[Action] Tracking the energy consumption of GitHub Actions Pipelines

[all-green-dev]

Pipelines are not only a great tool for automating tedious tasks, they are also probably a mayor energy consumer. Optimizing them could be worthwhile, however their actual energy demand is currently neither visible nor well researched.

Eco-CI is an approach to measure/estimate the energy consumption of a GitHub Actions Pipeline. This could be a great tool to raise awareness and a first step towards optimization.

[ArneTR]

Thanks for mentioning our tooling @by-d-sign !

We are very happy to make a PR for a project of your choice. We wil integrate it on a fork and then generate some data so you have an idea how it looks like.

Which project shall it be? @nikimanoledaki @by-d-sign :)

[leonardpahlke]

Sounds like a great subject for a blog post @by-d-sign @ArneTR 😉 https://github.com/cncf/tag-env-sustainability/issues/new?assignees=&labels=blog&projects=&template=blog.md&title=%5BBLOG%5D+%3Cblog-title%3E

[leonardpahlke]

cc @savitharaghunathan

[AntonioDiTuri]

As we agreed during the WG regular meeting this is out of scope for the current milestone, thanks for adding the issue. We will circle back with a proposed action time after the KubeCon when we will have time to organize and prioritize issue for the next milestone. Info about the milestones are currently in the readme

[ArneTR]

I made a demo of how this would look for one of the workflows from Falco. I picked the only one that had a cron, as this shows the most simple integration:

• Workflow chosen: https://github.com/falcosecurity/falco/actions/workflows/scorecard.yaml
• Draft PR where the demo is integrated to show diff: Sample integration of Eco-CI to Falco Pipelines falcosecurity/falco#3121
• Generated data by Eco-CI: https://metrics.green-coding.io/ci.html?repo=green-coding-solutions/falco&branch=master&workflow=87453986

Additonal: @by-d-sign Eco-CI can also handle matrix/parallel Github Actions out of the box. Since you brought this up as a question in one of the last community meetings :)

[ArneTR]

Hey folks,

I hope you had a great KubeCon.

We have recently added some features to our Eco-CI tooling. Now it shows also the location of the running machine which then enables to include grid intensity as well as total CO2e emitted.

You can see it in this sample PR that we have made on a fork from the Falco repository.

Aggregation and timeline data is provided here: https://metrics.green-coding.io/ci.html?repo=green-coding-solutions/falco&branch=2/merge&workflow=87453986

Hope this ping is interesting for you :)

@ribalba: Looping you in

[leonardpahlke]

@nikimanoledaki @AntonioDiTuri ^

[ArneTR]

Hey folks,

after I month I thought I give this a gentle ping. Any update if you fancy to integrate Eco-CI into any projects?

We are super happy to help and provide a PR. Integration effort should be minimal.

We recently also approached other open source projects and can provide ready tested PRs. Example : NMF-earth/nmf-app#393

While doing so very often also some direct optimizations come into view. Example where we did this with NMF: NMF-earth/nmf-app#395