Skip to content

System check providers running #619

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 9 commits into from
Jan 1, 2024
Merged

Conversation

ArneTR
Copy link
Member

@ArneTR ArneTR commented Dec 22, 2023

Metric providers can be left behind on the system in case of an unclean shutdown.

This PR introduces a system check to look for running providers in different GMT instance and also adds a test case to test the guard clause to trigger.

* main:
  Switched from cmd to command (#615)
  Hotfix for check on frequency provider
  Tests run_until must be guard-claused with cleanup routine (#616)
* main:
  Text change
  Value formatting on status page
  Normalized URL for machines endpoint
  Less confusing error messages
  Status has now a waiting time (#599)
  Run ID is now accessible even after fail and thus can be sent via ema… (#601)
Copy link

github-actions bot commented Dec 23, 2023

Old Energy Estimation

Eco-CI Output:

Label 🖥 avg. CPU utilization [%] 🔋 Total Energy [Joules] 🔌 avg. Power [Watts] Duration [Seconds]
Total Run 10.5937 1682.52 2.56482 664
Measurement #1 10.6233 1682.52 2.56482 658

📈 Energy graph:

 
 7.74 ┤                                     ╭╮                ╭╮
 7.14 ┤                                     ││                ││
 6.55 ┤                                     ││                ││
 5.95 ┤          ╭╮                         ││           ╭─╮  │╰─╮
 5.35 ┤        ╭╮││                         │╰╮         ╭╯ ╰╮ │  ╰╮
 4.75 ┤      ╭╮││││                        ╭╯ ╰╮╭─╮╭╮   │   │ │   │
 4.16 ┤     ╭╯╰╯╰╯╰╮  ╭─╮ ╭╮   ╭─╮   ╭─╮  ╭╯   ╰╯ ╰╯╰╮ ╭╯   ╰─╯   │        ╭╮╭╮╭╮                          ╭╮╭╮ ╭╮    ╭╮ ╭╮            ╭╮           ╭╮                                         ╭╮  ╭────╮       ╭╮               ╭╮                                                 ╭╮            ╭─╮                        ╭─╮                        ╭╮                        ╭─╮                          ╭╮                          ╭╮                           ╭╮                                                   ╭╮                                                  ╭╮                                                                     ╭─╮
 3.56 ┤     │      ╰──╯ ╰─╯╰───╯ ╰───╯ ╰─╮│          ╰╮│          │       ╭╯╰╯╰╯╰╮         ╭╮╭╮        ╭╮ ╭╯╰╯╰─╯╰────╯╰─╯╰──╮         │╰─╮         │╰─╮         ╭──╮         ╭──╮         ╭───╯╰──╯    ╰───────╯╰─────╮         │╰─╮         ╭──╮         ╭─╮         ╭──╮         │╰─╮         ╭╯ ╰╮         ╭╮        ╭╮ ╭╯ ╰╮                   ╭╮ ╭╯╰─╮                  ╭╮ ╭╯ ╰╮         ╭╮╭╮        ╭╮ ╭╯╰─╮        ╭─╮         ╭╮ ╭╯╰─╮        ╭─╮╭╮        ╭╮╭─╯╰─╮        ╭─╮         ╭╮ ╭──╮          ╭─╮         │╰─╮          ╭─╮         ╭─╮         ╭───╮         │╰─╮           ╭───╮        ╭─╮           ╭──╮        ╭─╮           ╭──╯ ╰─╮        ╭─╮         ╭╮ ╭─
 2.96 ┤    ╭╯                            ││           ││          │       │      ╰╮        │╰╯│        ││ │                  │         │  │         │  ╰╮        │  │         │  │         │                           │         │  │         │  │         │ ╰╮        │  │         │  ╰╮        │   │         ││        ││ │   │         ╭╮        ││ │   │                  ││ │   │        ╭╯│││        ││ │   │        │ │         ││ │   │        │ │││       ╭╯││    │        │ ╰╮        ││ │  ╰╮        ╭╯ │         │  │         ╭╯ │         │ │         │   │        ╭╯  ╰╮          │   │        │ ╰╮          │  │        │ │╭╮         │      │        │ │         │╰╮│
 2.37 ┤    │                             ╰╯           ││          │       │       │       ╭╯  │        ││ │                  │         │  ╰╮        │   │        │  │         │  │         │                           │        ╭╯  │         │  │        ╭╯  │        │  ╰╮        │   │        │   ╰╮        ││        ││ │   ╰╮        ││       ╭╯│╭╯   │        ╭╮        ││ │   │        │ │││       ╭╯│ │   │        │ ╰╮        ││ │   │        │ │││       │ ││    │       ╭╯  │        ││ │   │        │  │         │  │         │  │         │ │         │   │        │    ╰╮       ╭╮│   │       ╭╯  │          │  │        │ ╰╯│         │      │        │ │╭╮       │ ││
 1.77 ┼────╯                                          ╰╯          ╰───────╯       ╰───────╯   ╰────────╯╰─╯                  ╰─────────╯   ╰────────╯   ╰────────╯  ╰─────────╯  ╰─────────╯                           ╰────────╯   ╰─────────╯  ╰────────╯   ╰────────╯   ╰────────╯   ╰────────╯    ╰────────╯╰────────╯╰─╯    ╰────────╯╰───────╯ ╰╯    ╰────────╯╰────────╯╰─╯   ╰────────╯ ╰╯╰───────╯ ╰─╯   ╰────────╯  ╰────────╯╰─╯   ╰────────╯ ╰╯╰───────╯ ╰╯    ╰───────╯   ╰────────╯╰─╯   ╰────────╯  ╰─────────╯  ╰─────────╯  ╰─────────╯ ╰─────────╯   ╰────────╯     ╰───────╯╰╯   ╰───────╯   ╰──────────╯  ╰────────╯   ╰─────────╯      ╰────────╯ ╰╯╰───────╯ ╰╯
                                                                                                                                                                                                                                                                                                                                       Watts over time

@ArneTR ArneTR requested a review from ribalba December 28, 2023 09:57
ArneTR added 2 commits January 1, 2024 08:07
* main:
  Stderr is now by default UTF-8 (#624)
  Refactored kill/killpg mechanism to be unified and actually fail on n… (#625)
  Command fix. Must be list append
  Refactorings
  Moved tinyproxy out of if clause
  Refactoring for error messages and security fix for path echoing (#636)
  GMT color via own commit hash (#634)
  Hotfix for branch not main
  Non-Blocking starlette body read (#633)
  Bump fastapi from 0.105.0 to 0.108.0 (#632)
  Updated XGBoost submodule
  Bump pydantic from 2.5.2 to 2.5.3 (#628)
  Added stddev to timeline (#627)
  Disable tinyproxy systemd service (#623)
Copy link

github-actions bot commented Jan 1, 2024

Eco-CI Output:

Label 🖥 avg. CPU utilization [%] 🔋 Total Energy [Joules] 🔌 avg. Power [Watts] Duration [Seconds]
Total Run 10.8203 1796.98 2.60055 699
Measurement #1 10.897 1796.98 2.60055 693

📈 Energy graph:

 
 7.70 ┤                                                             ╭╮                 ╭╮
 7.11 ┤                                                             ││                 ││
 6.51 ┤         ╭╮                                                  ││            ╭╮   ││
 5.92 ┤         ││                                                  ││            ││   ││╭╮
 5.33 ┤       ╭─╯│                                                 ╭╯╰╮          ╭╯╰─╮ │╰╯│
 4.73 ┤       │  │                                       ╭╮        │  │╭──╮╭─╮   │   │╭╯  ╰╮            ╭╮
 4.14 ┤      ╭╯  ╰─╮  ╭─╮    ╭──╮ ╭──╮        ╭─╮╭─╮   ╭─╯╰──╮     │  ││  ╰╯ │  ╭╯   ╰╯    │        ╭╮╭╮││                            ╭╮  ╭╮╭─╮ ╭╮ ╭─╮                                                                  ╭╮╭╮  ╭─────╮        ╭╮                 ╭╮                                                               ╭╮                         ╭╮                         ╭╮                        ╭─╮                          ╭─╮                          ╭╮                           ╭╮                                                                  ╭╮                                    ╭╮╭╮            ╭╮                                                    ╭───╮                          ╭─
 3.55 ┤     ╭╯     ╰──╯ ╰────╯  ╰─╯  ╰──╮     │ ╰╯ ╰───╯     ╰──╮ ╭╯  ╰╯     ╰╮ │          │       ╭╯╰╯││╰─╮         ╭╮         ╭╮ ╭──╯╰──╯││ ╰─╯╰─╯ ╰─╮         ╭───╮         ╭──╮         ╭──╮         ╭──╮         ╭─╯││╰──╯     ╰────────╯╰──╮ ╭╮         ╭─╯╰╮         ╭──╮        ╭───╮        ╭──╮         ╭───╮         ╭╯╰─╮         ╭╮        ╭╮╭─╯╰─╮                   ╭╮╭─╯╰─╮                  ╭╮ ╭╯ ╰╮          ╭╮         ╭╮ ╭╯ ╰╮         ╭╮          ╭╮╭─╯╰─╮         ╭╮╭╮        ╭╮╭─╯╰─╮         ╭╮         ╭╮ ╭───╮         ╭─╮         ╭───╮         ╭╯│          ╭─╮         ╭───╮        ╭╯╰╯│╭╮          │╰─╮         ╭╮           ╭───╮        ╭─╮           ╭╯   ╰─╮         ╭╮          ╭╮ │
 2.95 ┤     │                           ╰╮    │                 │╭╯           │ │          │       │   ││  │        ╭╯│╭╮       ││ │       ╰╯          │         │   │         │  │         │  │         │  │         │  ╰╯                      │ ││         │   │         │  │        │   │        │  ╰╮        │   │         │   │         ││       ╭╯││    │         ╭╮       ╭╯││    │                  ││ │   ╰╮        ╭╯╰╮        ││ │   ╰╮        │╰─╮        │││    │         ││││       ╭╯││    │        ╭╯│╭╮       │╰╮│   │         │ ╰╮        │   │         │ ╰╮         │ │         │   │        │   │││          │  │        ╭╯│╭╮         │   │        │ ╰╮          │      ╰╮        │╰─╮        ││ │
 2.36 ┤    ╭╯                            │    │                 ││            │╭╯          │       │   ││  │       ╭╯ ╰╯│       │╰╮│                   ╰╮        │   │ ╭╮     ╭╯  │         │  │         │  │         │                          │╭╯╰╮        │   │        ╭╯  │        │   │        │   │        │   │        ╭╯   │         ││       │ ││    │         ││       │ ││    │        ╭╮        ││ │    │       ╭╯  ╰╮       │╰╮│    │       ╭╯  │       ╭╯││    │       ╭─╯│││       │ ││    │       ╭╯ ╰╯│       │ ││   │         │  │        │   │         │  │        ╭╯ │         │   │        │   │││       ╭╮ │  │        │ ╰╯│         │   │       ╭╯  │          │       │       ╭╯  │        ││ │
 1.77 ┼────╯                             ╰────╯                 ╰╯            ╰╯           ╰───────╯   ╰╯  ╰───────╯    ╰───────╯ ╰╯                    ╰────────╯   ╰─╯╰─────╯   ╰─────────╯  ╰─────────╯  ╰─────────╯                          ╰╯  ╰────────╯   ╰────────╯   ╰────────╯   ╰────────╯   ╰────────╯   ╰────────╯    ╰─────────╯╰───────╯ ╰╯    ╰─────────╯╰───────╯ ╰╯    ╰────────╯╰────────╯╰─╯    ╰───────╯    ╰───────╯ ╰╯    ╰───────╯   ╰───────╯ ╰╯    ╰───────╯  ╰╯╰───────╯ ╰╯    ╰───────╯    ╰───────╯ ╰╯   ╰─────────╯  ╰────────╯   ╰─────────╯  ╰────────╯  ╰─────────╯   ╰────────╯   ╰╯╰───────╯╰─╯  ╰────────╯   ╰─────────╯   ╰───────╯   ╰──────────╯       ╰───────╯   ╰────────╯╰─╯
                                                                                                                                                                                                                                                                                                                                                         Watts over time

@ArneTR ArneTR merged commit 5413d50 into main Jan 1, 2024
@ArneTR ArneTR deleted the system-check-providers-running branch January 1, 2024 07:27
ArneTR added a commit that referenced this pull request Jan 1, 2024
* main: (23 commits)
  System check providers running (#619)
  Stderr is now by default UTF-8 (#624)
  Refactored kill/killpg mechanism to be unified and actually fail on n… (#625)
  Command fix. Must be list append
  Refactorings
  Moved tinyproxy out of if clause
  Refactoring for error messages and security fix for path echoing (#636)
  GMT color via own commit hash (#634)
  Hotfix for branch not main
  Non-Blocking starlette body read (#633)
  Bump fastapi from 0.105.0 to 0.108.0 (#632)
  Updated XGBoost submodule
  Bump pydantic from 2.5.2 to 2.5.3 (#628)
  Added stddev to timeline (#627)
  Disable tinyproxy systemd service (#623)
  Text change
  Value formatting on status page
  Normalized URL for machines endpoint
  Less confusing error messages
  Status has now a waiting time (#599)
  ...
ArneTR added a commit that referenced this pull request Jan 1, 2024
* main:
  Adds skip_checks to providers (#566)
  Bump pytest from 7.4.3 to 7.4.4 (#639)
  Disabled second PSU provider for VM tests
  System check providers running (#619)
  Stderr is now by default UTF-8 (#624)
  Refactored kill/killpg mechanism to be unified and actually fail on n… (#625)
  Command fix. Must be list append
  Refactorings
  Moved tinyproxy out of if clause
  Refactoring for error messages and security fix for path echoing (#636)
ArneTR added a commit that referenced this pull request Jan 1, 2024
* main:
  Dev mode (#637)
  Hotfix: resolutions -> resolution
  Adds skip_checks to providers (#566)
  Bump pytest from 7.4.3 to 7.4.4 (#639)
  Disabled second PSU provider for VM tests
  System check providers running (#619)
  Stderr is now by default UTF-8 (#624)
  Refactored kill/killpg mechanism to be unified and actually fail on n… (#625)
  Command fix. Must be list append
  Refactorings
  Moved tinyproxy out of if clause
  Refactoring for error messages and security fix for path echoing (#636)
ArneTR added a commit that referenced this pull request Jan 2, 2024
* main:
  Dev mode (#637)
  Hotfix: resolutions -> resolution
  Adds skip_checks to providers (#566)
  Bump pytest from 7.4.3 to 7.4.4 (#639)
  Disabled second PSU provider for VM tests
  System check providers running (#619)
  Stderr is now by default UTF-8 (#624)
  Refactored kill/killpg mechanism to be unified and actually fail on n… (#625)
  Command fix. Must be list append
  Refactorings
  Moved tinyproxy out of if clause
  Refactoring for error messages and security fix for path echoing (#636)
  GMT color via own commit hash (#634)
  Hotfix for branch not main
  Non-Blocking starlette body read (#633)
  Bump fastapi from 0.105.0 to 0.108.0 (#632)
  Updated XGBoost submodule
  Bump pydantic from 2.5.2 to 2.5.3 (#628)
  Added stddev to timeline (#627)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants