Got rid of time.time() everywhere

[excitoon]

Pull Request check-list

Please make sure to review and check all of these items:

• Do tests and lints pass with this change?
• Do the CI tests pass with this change (enable it first in your forked repo and wait for the github action build to finish)?
• Is the new or changed code fully tested?
• Is a documentation update included (if this change modifies existing APIs, or introduces new ones)?
• Is there an example added to the examples folder (if applicable)?
• Was the change added to CHANGES file?

NOTE: these things are not required to open a PR and can be done
afterwards / while the PR is open.

Description of change

Made time calculations more stable, in library itself and in tests as well.

[excitoon]

@andymccurdy please run CI/CD

[petyaslavova]

Hi @excitoon , thank you for your contribution! We’ll review your change soon.

[petyaslavova]

LGTM