Use a number regex for running spec examples

[vinistock]

Motivation

Since we cannot guarantee that we will discover spec examples at the exact order Minitest will (because of the runtime vs static analysis difference), we use line numbers to ensure that the discovery and result reporting IDs will match.

However, for running the tests, we cannot use the line number information as that may not match the spec ID Minitest has assigned to that particular example. We can fix that by substituting that part of the command for a regex.

Implementation

Minitest formats the spec count with 4 digits, so I started replacing the test_XXXX for the regex test_\d{4}. Note that this is still specific enough to run the right tests since we include the group's name and the rest of the example name.

Automated Tests

Updated our tests.

[vinistock]

• Use a number regex for running spec examples #3514 👈 (View in Graphite)
• main

---

How to use the Graphite Merge Queue

Add the label graphite-merge to this PR to add it to the merge queue.

You must have a Graphite account in order to use the merge queue. Sign up using this link.

An organization admin has enabled the Graphite Merge Queue in this repository.

Please do not merge from GitHub as this will restart CI on PRs being processed by the merge queue.

This stack of pull requests is managed by Graphite. Learn more about stacking.