Skip to content

Conversation

ScottDugas
Copy link
Collaborator

@ScottDugas ScottDugas commented Aug 18, 2025

Without this change, if you add a new query and run the test with CORRECT_METRICS, it will update all the timings for all of the other queries. This is less important for the binp, but can make it hard to look at the metrics yaml diff, as there will be many lines to ignore.

With this change, it will keep the original info for every query that did not result in a diffence.

I tested this locally by adding a new query to standard-tests.yamsql and seeing that when I correct the metrics, only the one in question is modified, and the rest stay the same.

Here is an example diff without this change: ScottDugas@8f0778f
And here is an example diff with it: ScottDugas@0253892

Without this change, if you add a new query and run the test with
CORRECT_METRICS, it will update all the timings for all of the
other queries. This is less important for the binp, but can make it
hard to look at the metrics yaml diff, as there will be many lines
to ignore.

With this change, it will keep the original info for every query
that did not result in a diffence.

I tested this locally by adding a new query to standard-tests.yamsql
and seeing that when I correct the metrics, only the one in question
is modified, and the rest stay the same.
@ScottDugas ScottDugas added the testing improvement Change that improves our testing label Aug 18, 2025
@ScottDugas ScottDugas closed this Aug 29, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
testing improvement Change that improves our testing
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant