-
Notifications
You must be signed in to change notification settings - Fork 249
Open
Description
Hello,
I'm using Soda Core 3.5.2 with the Soda Library Python API to implement data quality monitoring. We use the scan.get_scan_results() method which returns a dictionary containing:
checks[] - our data quality check results
queries[] - the SQL queries executed during the scan
metrics[] - the metric values
Our Challenge
We need to establish a relationship between checks and their corresponding queries to store them in a relational database structure. We want to be able to query which SQL was executed for a specific check, especially for failed checks.
What we've observed
- Each check in checks[] has various metadata (identity, name, type, outcome, etc.)
- The queries[] array contains SQL queries with names, durations, and SQL text
- We need to understand how these two arrays relate to each other
My Questions
- What is the correct way to link a check to its executed SQL queries? Is there a specific field or pattern i should use?
- How can I determine which query (or queries) were executed for a specific check?
Any guidance on how to establish this relationship would be greatly appreciated!
Metadata
Metadata
Assignees
Labels
No labels