Skip to content

feat: DM-4756 add unstructured discovery to the client - #79

Open
tmtsmrsl wants to merge 23 commits into
mainfrom
DM-4756-unstructured-discovery-client
Open

tmtsmrsl wants to merge 23 commits into
mainfrom
DM-4756-unstructured-discovery-client

Conversation

@tmtsmrsl

Copy link
Copy Markdown

Adds unstructured discovery to the client: get_unstructured_discovery_folder_page, get_unstructured_discovery_file_page, get_unstructured_discovery_summary, get_unstructured_discovery_report (a CSV, or a ZIP of CSV parts for a large run) and get_last_unstructured_discovery_run_id, which reads the run list. RunInfo gains discovery_kind and the AI Engine fields.

Companion to datamasque/datamasque!4157. It needs a DataMasque version with unstructured discovery, so release it after that version.

Tests: unit tests for each call, the CSV and ZIP report, the run-list lookup and the new RunInfo fields. uv run pytest (612 passed) and make lint (ruff, format, mypy) pass. The live tests for these calls passed against a stack running the companion DataMasque branch (44 passed) before this branch was rebased onto main; they run again with the companion live-test change.

Timotius added 23 commits November 11, 2026 09:38
@tmtsmrsl tmtsmrsl self-assigned this Nov 10, 2026
@tmtsmrsl
tmtsmrsl marked this pull request as ready for review November 11, 2026 02:26
@tmtsmrsl
tmtsmrsl requested a review from alxboyle November 11, 2026 04:14

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant