Skip to content

test run ci workflow#1

Merged
prashanthjaganathan merged 2 commits into
devfrom
main
Feb 14, 2026
Merged

test run ci workflow#1
prashanthjaganathan merged 2 commits into
devfrom
main

Conversation

@prashanthjaganathan

@prashanthjaganathan prashanthjaganathan commented Feb 14, 2026

Copy link
Copy Markdown
Owner

Description

Testing PR with CI workflow and branch protection

Dataset-Specific (if implementing a new dataset)

  • Created data-pipeline/src/datasets/{dataset}/ingest.py with watermark support
  • Created data-pipeline/src/datasets/{dataset}/preprocess.py with all transformations
  • Created data-pipeline/src/datasets/{dataset}/features.py with documented features
  • Created data-pipeline/schemas/{dataset}/raw_schema.json
  • Created data-pipeline/schemas/{dataset}/processed_schema.json
  • Created data-pipeline/schemas/{dataset}/features_schema.json
  • Created data-pipeline/configs/datasets/{dataset}.yaml with API endpoint and schedule
  • Created data-pipeline/dags/datasets/{dataset}_dag.py with all validation stages
  • Added bias slice configurations
  • Created data-pipeline/src/datasets/{dataset}/README.md with dataset documentation
  • Added tests in data-pipeline/tests/unit/datasets/{dataset}/

Schema Changes (if modifying schemas)

  • Schema changes are backwards compatible OR migration plan is documented
  • Schema tests have been added/updated
  • TFDV statistics will be regenerated

@prashanthjaganathan
prashanthjaganathan merged commit eb15a9a into dev Feb 14, 2026
4 of 10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant