Skip to content

ci: ensure all declared AI TAP tests are built and executed #6103

Description

@renecannao

Context

Both AI group definitions declare 22 tests, but the #6083 runs execute only 16 tests in ai-g1 and 17 tests in ai-g2.

The ubuntu24-tap-genai-gcov build sets SKIP_GENAI_UNIT_TESTS=1 and prunes GenAI unit binaries for disk usage, while the groups still register those binaries. The absent tests are therefore silently skipped rather than reported as skipped or assigned elsewhere.

Missing from ai-g1

  • genai_config_query_unit-t
  • genai_discovery_schema_unit-t
  • genai_fts_string_unit-t
  • genai_llm_clients_unit-t
  • genai_mcp_endpoint_unit-t
  • genai_mcp_thread_unit-t

Missing from ai-g2

  • genai_mysql_catalog_unit-t
  • genai_query_handler_unit-t
  • genai_rag_fetch_from_source_unit-t
  • genai_stats_parsing_unit-t
  • genai_thread_unit-t

Acceptance criteria

  • CI reports a declared-but-missing test binary as an error or explicit skip; it is never silently omitted.
  • Every listed test is built and executed in a documented job, or removed from the AI integration group with a documented replacement.
  • Group summaries reconcile declared, selected, skipped, and executed counts.
  • Disk-usage constraints are handled without silently reducing coverage.
  • The existing CI-unit-tests-asan-coverage workflow remains unchanged unless separately approved.

Parent: #6098
Observed in: #6083
Related layout discussion: #5735

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    GHarea/testAutomated testing infrastructurestatus/confirmedIssue has been confirmed/reproducedtype/testTest improvement, comment, change, or request

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions