[caiopizzol]

Problem

Test integrity only knew JavaScript tests. On a Python change that weakens tests four ways, it caught only the deleted test file. A new @pytest.mark.skip, an added return before the assertions, and removed assertions all passed.

Change

Detector only (detect.ts). The Python gate is a separate follow-up: the justfile, uv run pytest, and pytest options in pyproject.toml.

• Test files. test_*.py, *_test.py, and conftest.py are test files, as are files under tests/ as before. Deleting one blocks.
• Skips block. Each language now has its own rules; JavaScript's are unchanged. The Python ones:
  • pytest and unittest skip and expected-failure markers, as decorators (@pytest.mark.skip, @unittest.skip, @skip), as marks (pytestmark =, pytest.param(marks=…)), or as calls (pytest.skip(), pytest.xfail(), pytest.importorskip(), self.skipTest(), SkipTest);
  • __test__ = False and collect_ignore, which stop pytest collecting tests.
• Conditional skips report instead of blocking. A skipif, skipIf, skipUnless, or xfail whose condition compares sys.platform, os.name, platform.system(), or an environment variable with a string, and whose reason is plain text. The rules match the JavaScript ones: truthiness conditions such as not IMAGE still block, and so does an or that is always true. skipUnless is read inverted, because it skips when its condition is false.
• Early exits block. An added bare return, or return None, in a Python test file.
• Assertions. Removed assert statements, self.assert…(), mock .assert_…() calls, and pytest.raises() or pytest.warns() are counted.

Verification

• bun run check passes; 93 package tests.
• Each new rule has a control: removing it fails a named test. There are 16 controls.
• Replayed over the last 200 commits of a public pytest repository, each commit against its parent: 5 blocked, 0 errors. Each block would need the label:
  • a refactor that moved tests into a new directory, which the detector sees as deletions;
  • two skipif calls on truthiness conditions;
  • a fixture that skips when PostgreSQL is absent;
  • a helper that added return None.
• The JavaScript replay over two TypeScript repositories gives identical results before and after.

🤖 Generated with Claude Code

[cubic-dev-ai]

All reported issues were addressed across 2 files

<sub>Reply with feedback, questions, or to request a fix.

Re-trigger cubic</sub>