[3.0] Introduce test-bot and tag-based test suite for PR

[crazywhalecc]

This would help us not update test-extensions.php manually.

1. When new PR is created, run bin/spc test-bot can automatically generate required tests for extensions and libraries, using reverse registry files lookup function.
2. Make github bot to push a message to recommend tags if not set.
3. Analyse tags and generate matrix to test extensions.

[crazywhalecc]

PR Test Bot — Design & Label Specification

Overview

The PR test-bot is a GitHub Actions workflow that analyzes pull request changes and posts an informational comment describing what will be tested. Humans apply labels to control which tests run; the bot only reads labels and comments.

The entire system is gated behind the need-test label. No label → no action.

---

Trigger Mechanism

on:
  pull_request:
    types: [labeled, synchronize, reopened]

The first job in the workflow checks whether need-test is present on the PR. If not, the entire pipeline is skipped. When need-test is added or removed between pushes, the next synchronize event re-evaluates the gate.

---

Label Reference

Trigger gate

Label	Meaning
need-test	Master switch — must be present for any test logic to run

Platform labels

Label	Runners	Notes
test/linux	ubuntu-24.04 (x86_64) + ubuntu-24.04-arm (aarch64)	Each runner builds both musl and glibc via SPC_TARGET, giving 4 job cells
test/windows	windows-2025 x64	MSVC toolchain; fpm/cgi/frankenphp/embed excluded
test/macos	macos-15 (arm64) + macos-15-intel (x86_64)	Native toolchain, 2 job cells

PHP version labels

If none of these labels is present, the default is PHP 8.5 NTS.

Label	PHP version	Thread safety
test/83-nts	8.3	NTS
test/83-zts	8.3	ZTS
test/84-nts	8.4	NTS
test/84-zts	8.4	ZTS
test/85-nts	8.5	NTS
test/85-zts	8.5	ZTS

Scale labels (independent jobs)

These are separate jobs from per-change matrix tests. They run a fixed preset against a fixed set of 4 platforms (Linux musl x86_64, Linux glibc x86_64, Windows x64, macOS arm64) using PHP 8.5 NTS, with all SAPIs enabled (cli, micro, fpm, cgi, frankenphp, embed — Windows only gets cli + micro).

Label	Extension preset	SAPIs
test/base	base (minimal: pcntl, posix, mbstring, tokenizer, phar)	All (platform-permitting)
test/max	max (bulk: full common extension set)	All (platform-permitting)

---

Workflow Job Structure

check-need-test
      │ (skip if need-test absent)
      ▼
  test-bot   ←─ php spc dev:test-bot --pr=N --repo=owner/repo
      │              outputs: matrix JSON, has_platform_labels,
      │                       has_base, has_max
      │
      ├──────────────────────────────────┐
      ▼                                  ▼
per-change-matrix-test            scale-test
  if: has_platform_labels           if: has_base || has_max
  dynamic matrix                    fixed 4-platform matrix
  SAPIs: cli + micro                SAPIs: all (platform-permitting)

---

Per-Change Matrix Test

How the extension set is built from changed files

Changed file path pattern	Action
src/Package/Extension/{name}.php	Add {name} to extension set
config/pkg/ext/ext-{name}.yml	Add {name} to extension set
src/Package/Library/{name}.php	Scan all config/pkg/ext/*.yml; add any extension whose depends includes {name}
config/pkg/lib/{name}.yml	Same as above
src/Package/Target/{name}.php	Listed in comment as "Targets" — does not affect extension set
config/pkg/target/{name}.yml	Same as above

All affected extensions are merged into a single set per platform × version cell — no per-package jobs.

Matrix shape

Columns driven by active platform + version labels:

os × spc_target × php_version × zts  →  1 job cell each

Example with test/linux + test/85-zts:

os	spc_target	php	zts
ubuntu-24.04	musl	8.5	true
ubuntu-24.04	glibc	8.5	true
ubuntu-24.04-arm	musl	8.5	true
ubuntu-24.04-arm	glibc	8.5	true

---

dev:test-bot Command

php spc dev:test-bot --pr=<number> --repo=<owner/repo>

GitHub API calls

1. GET /repos/{repo}/pulls/{pr}/files — changed files
2. GET /repos/{repo}/issues/{pr}/labels — current labels
3. POST /repos/{repo}/issues/{pr}/comments (or PATCH to update existing bot comment)

Auth via GITHUB_TOKEN environment variable (reuses GitHubTokenSetupTrait).

Idempotency

The bot embeds a hidden HTML marker <!-- spc-test-bot --> at the top of its comment. On subsequent runs it finds this comment via the list-comments API and updates it with PATCH, rather than posting a new one.

---

Bot Comment Format

When no platform labels are set

<!-- spc-test-bot -->

**StaticPHP Test Bot**

This PR modifies the following components:
- **Extensions**: `redis`, `swoole`
- **Libraries**: `openssl`, `nghttp2`, `libssh2`
- **Targets**: _(none)_

No platform labels are set. To trigger per-change tests, add one or more platform labels:

**Platform** (required):
`test/linux`  `test/windows`  `test/macos`

**PHP version** (optional — defaults to `85-nts`):
`test/83-nts`  `test/83-zts`  `test/84-nts`  `test/84-zts`  `test/85-nts`  `test/85-zts`

**Scale** (optional — independent jobs, fixed 4 platforms, all SAPIs):
- `test/base` — base preset (minimal extensions)
- `test/max` — max preset (bulk extensions)

> ⚠️ This PR modifies **14 libraries**. Consider adding `test/base` or `test/max` for full preset regression coverage.

When platform labels are present

<!-- spc-test-bot -->

**StaticPHP Test Bot**

This PR modifies the following components:
- **Extensions**: `redis`, `swoole`
- **Libraries**: `openssl`, `nghttp2`
- **Targets**: _(none)_

Based on current labels (`test/linux`, `test/windows`, `test/85-zts`, `test/max`), the following jobs will run:

**Per-change tests** — testing extensions: `openssl`, `redis`, `swoole` (derived from changed libraries + extensions)

| Platform | spc_target | PHP | ZTS | SAPIs |
|---|---|---|---|---|
| ubuntu-24.04 | musl | 8.5 | ✓ | cli, micro |
| ubuntu-24.04 | glibc | 8.5 | ✓ | cli, micro |
| ubuntu-24.04-arm | musl | 8.5 | ✓ | cli, micro |
| ubuntu-24.04-arm | glibc | 8.5 | ✓ | cli, micro |
| windows-2025 | msvc | 8.5 | ✓ | cli, micro |

**Scale test** (`test/max`) — max preset, PHP 8.5 NTS, fixed platforms

| Platform | spc_target | SAPIs |
|---|---|---|
| ubuntu-24.04 | musl | cli, micro, fpm, cgi, frankenphp, embed |
| ubuntu-24.04 | glibc | cli, micro, fpm, cgi, frankenphp, embed |
| windows-2025 | msvc | cli, micro |
| macos-15 | native | cli, micro, fpm, cgi, frankenphp, embed |

---

Recommended GitHub Label Colors

Label	Suggested color
need-test	#e4e669 (yellow)
test/linux	#0075ca (blue)
test/windows	#0e8a16 (green)
test/macos	#6f42c1 (purple)
test/8x-nts / test/8x-zts	#d93f0b (orange)
test/base	#bfd4f2 (light blue)
test/max	#1d76db (dark blue)