Skip to content

fix(benchmarks): remove qwen3.6-plus inherited predecessor scores from personality card - #26

Open
TechNickAI wants to merge 2 commits into
mainfrom
fix/qwen36-plus-charter-violation
Open

fix(benchmarks): remove qwen3.6-plus inherited predecessor scores from personality card#26
TechNickAI wants to merge 2 commits into
mainfrom
fix/qwen36-plus-charter-violation

Conversation

@TechNickAI

Copy link
Copy Markdown
Owner

What this fixes

The Qwen3.6 Plus personality card on heartcentered.ai/model-benchmarks/ has been publishing four inherited numbers as prose:

  • "highest sycophancy (6.2) and lowest EQ score (60.45)"
  • Trait chips: Sycophancy 6.2 / EQ 60.45 / Warmth 13.4
  • "(Benchmark data from Qwen3.5-397B predecessor)"

These are from the predecessor model, not from any run on Qwen3.6 Plus itself. The charter's non-negotiable says never present a successor model's score as a predecessor's, and the footnote is an admission, not a remedy.

The data layer was already cleanedmodel-data.json shows benchmarks.eq_bench: {} for qwen/qwen3.6-plus:free (verified live). But the prose copy in index.html was never touched, so the four numbers stayed live on the public site for visitors to read as real data. This is exactly the failure the project's own guardrail names: removing bad data without grepping the rendered HTML.

The fix

The card now honestly states the model has no EQ-Bench data. Empty is honest; an inherited number is a lie that looks like data.

One file changed: model-benchmarks/index.html (+7/−11 lines). No data, JS, or other pages touched.

Verification

  • The four inherited numbers (6.2, 60.45, 13.4) no longer appear in the personality card
  • The predecessor parenthetical is removed
  • HTML tag balance verified: <div> and <p> counts match before/after
  • The data layer was already clean — this is a prose-only fix

Decision needed

Merge this PR to fix the charter violation on the live site, or say no and I'll close it. The pre-declared default (per the 2026-07-30 zoom-out) was: if no answer by 2026-07-31 18:00Z, Cora opens the PR and leaves it for Nick to merge. This is that PR — opened at 10:05Z, well before the deadline. Merging prose to main is Nick's call by charter.

Nick Sullivan and others added 2 commits July 31, 2026 05:06
…m personality card

The Qwen3.6 Plus personality card published four numbers (sycophancy 6.2,
EQ 60.45, warmth 13.4) inherited from the Qwen3.5-397B predecessor, with a
parenthetical admitting the inheritance. The charter's non-negotiable: never
present a successor model's score as a predecessor's. The data layer was
already cleaned (eq_bench: {} in model-data.json), but the prose copy in
index.html remained live — the exact guardrail failure of removing bad data
without grepping the rendered HTML.

The card now honestly states the model has no EQ-Bench data. Empty is honest.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant