Skip to content

Add Cowley2026 V4 neural benchmark#2456

Open
KartikP wants to merge 3 commits into
masterfrom
kp/cowley2026-benchmark
Open

Add Cowley2026 V4 neural benchmark#2456
KartikP wants to merge 3 commits into
masterfrom
kp/cowley2026-benchmark

Conversation

@KartikP

@KartikP KartikP commented Jun 30, 2026

Copy link
Copy Markdown
Collaborator

Adds the Cowley2026 V4 single-unit benchmark (Cowley et al., Nature 2026), session 190923: 33 neurons, 1200 images, PLS predictivity.

Two commits: the contributor's original submission, then the fixes to make it run.

Fixes:

  • disable CV stratification (no object categories), as in Cadena2017
  • even/odd repetition relabel so the split-half ceiling handles ragged repeats (4-28/image)
  • correct zip S3 version_id

Verified (private_access): alexnet 0.346 (raw r 0.528, ceiling 0.804); data and benchmark tests pass.

Three further sessions (201025, 210225, 211022) are uploaded and can be added the same way.

KartikP added 3 commits June 30, 2026 11:52
Files as submitted by Benjamin Cowley (CSHL), unmodified.
- disable CV stratification (no object categories)
- even/odd repetition relabel for ragged-repeat ceiling
- correct zip S3 version_id
- literal registry lines for plugin discovery; flatten to benchmark.py

alexnet 0.346 (raw r 0.528, ceiling 0.804); data and benchmark tests pass.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant