Skip to content

[codex] Update Prime env dataset loading#20

Draft
sileod wants to merge 1 commit into
mainfrom
codex/update-prime-formal-reasoning-env
Draft

[codex] Update Prime env dataset loading#20
sileod wants to merge 1 commit into
mainfrom
codex/update-prime-formal-reasoning-env

Conversation

@sileod

@sileod sileod commented May 7, 2026

Copy link
Copy Markdown
Owner

Summary

  • Default the Prime environment loader to reasoning-core/formal-reasoning-env.
  • Handle datasets that only expose train by taking eval examples from train after the train slice.
  • Filter rows to instruct / few_shot only when a mode column exists.

Validation

  • python -B -m py_compile reasoning_core/primeintellect/reasoning_core_env/reasoning_core_env.py
  • Installed runtime deps in an isolated Python 3.11 uv venv.
  • Confirmed via Hugging Face metadata that reasoning-core/rc1, reasoning-core/symbolic-reasoning-env, and reasoning-core/formal-reasoning-env currently expose only train; direct test loads fail with Bad split: test.
  • Smoke tested load_environment(num_train_examples=2, num_eval_examples=2) and confirmed train=2, eval=2.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant