Skip to content

Support SynthPersona QA schema filters#2

Open
williamli-15 wants to merge 1 commit intomainfrom
codex/synthpersona-qa-schema-main
Open

Support SynthPersona QA schema filters#2
williamli-15 wants to merge 1 commit intomainfrom
codex/synthpersona-qa-schema-main

Conversation

@williamli-15
Copy link
Copy Markdown
Contributor

Summary

  • load current SynthPersona QA metadata such as source, bank_id, family_id, axis, choice labels, baseline flag, and explicit source fields
  • add get_qa filters for source, bank_id, and family_id
  • switch default train/test split to individual FRQ train rows and shared MCQ test rows
  • align BASELINE_PERSONA_ID with the public baseline_assistant persona
  • document FRQ/MCQ usage and split_group_id for leakage-aware splits

Tests

  • uv run --with pytest pytest tests/test_datasets.py
  • uv run python tests/smoke_test.py
  • real export smoke with local SynthPersona public preview

@williamli-15 williamli-15 force-pushed the codex/synthpersona-qa-schema-main branch 5 times, most recently from 60a5961 to b0c0190 Compare May 6, 2026 08:52
@williamli-15 williamli-15 force-pushed the codex/synthpersona-qa-schema-main branch from b0c0190 to f33913d Compare May 6, 2026 09:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant