01
Spec
| Target | GO term prediction (molecular function) — GO release 2026-05-19 (OBO) / GAF 2026-05-21, experimental-evidence only, terms with 15-500 annotated genes, paralog/gene-family-aware split (Ensembl Compara family ids), true-path-consistent positives propagated over is_a + part_of, shipping conditional information accretion (ia) alongside marginal ic. |
|---|---|
| Axis | Function & pathways — Molecular function, biological process, and pathway membership. |
| Shape | Term membership (multi-label) · metric family: f_max |
| Task | gene_function_classification / gene_function |
| Dataset | ashburner_2000_nature_genetics/go_mf@0.0.3 |
| Publication | ashburner_2000_nature_genetics |
| Metrics |
|
| Temporal discovery | no — held-out genes |
| License | Declared per SPDX in the dataset's recipe README ↗ (commercial-use gated by CI). |
| References |
|
IO contract
- ic_column
- ic
- pairing_key
- gene_term
- required_metadata
- gene_id, term
- target_kind
- binary
02
What the prediction looks like
This eval has the term membership (multi-label) shape. The figure is seeded to it — drag the control to watch the score respond.
A gene × term grid — which terms does the gene carry?
Used by GO · pathways · HPO · disease · domains · cell-type & tissue markers · lineage · temporal discovery
DNA repair
apoptosis
cell cycle
transcription
immune resp.
metabolism
TP53
BRCA1
MYC
CDK1
ALB
truth — gene really carries the term model calls it present (p ≥ threshold)cell shade = predicted probability
Precision89%
Recall89%
F1 @ thr0.89
Fmax0.95
Truth is sparse — most cells are 0. The model emits a probability per cell (the shading); Fmax sweeps the threshold to the best-F1 operating point, so no single arbitrary cutoff is punished. Cell-type, lineage and temporal-discovery evals reuse this exact grid.
03
Run it
Fetch the censored splits, predict, score — task and dataset filled in.
import prima_bench as pb
# Downloads on demand into the local cache; returns local Paths.
train_path, test_path = pb.fetch_data(task="gene_function_classification", dataset="ashburner_2000_nature_genetics/go_mf@0.0.3")
train = pb.load(train_path, task="gene_function_classification", split="train", dataset="ashburner_2000_nature_genetics/go_mf@0.0.3")
test = pb.load(test_path, task="gene_function_classification", split="test", dataset="ashburner_2000_nature_genetics/go_mf@0.0.3")
# Your model produces predictions aligned to the eval input.
predictions = my_model(test)
# Score against the censored solution over this task's metric panel:
# gene_function_term_auprc, gene_function_term_auroc, gene_function_micro_auprc, gene_function_fmax, gene_function_smin
run = pb.Evaluation(task="gene_function_classification", dataset="ashburner_2000_nature_genetics/go_mf@0.0.3")
run.update(predictions=predictions) # one-shot; or stream shard-by-shard
result = run.compute() # -> EvalResult
print(result)
04
Results
Awaiting scored models — the row scaffold is live; numbers land with results.json.
Awaiting results · prima-bench
go_mf · leaderboard
Evals
1
graded
Datasets
1
sources
Models
—
pending
Best score
—
pending
No
results.json wired up yet. The eval scaffold below is live; drop a document matching src/data/results.schema.md at src/data/results.json (or pass a results prop) and every bar fills in. Each track's tick marks the chance baseline.Gene Function
1| Eval | Score | awaiting |
|---|---|---|
go_mfashburner_2000_nature_genetics/go_mf@0.0.3 | — |