Home
/
Cell-level evals
Cell-level evals · eval bucket
Identity, state, response.
Identity, state, and response to perturbation — reading a cell from its measured profile.
24
evals implemented · 3 families
01
Overview
The cell bucket grades a model on a cell's identity, state, and how it responds to
perturbation. 24 evals span 3 task
families, each a (task × dataset-arm) pair drawn
straight from the runtime registry.
02
Families
Task families present in this bucket, by eval count.
03
Catalog
Filter and sort every cell eval; expand any card for its IO contract.
Task all batch_integration cell_type_annotation multimodal_integration perturbation_prediction
Publication all hao_2024_nature_methods melton_2025_science_advances tian_2023_science wilson_2022_nature_communications
Modality all chromatin_accessibility gene_expression joint
sort Task Dataset Family Publication # metrics ↑
24 of 24 evals · 3 families
integration 15 batch_integration melton_2025_science_advances / 10x_multiome_chromatin_accessibility_full_counts@0.0.0-smoke · chromatin_accessibility 11m # ▸
batch_integration melton_2025_science_advances / 10x_multiome_chromatin_accessibility_testslice_counts@0.0.0-smoke · chromatin_accessibility 11m # ▸
batch_integration melton_2025_science_advances / 10x_multiome_full_seq@0.0.0-smoke · chromatin_accessibility 11m # ▸
batch_integration melton_2025_science_advances / 10x_multiome_full_seq@0.0.0-smoke · gene_expression 11m # ▸
batch_integration melton_2025_science_advances / 10x_multiome_gene_expression_full_counts@0.0.0-smoke · gene_expression 11m # ▸
batch_integration melton_2025_science_advances / 10x_multiome_gene_expression_testslice_counts@0.0.0-smoke · gene_expression 11m # ▸
batch_integration melton_2025_science_advances / 10x_multiome_testslice_seq@0.0.0-smoke · chromatin_accessibility 11m # ▸
batch_integration melton_2025_science_advances / 10x_multiome_testslice_seq@0.0.0-smoke · gene_expression 11m # ▸
batch_integration tian_2023_science / gene_expression@0.0.0 11m # ▸
batch_integration wilson_2022_nature_communications / cta_snRNA-seq_gene_expression_testslice_counts@0.0.1-smoke · gene_expression 11m # ▸
batch_integration wilson_2022_nature_communications / cta_snRNA-seq_gene_expression_testslice_seq@0.0.1-smoke · gene_expression 11m # ▸
batch_integration wilson_2022_nature_communications / snRNA-seq_gene_expression_full_counts@0.0.1-smoke · gene_expression 11m # ▸
batch_integration wilson_2022_nature_communications / snRNA-seq_gene_expression_full_seq@0.0.1-smoke · gene_expression 11m # ▸
multimodal_integration melton_2025_science_advances / 10x_multiome_diagonal@0.0.0-smoke 13m # ▸
multimodal_integration melton_2025_science_advances / 10x_multiome_diagonal_testslice@0.0.0-smoke 13m # ▸
cell_type_annotation 8 cell_type_annotation melton_2025_science_advances / 10x_multiome_full_seq@0.0.0-smoke · chromatin_accessibility 6m # ▸
cell_type_annotation melton_2025_science_advances / 10x_multiome_full_seq@0.0.0-smoke · gene_expression 6m # ▸
cell_type_annotation melton_2025_science_advances / 10x_multiome_full_seq@0.0.0-smoke · joint 6m # ▸
cell_type_annotation melton_2025_science_advances / cta_10x_multiome_chromatin_accessibility_counts@0.0.0-smoke 6m # ▸
cell_type_annotation melton_2025_science_advances / cta_10x_multiome_gene_expression_counts@0.0.0-smoke 6m # ▸
cell_type_annotation tian_2023_science / cell_type_annotation@0.0.0 6m # ▸
cell_type_annotation wilson_2022_nature_communications / cta_snRNA-seq_gene_expression_counts@0.0.1-smoke 6m # ▸
cell_type_annotation wilson_2022_nature_communications / cta_snRNA-seq_gene_expression_seq@0.0.1-smoke 6m # ▸
perturbation 1 perturbation_prediction hao_2024_nature_methods / norman_2019_science@0.0.1 2m # ▸