Geneformer Eval

Evaluation of Geneformer (30M transformer pretrained on single-cell corpus) on zero-shot & few-shot downstream tasks.

Composite
77.0
Experimental validation
Wet-lab confirmed
Stages
Virtual Cell
Modalities
cross-modality
Task types
cell-type-annotationgene-dosage
Size
cells: 30,000,000
tasks: 7
License
MIT
First release
2023-06
Last updated
2024-11
Official site
→ project page
Leaderboard
→ leaderboard
Dataset
→ dataset
Code / GitHub
→ repository
HuggingFace
→ HF
Paper
Transfer learning enables predictions in network biology · Theodoris CV, Xiao L, Chopra A, et al. · 2023 · paper · doi:10.1038/s41586-023-06139-9 · 550 citations
Flags
self_referential
Experts
Christina Theodoris
Groups
Broad Institute
Hosted by
Related benchmarks
Open Problems: Perturbation Prediction, scGPT Evaluation Suite

Rubric (7-criterion)

rigor
4
coverage
3
maintenance
4
adoption
4
quality
4
accessibility
4
industry_relevance
4

Notes

Author-led eval; still widely re-run on OpenProblems tasks.

← Back to all benchmarks

Compare:
Open comparison →