scGPT Evaluation Suite
Evaluation shipped with scGPT foundation model (cell type annotation, GRN, perturbation).
Composite
73.7
Experimental validation
Wet-lab confirmed
Stages
Virtual Cell
Modalities
cross-modality
Task types
cell-type-annotationperturbation-prediction
Size
cells: 33,000,000
tasks: 5
tasks: 5
License
MIT
First release
2023-05
Last updated
2025-01
Official site
Leaderboard
→ leaderboard
Dataset
→ dataset
Code / GitHub
HuggingFace
→ HF
Paper
scGPT: toward building a foundation model for single-cell multi-omics using generative AI · Cui H, Wang C, Maan H, Pang K, Luo F, Wang B · 2024 · paper · doi:10.1038/s41592-024-02201-0 · 520 citations
Flags
self_referential
Experts
Groups
Hosted by
—
Related benchmarks
Rubric (7-criterion)
rigor
3
coverage
3
maintenance
4
adoption
5
quality
3
accessibility
5
industry_relevance
3
Notes
Evaluation dominated by authors' own model — flagged self-referential. Pair with OpenProblems for fair comparison.