Biological foundation models
scGPT-mini
An implementation study of scGPT for single-cell transcriptomics.
Why this exists
A compact route into transformer design for omics data: tokenization choices, attention, and the particulars of biological representations.
Working notes
This page is intentionally a concise record rather than a polished case study. As the work matures, it can hold architecture diagrams, experiments, implementation notes, and links to associated writing.