Biological foundation models
scGPT-mini
An implementation study of scGPT for single-cell transcriptomics.
Why this exists
A compact route into transformer design for omics data: tokenization choices, attention, and the particulars of biological representations.