---
title: "GenSLMs"
type: concept
related: [Foundational Model, Genslms]
source: https://www.jemoka.com/posts/kbhgenslms/
confidence: high
status: active
---

GenSLMs are a LLM, but genome sequence
Take genome sequence Throw transformers at it create &ldquo;semantic embedding&rdquo; autoregression happens This is trained as a foundational model to organize the genomic sequence
Turns out, the embedding space above can be used to discover relations. See proteins can be encoded as hierarchies
