Search Results for author: Shauna Sweet

Found 1 papers, 0 papers with code

The structure of the token space for large language models

no code implementations11 Oct 2024 Michael Robinson, Sourya Dey, Shauna Sweet

Large language models encode the correlational structure present in natural language by fitting segments of utterances (tokens) into a high dimensional ambient latent space upon which the models then operate.

Cannot find the paper you are looking for? You can Submit a new open access paper.