AI docs · Foundations

Foundations,
explained.

AI concept docs on foundations: clear explanations of what each is, how it works, the trade-offs, and the pitfalls.

Large language models (LLMs)

Models trained to predict the next token of text, which turns out to be a powerful way to read, write, and reason over language.

LLMs read and write in tokens, and they can only consider a limited window of them at once. This shapes cost, latency, and what fits.

Numeric representations of text (or images) that place similar meanings close together, enabling search and retrieval by meaning.

Foundations: AI docs · SDEN