Stories tagged with #machine-learning

Found 2 stories

0xkato.xyz — The Wildly Simple Architecture Running Our AI Moment
947 276

The Wildly Simple Architecture Running Our AI Moment

A ground-up walkthrough of how transformer-based LLMs actually work - tokens, embeddings, attention, and the next-token loop - and why HN engineers can't…

machine-learning llm transformers deep-learning ai
0xkato.xyz
johndcook.com — FP4: the 16-value float powering billion-parameter models
1.4k 1.4k

FP4: the 16-value float powering billion-parameter models

FP4, a 4-bit float with just 16 representable numbers, is now the default inference format for billion-parameter models on NVIDIA Blackwell hardware.

machine-learning floating-point nvidia quantization ai-inference
johndcook.com