Stories tagged with #nvidia

Found 3 stories

johndcook.com — FP4: the 16-value float powering billion-parameter models
1.4k 1.4k

FP4: the 16-value float powering billion-parameter models

FP4, a 4-bit float with just 16 representable numbers, is now the default inference format for billion-parameter models on NVIDIA Blackwell hardware.

machine-learning floating-point nvidia quantization ai-inference
johndcook.com
twitter.com — Anthropic Is Now Training on Elon's Supercluster
307 351

Anthropic Is Now Training on Elon's Supercluster

Anthropic is expanding into xAI's Colossus2, using GB200 GPUs - after already taking the entire Colossus1. HN asks what this means for the AI race.

ai anthropic xai compute nvidia datacenter
twitter.com
nvlabs.github.io — One minute of 720p video from a single GPU - how did we get here so fast?
405 152

One minute of 720p video from a single GPU - how did we get here so fast?

SANA-WM is a 2.6B open-source world model that generates minute-long 720p video with 6-DoF camera control on one GPU. NVIDIA trained it on 64 H100s in 15 days.

ai video-generation open-source nvidia world-model diffusion
nvlabs.github.io