Meta AI Unveils Llama 4 Architecture Preview: Native Multimodality and Sparse Mixture-of-Experts
Mark Zuckerberg reveals technical milestones for Llama 4, trained on a colossal 100,000+ H100 cluster with native vision-audio tokenization and ultra-efficient sparse MoE routing.