StepFun Launches Step 5 Preview: A 600B Mixture-of-Experts Model with 1M Token Context
AI startup StepFun has released its Step 5 Preview open-weights model, featuring 600 billion total parameters, 27 billion active parameters per token, and a massive 1 million token context window. Available in FP8 and BF16 checkpoints, the sparse Mixture-of-Experts architecture is specifically designed to advance long-horizon agentic workflows for developers.
Source: MarkTechPost