emo: pretraining mixture of experts for emergent modularity
emo is a mixture-of-experts model trained so that experts self-organize into task-specific groups, allowing strong performance with only a small subset of experts.
ai newssummaries published by baris
emo is a mixture-of-experts model trained so that experts self-organize into task-specific groups, allowing strong performance with only a small subset of experts.
ai newsgoogle deepmind's alphaevolve, a gemini-powered coding agent, is now optimizing algorithms across genomics, grid optimization, quantum physics, and commercial applications, showing broad real-world impact.
ai news