1 page tagged
#systems
mixture-of-experts
concept
MoE: scale params without scaling per-token compute; routing and infra complexity.
esc