Microsoft AI reveals a 2.8-trillion-parameter Mixture-of-Experts model trained on 16,000 NVIDIA GPUs, claiming 4-12x FLOPs ...