NoneKnowofMI6 made the first post Mar 30, 2024 #1 Grok-1 is a JAX model offered by xai-org on GitHub, with 314 billion parameters and a MoE (Mixture of Experts) architecture. It is designed for a wide range of AI tasks, supporting advanced features like activation sharing and 8-bit quantitation...
Grok-1 is a JAX model offered by xai-org on GitHub, with 314 billion parameters and a MoE (Mixture of Experts) architecture. It is designed for a wide range of AI tasks, supporting advanced features like activation sharing and 8-bit quantitation...