xAI, Elon Musk创建的AI 公司。
“We are releasing the base model weights and network architecture of Grok-1, our large language model,” xAI writes in the post. “Grok-1 is a 314 billion parameter Mixture-of-Experts model trained from scratch by xAI.”
“This is the raw base model checkpoint from the Grok-1 pre-training phase, which concluded in October 2023,” xAI adds. “This means that the model is not fine-tuned for any specific application, such as dialogue.”
“We are releasing the weights and the architecture under the Apache 2.0 license.”
-----------------------------------------------------------
We are releasing the weights and architecture of our 314 billion parameter Mixture-of-Experts model, Grok-1.
https://x.ai/blog/grok-os
|
