My understanding is that they have a base model checkpoint for Behemoth from pre-training.
This base model is not instruction-tuned so you can't use it like a normal instruction-tuned model for chatbots.
However, the base model can be distilled, and then the distilled model is post-trained to be instruction tuned, which can be released as a model for chatbots.
This base model is not instruction-tuned so you can't use it like a normal instruction-tuned model for chatbots.
However, the base model can be distilled, and then the distilled model is post-trained to be instruction tuned, which can be released as a model for chatbots.