knuts
if we request a model what are the chances it gets support?
Junu Kwon
knuts: Hello, thank you for reaching out and submitting a request.
Currently, Dedicated Endpoints can only launch models saved in
safetensors
format. The model you are attempting to use appears to be saved as a pickle file. Regrettably, we do not have any plans to extend our support to include other file types at this time. Still, you may try converting the model to safetensors
, as the model's architecture (MistralForCausalLM
, can be seen in config.json
) is on our support list.We appreciate your understanding and look forward to providing you with optimal support. If you have any questions or concerns, please do not hesitate to ask, and we will be happy to assist you further.