import mii
mii_configs = {"tensor_parallel": 1, "dtype": "fp16"}
mii.deploy(task="text-classification",model="roberta-large-mnli",deployment_name="roberta_deployment",mii_config=mii_configs)
但是它报错了
text-classification is not supported by roberta-large-mnli. This task is supported by 53415 other models. See which models with `mii.get_supported_models(mii.text-classification)`. (type=assertion_error)
2条答案
按热度按时间3xiyfsfu1#
你好,@pradeepdev-1995 ,我们在这里列出了支持最新DeepSpeed-MII的模型:https://github.com/microsoft/DeepSpeed-MII?tab=readme-ov-file#supported-models
如果你想运行一个Roberta模型,你需要使用MII-Legacy API:https://github.com/microsoft/DeepSpeed-MII/tree/main/mii/legacy
特别是,请查看这个示例:https://github.com/microsoft/DeepSpeed-MII/blob/main/mii/legacy/examples/local/question-answering-example.py
1wnzp6jl2#
我尝试了官方文档中的以下代码
但是它报错了
所以我尝试了
mii.get_supported_models(mii.text-classification)
命令,但是它显示使用包版本时