仅支持以下架构的Pipeline并行:['AquilaModel', 'AquilaForCausalLM', 'InternLMForCausalLM', 'LlamaForCausalLM', 'LLaMAForCausalLM', 'MistralForCausalLM', 'Phi3ForCausalLM', 'GPT2LMHeadModel']。
0wi1tuuw1#
cc @andoorve
bprjcwpo2#
+1
2条答案
按热度按时间0wi1tuuw1#
cc @andoorve
bprjcwpo2#
+1