vTensor:用于高效LLM服务的灵活虚拟Tensor管理看起来很酷
j1dl9f461#
vTensor的代码是开源的!在这里:https://github.com/intelligent-machine-learning/glake/tree/master/GLakeServe
1条答案
按热度按时间j1dl9f461#
vTensor的代码是开源的!在这里:https://github.com/intelligent-machine-learning/glake/tree/master/GLakeServe