inference BUG 无法加载ChatTTS模型

sd2nnvve  于 8个月前  发布在  其他
关注(0)|答案(1)|浏览(162)

描述错误

加载ChatTTS模型时出现错误。

重现问题

为了帮助我们重现此错误，请提供以下信息：
我使用的是 xprobe/xinference:latest-cpu docker部署，MANIFEST DIGEST sha256:7660c8485d36dd75fcea87768f6073f0b86d77e458b968a7b843f1167d9a3d05

预期行为

正常加载ChatTTS模型。

其他上下文

docker容器日志(docekr-compose):

  1. xinference    | 2024-07-09 14:51:11,100 xinference.core.supervisor 39 DEBUG    Enter list_model_registrations, args: (<xinference.core.supervisor.SupervisorActor object at 0x7f1b0966e390>, 'LLM'), kwargs: {'detailed': True}
  2. xinference    | 2024-07-09 14:51:11,169 xinference.core.supervisor 39 DEBUG    Leave list_model_registrations, elapsed time: 0 s
  3. xinference    | 2024-07-09 14:51:12,396 xinference.core.supervisor 39 DEBUG    Enter list_model_registrations, args: (<xinference.core.supervisor.SupervisorActor object at 0x7f1b0966e390>, 'audio'), kwargs: {'detailed': True}
  4. xinference    | 2024-07-09 14:51:12,400 xinference.core.supervisor 39 DEBUG    Leave list_model_registrations, elapsed time: 0 s
  5. xinference    | 2024-07-09 14:51:30,489 xinference.core.supervisor 39 DEBUG    Enter launch_builtin_model, model_uid: ChatTTS, model_name: ChatTTS, model_size: , model_format: None, quantization: None, replica: 1, kwargs: {}
  6. xinference    | 2024-07-09 14:51:30,490 xinference.core.worker 39 DEBUG    Enter get_model_count, args: (<xinference.core.worker.WorkerActor object at 0x7f1b096db5f0>,), kwargs: {}
  7. xinference    | 2024-07-09 14:51:30,490 xinference.core.worker 39 DEBUG    Leave get_model_count, elapsed time: 0 s
  8. xinference    | 2024-07-09 14:51:30,490 xinference.core.worker 39 DEBUG    Enter launch_builtin_model, args: (<xinference.core.worker.WorkerActor object at 0x7f1b096db5f0>,), kwargs: {'model_uid': 'ChatTTS-1-0', 'model_name': 'ChatTTS', 'model_size_in_billions': None, 'model_format': None, 'quantization': None, 'model_engine': None, 'model_type': 'audio', 'n_gpu': 'auto', 'request_limits': None, 'peft_model_config': None, 'gpu_idx': None}
  9. xinference    | 2024-07-09 14:51:33,983 xinference.core.worker 39 ERROR    Failed to load model ChatTTS-1-0
  10. xinference    | Traceback (most recent call last):
  11. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xinference/core/worker.py", line 673, in launch_builtin_model
  12. xinference    |     await model_ref.load()
  13. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xoscar/backends/context.py", line 227, in send
  14. xinference    |     return self._process_result_message(result)
  15. xinference    |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  16. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xoscar/backends/context.py", line 102, in _process_result_message
  17. xinference    |     raise message.as_instanceof_cause()
  18. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xoscar/backends/pool.py", line 659, in send
  19. xinference    |     result = await self._run_coro(message.message_id, coro)
  20. xinference    |     ^^^^^^^^^^^^^^^^^
  21. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xoscar/backends/pool.py", line 370, in _run_coro
  22. xinference    |     return await coro
  23. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xoscar/api.py", line 384, in __on_receive__
  24. xinference    |     return await super().__on_receive__(message)  # type: ignore
  25. xinference    |     ^^^^^^^^^^^^^^^^^
  26. xinference    |   File "xoscar/core.pyx", line 558, in __on_receive__
  27. xinference    |     raise ex
  28. xinference    |   File "xoscar/core.pyx", line 520, in xoscar.core._BaseActor.__on_receive__
  29. xinference    |     async with self._lock:
  30. xinference    |     ^^^^^^^^^^^^^^^^^
  31. xinference    |   File "xoscar/core.pyx", line 521, in xoscar.core._BaseActor.__on_receive__
  32. xinference    |     with debug_async_timeout('actor_lock_timeout',
  33. xinference    |     ^^^^^^^^^^^^^^^^^
  34. xinference    |   File "xoscar/core.pyx", line 526, in xoscar.core._BaseActor.__on_receive__
  35. xinference    |     result = await result
  36. xinference    |     ^^^^^^^^^^^^^^^^^
  37. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xinference/core/model.py", line 278, in load
  38. xinference    |     self._model.load()
  39. xinference    |     ^^^^^^^^^^^^^^^^^
  40. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xinference/model/audio/chattts.py", line 43, in load
  41. xinference    |     from xinference.thirdparty import ChatTTS
  42. xinference    |     ^^^^^^^^^^^^^^^^^
  43. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xinference/thirdparty/ChatTTS/__init__.py", line 1, in <module>
  44. xinference    |     from .core import Chat
  45. xinference    |           ^^^^^^^^^^^^^^^^^
  46. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xinference/thirdparty/ChatTTS/core.py", line 5, in <module>
  47. xinference    |     from omegaconf import OmegaConf
  48. xinference    |           ^^^^^^^^^^^^^^^^^
  49. xinference    | ModuleNotFoundError: [address=0.0.0.0:35749, pid=723] No module named 'omegaconf'
  50. xinference    | 2024-07-09 14:51:34,015 xinference.core.supervisor 39 DEBUG    Enter terminate_model, args: (<xinference.core.supervisor.SupervisorActor object at 0x7f1b0966e390>, 'ChatTTS'), kwargs: {'suppress_exception': True}
  51. xinference    | 2024-07-09 14:51:34,015 xinference.core.supervisor 39 DEBUG    Leave terminate_model, elapsed time: 0 s
  52. xinference    | 2024-07-09 14:51:34,019 xinference.api.restful_api 1 ERROR    [address=0.0.0.0:35749, pid=723] No module named 'omegaconf'
  53. xinference    | Traceback (most recent call last):
  54. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xinference/api/restful_api.py", line 822, in launch_model
  55. xinference    |     model_uid = await (await self._get_supervisor_ref()).launch_builtin_model(
  56. xinference    |                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  57. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xoscar/backends/context.py", line 227, in send
  58. xinference    |     return self._process_result_message(result)
  59. xinference    |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  60. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xoscar/backends/context.py", line 102, in _process_result_message
  61. xinference    |     raise message.as_instanceof_cause()
  62. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xoscar/backends/pool.py", line 659, in send
  63. xinference    |     result = await self._run_coro(message.message_id, coro)
  64. xinference    |     ^^^^^^^^^^^^^^^^^
  65. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xoscar/backends/pool.py", line 370, in _run_coro
  66. xinference    |     return await coro
  67. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xoscar/api.py", line 384, in __on_receive__
  68. xinference    |     return await super().__on_receive__(message)  # type: ignore
  69. xinference    |     ^^^^^^^^^^^^^^^^^
  70. xinference    |   File "xoscar/core.pyx", line 558, in __on_receive__
  71. xinference    |     raise ex
  72. xinference    |   File "xoscar/core.pyx", line 520, in xoscar.core._BaseActor.__on_receive__
  73. xinference    |     async with self._lock:
  74. xinference    |     ^^^^^^^^^^^^^^^^^
  75. xinference    |   File "xoscar/core.pyx", line 521, in xoscar.core._BaseActor.__on_receive__
  76. xinference    |     with debug_async_timeout('actor_lock_timeout',
  77. xinference    |     ^^^^^^^^^^^^^^^^^
  78. xinference    |   File "xoscar/core.pyx", line 526, in xoscar.core._BaseActor.__on_receive__
  79. xinference    |     result = await result
  80. xinference    |     ^^^^^^^^^^^^^^^^^
  81. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xinference/core/supervisor.py", line 871, in launch_builtin_model
  82. xinference    |     await _launch_model()
  83. xinference    |     ^^^^^^^^^^^^^^^^^
  84. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xinference/core/supervisor.py", line 835, in _launch_model
  85. xinference    |     await _launch_one_model(rep_model_uid)
  86. xinference    |     ^^^^^^^^^^^^^^^^^
  87. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xinference/core/supervisor.py", line 816, in _launch_one_model
  88. xinference    |     await worker_ref.launch_builtin_model(
  89. xinference    |     ^^^^^^^^^^^^^^^^^
  90. xinference    |   File "xoscar/core.pyx", line 284, in __pyx_actor_method_wrapper
  91. xinference    |     async with lock:
  92. xinference    |   File "xoscar/core.pyx", line 287, in xoscar.core.__pyx_actor_method_wrapper
  93. xinference    |     result = await result
  94. xinference    |     ^^^^^^^^^^^^^^^^^
  95. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xinference/core/utils.py", line 45, in wrapped
  96. xinference    |     ret = await func(*args, **kwargs)
  97. xinference    |     ^^^^^^^^^^^^^^^^^
  98. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xinference/core/worker.py", line 673, in launch_builtin_model
  99. xinference    |     await model_ref.load()
  100. xinference    |     ^^^^^^^^^^^^^^^^^
  101. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xoscar/backends/context.py", line 227, in send
  102. xinference    |     return self._process_result_message(result)
  103. xinference    |     ^^^^^^^^^^^^^^^^^
  104. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xoscar/backends/context.py", line 102, in _process_result_message
  105. xinference    |     raise message.as_instanceof_cause()
  106. xinference    |     ^^^^^^^^^^^^^^^^^
  107. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xoscar/backends/pool.py", line 659, in send
  108. xinference    |     result = await self._run_coro(message.message_id, coro)
  109. xinference    |     ^^^^^^^^^^^^^^^^^
  110. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xoscar/backends/pool.py", line 370, in _run_coro
  111. xinference    |     return await coro
  112. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xoscar/api.py", line 384, in __on_receive__
  113. xinference    |     return await super().__on_receive__(message)  # type: ignore
  114. xinference    |     ^^^^^^^^^^^^^^^^^
  115. xinference    |   File "xoscar/core.pyx", line 558, in __on_receive__
  116. xinference    |     raise ex
  117. xinference    |   File "xoscar/core.pyx", line 520, in xoscar.core._BaseActor.__on_receive__
  118. xinference    |     async with self._lock:
  119. xinference    |     ^^^^^^^^^^^^^^^^^
  120. xinference    |   File "xoscar/core.pyx", line 521, in xoscar.core._BaseActor.__on_receive__
  121. xinference    |     with debug_async_timeout('actor_lock_timeout',
  122. xinference    |     ^^^^^^^^^^^^^^^^^
  123. xinference    |   File "xoscar/core.pyx", line 526, in xoscar.core._BaseActor.__on_receive__
  124. xinference    |     result = await result
  125. xinference    |     ^^^^^^^^^^^^^^^^^
  126. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xinference/core/model.py", line 278, in load
  127. xinference    |     self._model.load()
  128. xinference    |     ^^^^^^^^^^^^^^^^^
  129. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xinference/model/audio/chattts.py", line 43, in load
  130. xinference    |     from xinference.thirdparty import ChatTTS
  131. xinference    |     ^^^^^^^^^^^^^^^^^
  132. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xinference/thirdparty/ChatTTS/__init__.py", line 1, in <module>
  133. xinference    |     from .core import Chat
  134. xinference    |           ^^^^^^^^^^^^^^^^^
  135. xinference    |   File "/opt/conda/lib/python3.11/site-packages/xinference/thirdparty/ChatTTS/core.py", line 5, in <module>
  136. xinference    |     from omegaconf import OmegaConf
  137. xinference    |           ^^^^^^^^^^^^^^^^^
  138. xinference    | ModuleNotFoundError: [address=0.0.0.0:35749, pid=723] No module named 'omegaconf'
inference

1条答案

按热度按时间
snz8szmq

snz8szmq1#

这个问题已经过时，因为它已经开放了7天，没有任何活动。

赞(0）分享  回复(0）举报  8个月前
我来回答

相关问题

    查看更多

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新问答

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com