错误信息 | Error Message

[ERROR] Experienced exception while trying to serve
Traceback (most recent call last):
File "/workspace/envs/qanything-python/lib/python3.10/site-packages/sanic/mixins/startup.py", line 958, in serve_single
worker_serve(monitor_publisher=None, **kwargs)
File "/workspace/envs/qanything-python/lib/python3.10/site-packages/sanic/worker/serve.py", line 143, in worker_serve
raise e
File "/workspace/envs/qanything-python/lib/python3.10/site-packages/sanic/worker/serve.py", line 117, in worker_serve
return _serve_http_1(
File "uvloop/loop.pyx", line 1517, in uvloop.loop.Loop.run_until_complete
loop.run_until_complete(app._server_event("init", "before"))
File "uvloop/loop.pyx", line 1517, in uvloop.loop.Loop.run_until_complete
loop.run_until_complete(app._server_event("init", "before"))
File "sanic/signals.py", line 208, in dispatch
return await dispatch
File "sanic/signals.py", line 183, in _dispatch
raise e
File "sanic/signals.py", line 167, in _dispatch
retval = await maybe_coroutine
File "sanic/app.py", line 1315, in _listener
await maybe_coro
File "/workspace/QAnything/qanything_kernel/qanything_server/sanic_api.py", line 202, in init_local_doc_qa
local_doc_qa.init_cfg(args=args)
File "/workspace/QAnything/qanything_kernel/core/local_doc_qa.py", line 61, in init_cfg
self.llm: OpenAICustomLLM = OpenAICustomLLM(args)
File "/workspace/QAnything/qanything_kernel/connector/llm/llm_for_fastchat.py", line 40, in init
self.engine = AsyncLLMEngine.from_engine_args(engine_args)
File "/workspace/envs/qanything-python/lib/python3.10/site-packages/vllm/engine/async_llm_engine.py", line 628, in from_engine_args
engine = cls(parallel_config.worker_use_ray,
File "/workspace/envs/qanything-python/lib/python3.10/site-packages/vllm/engine/async_llm_engine.py", line 321, in init
self.engine = self._init_engine(*args, **kwargs)
File "/workspace/envs/qanything-python/lib/python3.10/site-packages/vllm/engine/llm_engine.py", line 128, in init
self._init_workers()
File "/workspace/envs/qanything-python/lib/python3.10/site-packages/vllm/engine/llm_engine.py", line 181, in _init_workers
self._run_workers("load_model")
File "/workspace/envs/qanything-python/lib/python3.10/site-packages/vllm/engine/llm_engine.py, line 1041, in _run_workers
driver_worker_output = getattr(self.driver_worker,
File "/workspace/envs/qanything-python/lib/python3.10/site-packages/vllm

QAnything日志 | QAnything logs

• 无响应*

复现方法 | Steps To Reproduce

执行以下命令：

CUDA_VISIBLE_DEVICES=1 python -m qanything_kernel.qanything_server.sanic_api --host 0.0.0.0 --port 14009 --model_size 7B

报错：AttributeError: 'QWenConfig' object has no attribute 'intermediate_size'

备注 | Anything else?

• 无响应*