镜像升级到1.0.9，这个问题就好了，不过推理的时候还会有其他的错误:(

镜像升级到1.0.9，这个问题就好了，不过推理的时候还会有其他的错误:(
俺来试试

镜像升级到1.0.9，这个问题就好了，不过推理的时候还会有其他的错误:(
俺来试试
测试结果是什么？我与你一样，但好像还是不行

(base) PS E:\QAnything> bash run.sh
models 文件夹已存在，无需下载。
Checking model directories...
检查模型目录...
检查模型版本成功，当前版本为 v2.1.0。
Model directories check passed. (0/8)
模型路径和模型版本检查通过. (0/8)
Do you want to use the previous host: localhost? (yes/no) 是否使用上次的host: localhost？(yes/no) 回车默认选yes，请输入:yes
Running under WSL
Container qanything-container-local Stopping
Container qanything-container-local Stopped
Container qanything-container-local Removing
Container qanything-container-local Removed
Container milvus-standalone-local Stopping
Container mysql-container-local Stopping
Container milvus-standalone-local Stopped
Container milvus-standalone-local Removing
Container mysql-container-local Stopped
Container mysql-container-local Removing
Container milvus-standalone-local Removed
Container milvus-minio-local Stopping
Container milvus-etcd-local Stopping
Container mysql-container-local Removed
Container milvus-etcd-local Stopped
Container milvus-etcd-local Removing
Container milvus-minio-local Stopped
Container milvus-minio-local Removing
Container milvus-etcd-local Removed
Container milvus-minio-local Removed
Network qanything_milvus_mysql_local Removing
Network qanything_milvus_mysql_local Removed
[+] Running 6/6
✔ Network qanything_milvus_mysql_local Created 0.1s
✔ Container milvus-minio-local Started 0.2s
✔ Container mysql-container-local Started 0.2s
✔ Container milvus-etcd-local Started 0.2s
✔ Container milvus-standalone-local Started 0.1s
✔ Container qanything-container-local Started 0.2s
qanything-container-local |
qanything-container-local | =============================
qanything-container-local | == Triton Inference Server ==
qanything-container-local | =============================
qanything-container-local |
qanything-container-local | NVIDIA Release 23.05 (build 61161506)
qanything-container-local | Triton Server Version 2.34.0
qanything-container-local |
qanything-container-local | Copyright (c) 2018-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
qanything-container-local |
qanything-container-local | Various files include modifications (c) NVIDIA CORPORATION & AFFILIATES. All rights reserved.
qanything-container-local |
qanything-container-local | This container image and its contents are governed by the NVIDIA Deep Learning Container License.
qanything-container-local | By pulling and using the container, you accept the terms and conditions of this license:
qanything-container-local | https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license
qanything-container-local |
qanything-container-local | GPU ID: 0, 0
qanything-container-local | The triton server will start on 0 GPU
qanything-container-local | The llm transfer service is ready! (1/8)
qanything-container-local | 大模型中转服务已就绪! (1/8)
qanything-container-local | The rerank service is ready! (2/8)
qanything-container-local | rerank服务已就绪! (2/8)
qanything-container-local | The ocr service is ready! (3/8)
qanything-container-local | OCR服务已就绪! (3/8)
qanything-container-local | The qanything backend service is ready! (4/8)
qanything-container-local | qanything后端服务已就绪! (4/8)
qanything-container-local | Waiting for [npm run install]（5/8)
qanything-container-local | up to date in 5s
qanything-container-local |
qanything-container-local | 177 packages are looking for funding
qanything-container-local | run npm fund for details
qanything-container-local | [npm run install] Installed successfully（5/8)
qanything-container-local | Waiting for npm run build
qanything-container-local |
qanything-container-local | > ai-demo@1.0.1 build
qanything-container-local | > vite build
qanything-container-local |
qanything-container-local | The CJS build of Vite's Node API is deprecated. See https://vitejs.dev/guide/troubleshooting.html#vite-cjs-node-api-deprecated for more details.
qanything-container-local | vite v5.0.12 building for production...
qanything-container-local | ~@/styles/fonts/FZLanTingHeiS-L-GB.TTF referenced in /workspace/qanything_local/front_end/src/styles/common/global.scss didn't resolve at build time, it will remain unchanged to be resolved at runtime
qanything-container-local |
qanything-container-local | ~@/styles/fonts/FZYaSongS-B-GB.TTF referenced in /workspace/qanything_local/front_end/src/styles/common/global.scss didn't resolve at build time, it will remain unchanged to be resolved at runtime
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/OptionList.vue
qanything-container-local | 187:5 warning Unexpected console statement no-console
qanything-container-local | 197:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/Chat.vue
qanything-container-local | 265:7 warning Unexpected console statement no-console
qanything-container-local | 267:9 warning Unexpected console statement no-console

翻译结果如下：
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/UploadInput.vue
qanything-container-local | 72:1警告 意外的控制台语句 no-console
qanything-container-local | 97:3警告 意外的控制台语句 no-console
qanything-container-local |
qanything-container-local | ✖ 2个问题 (0个错误，2个警告)
qanything-container-local |
✓ 3390个模块已转换。
dist/qanything/index.html 0.81 kB │ gzip: 0.48 kB
qanything-container-local | dist/qanything/assets/ai-avatar-Mfa3nGpi.png 4.48 kB
qanything-container-local | dist/qanything/assets/logo-small-G9Aimh5e.png 7.12 kB
qanything-container-local | dist/qanything/assets/icon-file-cc9GkaT6.png 12.36 kB
qanything-container-local | dist/qanything/assets/index-N7ZRDdsa.css 4.72 kB │ gzip: 1.54 kB
qanything-container-local | dist/qanything/assets/Home-fBCPtTdS.css 10.80 kB │ gzip: 2.43 kB
qanything-container-local | dist/qanything/assets/index-qS-55NZJ.css 11.60 kB │ gzip: 2.39 kB
qanything-container-local | dist/qanything/assets/index-RapwEZsc.js 88.21 kB │ gzip: 31.34 kB
qanything-container-local | dist/qanything/assets/index-LKprbnns.js 280.95 kB │ gzip: 94.50 kB
qanything-container-local | dist/qanything/assets/useOptiionList-x3dMi9Nk.js 294.00 kB │ gzip: 102.64 kB
qanything-container-local | dist/qanything/assets/Home-zTKfjtjJ.js 560.19 kB │ gzip: 157.61 kB
qanything-container-local |
qanything-container-local | (!) 有些块在压缩后超过了500 kB。请考虑以下建议：
qanything-container-local | - 使用动态导入()对应用程序进行代码拆分
qanything-container-local | - 在此处使用build.rollupOptions.output.manualChunks以改善拆分：https://rollupjs.org/configuration-options#output-manualchunks
qanything-container-local | - 通过build.chunkSizeWarningLimit调整此警告的块大小限制。
qanything-container-local | 已构建(耗时19m 33s)
qanything-container-local | > ai-demo@1.0.1 postbuild
qanything-container-local | > node writeVersion.js
qanything-container-local |
qanything-container-local | file:///workspace/qanything_local/front_end/writeVersion.js:1
qanything-container-local | const fs = require('fs');
qanything-container-local | ^
qanything-container-local |
qanything
qanything-container-local | =============================
qanything-container-local |
qanything-container-local | NVIDIA Release 23.05 (build 61161506)
qanything-container-local | Triton Server Version 2.34.0
qanything-container-local |
qanything-container-local | Copyright (c) 2018-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
qanything-container-local |
qanything-container-local | Various files include modifications (c) NVIDIA CORPORATION & AFFILIATES. All rights reserved.
qanything-container-local |
qanything-container-local | This container image and its contents are governed by the NVIDIA Deep Learning Container License.
qanything-container-local | By pulling and using the container, you accept the terms and conditions of this license:
qanything-container-local | https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license
qanything-container-local |
qanything-container-local | GPU ID: 0, 0
qanything-container-local | The triton server will start on 0 GPU
qanything-container-local | The llm transfer service is ready! (1/8)
qanything-container-local | 大模型中转服务已就绪! (1/8)
qanything-container-local | The rerank service is ready! (2/8)
qanything-container-local | rerank服务已就绪! (2/8)
qanything-container-local | The ocr service is ready! (3/8)
qanything-container-local | OCR服务已就绪! (3/8)
qanything-container-local | The qanything backend service is ready! (4/8)
qanything-container-local | qanything后端服务已就绪! (4/8)
qanything-container-local | Waiting for [npm run install]（5/8)
qanything-container-local | up to date, audited 887 packages in 8s
qanything-container-local |
qanything-container-local | 177 packages are looking for funding
qanything-container-local | run npm fund for details
qanything-container-local |
qanything-container-local | 7 moderate severity vulnerabilities
qanything-container-local |
qanything-container-local | To address all issues (including breaking changes), run:
qanything-container-local | npm audit fix --force
qanything-container-local |
qanything-container-local | Run npm audit for details.
qanything-container-local | npm notice
qanything-container-local | npm notice New minor version of npm available! 10.2.3 -> 10.3.0
qanything-container-local | npm notice Changelog: https://github.com/npm/cli/releases/tag/v10.3.0
qanything-container-local | npm notice Run npm install -g npm@10.3.0 to update!
qanything-container-local | npm notice
qanything-container-local | [npm run install] Installed successfully（5/8)
qanything-container-local | Waiting for npm run build
qanything-container-local |
qanything-container-local | > ai-demo@1.0.1 build
qanything-container-local | > vite build
qanything-container-local |
qanything-container-local | The CJS build of Vite's Node API is deprecated. See https://vitejs.dev/guide/troubleshooting.html#vite-cjs-node-api-deprecated for more details.
qanything-container-local | vite v5.0.12 building for production...
qanything-container-local | ~@/styles/fonts/FZLanTingHeiS-L-GB.TTF referenced in /workspace/qanything_local/front_end/src/styles/common/global.scss didn't resolve at build time, it will remain unchanged to be resolved at runtime
qanything-container-local |
qanything-container-local | ~@/styles/fonts/FZYaSongS-B-GB.TTF referenced in /workspace/qanything_local/front_end/src/styles/common/global.scss didn't resolve at build time, it will remain unchanged to be resolved at runtime
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/Chat.vue
qanything-container-local | 265:7 warning Unexpected console statement no-console
qanything-container-local | 267:9 warning Unexpected console statement no-console
qanything-container-local | 280:13 warning Unexpected console statement no-console
qanything-container-local | 286:7 warning Unexpected console statement no-console
qanything-container-local | 288:7 warning Unexpected console statement no-console
qanything-container-local | 304:7 warning Unexpected console statement no-console
qanything-container-local | 305:7 warning Unexpected console statement no-console
qanything-container-local | 315:7 warning Unexpected console statement no-console
qanything-container-local | 330:3 warning Unexpected console statement no-console
qanything-container-local | 361:5 warning Unexpected console statement no-console
qanything-container-local | 381:7 warning Unexpected console statement no-console
qanything-container-local | 385:5 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 12 problems (0 errors, 12 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/OptionList.vue
qanything-container-local | 187:5 warning Unexpected console statement no-console
qanything-container-local | 197:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]

等待前端服务启动中...
等待前端服务启动中...
等待前端服务启动中...
等待前端服务启动中...
等待前端服务启动中...
等待前端服务启动中...
等待前端服务启动中...
等待前端服务启动中...
等待前端服务启动中...
等待前端服务启动中...
等待前端服务启动中...
等待前端服务启动中...
等待前端服务启动中...
等待前端服务启动中...
等待前端服务启动中...
等待前端服务启动中...

启动Triton服务超时，请进入容器内检查/model_repos/QAEnsemble_base/QAEnsemble_base.log以获取更多信息。

+1
QAEnsemble.log:
终止调用后抛出 'std::runtime_error' 异常，错误信息：[FT][ERROR] Assert失败： /home/local/llama_inference/llm_serve/fastertransformer_backend/build/_deps/repo-ft-src/src/fastertransformer/triton_backend/llama/LlamaTritonModel.cc:89 [af64e462bb34:00106] 进程接收到信号 [af64e462bb34:00106] 信号：Aborted (6) [af64e462bb34:00106] 信号代码：(-6) [af64e462bb34:00106] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7f9ce0895520] [af64e462bb34:00106] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7f9ce08e99fc] [af64e462bb34:00106] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7f9ce0895476] [af64e462bb34:00106] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7f9ce087b7f3] [af64e462bb34:00106] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7f9ce0b1db9e] [af64e462bb34:00106] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xaae20c)[0x7f9ce0b2920c] [af64e462bb34:00106] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xaae277)[0x7f9ce0b29277] [af64e462bb34:00106] [ 7] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xaae4d8)[0x7f9ce0b294d8] [af64e462bb34:00106] [ 8] /opt/tritonserver/backends/qa_ensemble/libtransformer-shared.so(_ZN17fastertransformer17throwRuntimeErrorEPKciRKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE+0x27f)[0x7f9c7b7c4c5f] [af64e462bb34:00106] [ 9] /opt/tritonserver/backends/qa_ensemble/libtransformer-shared.so(_ZN16LlamaTritonModelI6__halfEC1EmmiNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEEi+0x70e)[0x7f9c7ba9fdae] [af64e462bb34:00106] [10] /opt/tritonserver/backends/qa_ensemble/libtransformer-shared.so(+0x275ca)[0x7f9cd07865ca] [af64e462bb34:00106] [11] /opt/tritonserver/backends/qa_ensemble/libtransformer-shared.so(+0x2f0d9)[0x7f9cd078e0d9] [af64e462bb34:00106] [12] /opt/tritonserver/backends/qa_ensemble/libtransformer-shared.so(+0x35f56)[0x7f9cd0794f56] [af64e462bb34:00106] [13] /opt/tritonserver/backends/qa_ensemble/libtransformer-shared.so(TRITONBACKEND_ModelInitialize+0x4c2)[0x7f9cd0795732] [af64e462bb34:00106] [14] /opt/tritonserver/bin/../lib/libtritonserver.so(+0x174497)[0x7f9ce125e497] [af64e462bb34:00106] [15] /opt/tritonserver/bin/../lib/libtritonserver.so(+0x252d80)[0x7f9ce133cd80] [af64e462bb34:00106] [16] /opt/tritonserver/bin/../lib/libtritonserver.so(+0x2563c3)[0x7f9ce13403c3] [af64e462bb34:00106] [17] /opt/tritonserver/bin/../lib/libtritonserver.so(+0x39a052)[0x7f9ce1484052] [af64e462bb34:00106] [18] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xdc253)

同样的问题，有解决方案吗