Merge pull request #228 from Damon-Salvetore/vllm-1

[Fix] Resolve occasional infinite loops during vLLM inference
This commit is contained in:
Jianwei Yu
2026-02-03 10:38:40 +08:00
committed by GitHub
4 changed files with 553 additions and 0 deletions
+5
View File
@@ -55,6 +55,11 @@ Once the vLLM server is running, test it with the provided script:
# Run the test (use container path /app/...)
docker exec -it vibevoice-vllm python3 vllm_plugin/tests/test_api.py /app/audio.wav
```
```bash
# Run the recover_test (use container path /app/...)
docker exec -it vibevoice-vllm python3 vllm_plugin/tests/test_api_auto_recover.py /app/audio.wav
```
> **Note**: The audio file must be inside the mounted directory (`/app` in the container). Copy your audio to the VibeVoice folder before testing.
### Environment Variables