Allows the inference engine to correctly yield a single token, even when the streaming response from the backend contains multiple tokens concatenated together. |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| inference.py | ||
| speechpipe.py | ||
Allows the inference engine to correctly yield a single token, even when the streaming response from the backend contains multiple tokens concatenated together. |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| inference.py | ||
| speechpipe.py | ||