How can i solve this proble? keyError 3811 #1103
Description
Self Checks
- This template is only for bug reports. For questions, please visit Discussions.
- I have thoroughly reviewed the project documentation (installation, training, inference) but couldn't find information to solve my problem. English 中文 日本語 Portuguese (Brazil)
- I have searched for existing issues, including closed ones. Search issues
- I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
- [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
- Please do not modify this template and fill in all required fields.
Cloud or Self Hosted
Self Hosted (Docker)
Environment Details
Hi,
I just wonder how can i solve this problem
When i using this project via Korea language
i got some issue
i just using tokenizer from your huggingface
but really i don't know why the 3811 index not in tokenizer
please let me know how can i fix it
Steps to Reproduce
fish_speech/models/text2semantic/inference.py --text "(angry)안녕하세요 " --prompt-text "어 성균이형 나야 남길이 어 시베리아 어 잘 다녀왔는지 모르겠는데 어 그곳에서 여행이 무척 궁금하네요 어 무사히 잘 마쳤기를 바라고 어 재밌게 방송 보도록 하겠습니다" --prompt-tokens codes_0.npy --compile
✔️ Expected Behavior
Traceback (most recent call last):
File "/opt/fish-speech/fish_speech/models/text2semantic/inference.py", line 706, in <module>
main()
File "/usr/local/lib/python3.12/site-packages/click/core.py", line 1442, in __call__
return self.main(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/click/core.py", line 1363, in main
rv = self.invoke(ctx)
^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/click/core.py", line 1226, in invoke
return ctx.invoke(self.callback, **ctx.params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/click/core.py", line 794, in invoke
return callback(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/fish-speech/fish_speech/models/text2semantic/inference.py", line 689, in main
for response in generator:
^^^^^^^^^
File "/opt/fish-speech/fish_speech/models/text2semantic/inference.py", line 450, in generate_long
encoded, audio_masks, audio_parts = base_content_sequence.encode_for_inference(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/fish-speech/fish_speech/content_sequence.py", line 275, in encode_for_inference
encoded = self.encode(tokenizer, add_shift=False)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/fish-speech/fish_speech/content_sequence.py", line 197, in encode
tokenizer.semantic_id_to_token_id[int(i.item())]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^
KeyError: 3811
root@24c8cdfc4623:/opt/fish-speech# python3 -c "
❌ Actual Behavior
No response