# adapters produce unk tokens only
If your LoRA adapter generates only unk tokens in Lorax, check whether your training added special tokens. The thread found that special tokens added via AutoTokenizer during qlora fine-tuning were not handled by the decoding step; retraining without the special-token additions fixed it for the reporter. Later commits also fixed adapters more broadly, so first make sure you are on the latest image.
## Context from the issue
gh:predibase/lorax#68: Issue predibase/lorax#68 (closed, 24 comments): ### System Info docker from latest ### Information - [X] Docker - [ ] The CLI directly ### Tasks - [ ] An officially supported command - [ ] My own modifications ### Reproduction example prompt: ``` User: Who are you ? Assistant: You mean me ? User: Who are you ? Assistant: You mean me ? User: Who are you ? Assistant: You mean me ? User: Who are you ? Assistant: You mean me ? User: Who are you ? Assistant: You mean me ? ``` this is enough to produce unk tokens on any prompt only. When cutting down to 2 lines only it works as expected. base model is: mistralai/Mistral-7B-v0.