product · inferred from evidence
meta/meta-llama-3-70b-instruct
A specific large language model version referenced in the issue.
- Llama 3 streaming repeats the previous request's first token
Streaming `meta/meta-llama-3-70b-instruct` produced a strange artifact: each new response in a chat started by repeating earlier turns' first tokens, first "Hi", then "I", then "How", growing with the conversation. Maintainer mattt first su