library · inferred from evidence
sentencepiece
A library for tokenization, referenced as a dependency in the ai21 SDK.
- ai21 SDK installation fails on Python 3.13 (sentencepiece==0.2.0 has no 3.13 support)
On Python 3.13, pip install ai21 (or uv add ai21) failed because one of the SDK's pinned dependencies, sentencepiece==0.2.0, did not support Python 3.13 yet. The reporter hit this on Windows 11, but the dependency pin was the cause regardle