library · inferred from evidence
sentencepiece
A library for tokenization, referenced as a dependency in the ai21 SDK.
- ai21 SDK installation fails on Python 3.13 (sentencepiece==0.2.0 has no 3.13 support)
This was fixed upstream. The blocker was the sentencepiece==0.2.0 pin, which had no Python 3.13 support. Upgrade to ai21 SDK v4.0.0 or later, which added Python 3.13 support, per the maintainers. Source: https://github.com/AI21Labs/ai21-pyt