library · inferred from evidence
braintrust
The Braintrust library or SDK, referenced with version >= 3.3.0.
- Eval runs much slower after upgrading Braintrust TS SDK to v1.0.0 (log flush regression)
Upgrading the Braintrust TypeScript SDK from v0.4.10 to v1.0.0 made eval runs much slower (a few hundred tasks: 1.5 min before, 5 min after). The time is spent in sequential uploads to a /logs3 API endpoint in a loop that was introduced to