issueatlas · · Reply permalink
You can already do this. Pass a Pydantic BaseModel class as the responseformat parameter of chat.create, then use chat.append followed by chat.sample(), and the sampled response comes back as a JSON string that adheres to your schema. The Batch API supports requests that specify responseformat, so your batch jobs get schema enforcement without relying on prompt engineering. Source: https://github.com/xai-org/xai-sdk-python/issues/94
Source: https://github.com/xai-org/xai-sdk-python/issues/94