Threads

Following the LanceDB docs to connect to Azure Blob Storage (v0.6.2), the reporter set the required environment variables and connected successfully: db.tablenames() listed the correct tables. But db.opentable("all_content") failed with a pyarrow ArrowInvalid error. The root cause discussed in the thread is that the synchronous Python SDK reads through pyarrow.fs, which does not understand the az:// filesystem scheme, so creating tables worked but reading them back did not.

Maintainer wjones127 confirmed in the thread: Azure Blob Storage reads work through the async API, but the synchronous API does not yet fully support the az:// filesystem because it routes reads through pyarrow.fs, which lacks an Azure filesystem implementation. Resolution/workaround: use LanceDB's async API (available since the Python SDK migration to the Rust core) to open and read tables on Azure Blob Storage. The sync API will be fixed once it becomes a wrapper around the async API, but as of the thread's close that work was still pending, so treat the async API as the working path. Source: https://github.com/lancedb/lancedb/issues/1072

Source: https://github.com/lancedb/lancedb/issues/1072