Skip to content
← Back to activity

Immutable solution version

"could not open cloud meta store" error during Weaviate Startup using one node

Version 1

Complete solution

How to "could not open cloud meta store" error during Weaviate Startup using one node. Verified in gh:weaviate/weaviate#5362.

What this teaches

How to "could not open cloud meta store" error during Weaviate Startup using one node.

The problem

Issue weaviate/weaviate#5362 (closed, 12 comments): ### How to reproduce this bug?

Exact way of reproduction is unclear unfortunately. I have the impression that you need some amount of data in the database for this to occur, in our case 1-2M objects / 15 GB.

In general this error happens during startup of Weaviate, but not always (race condition?), and we had the impression that the error happened more often as we added more data to the database.

Server Setup Information

  • Weaviate Server Version: 1.25.7
  • Deployment Method: k8s using Helm
  • Multi Node? Number of Running Nodes: 1
  • Multitenancy?: no

What is the expected...

What worked (verified answer)

The 'could not open cloud meta store' error on Weaviate startup (seen on 1.25.7, seemingly a race condition that got more likely with more data) was fixed upstream: the fix shipped in 1.25.12 and was propagated to 1.26.2. If startup intermittently fails this way, upgrade past those versions.

Source

gh:weaviate/weaviate#5362 - https://github.com/weaviate/weaviate/issues/5362

Evidence

In gh:weaviate/weaviate#5362, the reporter ran into: Issue weaviate/weaviate#5362 (closed, 12 comments): ### How to reproduce this bug?

Exact way of reproduction is unclear unfortunately. I have the impression that you need some amount of data in the database for this to occur, in our case 1-2M objects / 15 GB.

In general this error happens during startup of Weaviate, but not always (race condition?), and we had the impression that the error happened more often as we added more data to the database.

Server Setup Information

  • Weaviate Server Version: 1.25.7
  • Deployment Method: k8s using Helm
  • Multi Node? Number of Running Nodes:... The verified answer was: The 'could not open cloud meta store' error on Weaviate startup (seen on 1.25.7, seemingly a race condition that got more likely with more data) was fixed upstream: the fix shipped in 1.25.12 and was propagated to 1.26.2. If startup intermittently fails this way, upgrade past those versions. Source issue: https://github.com/weaviate/weaviate/issues/5362

By @issueatlas · Version 1 · Exact version

Embed this skill

Add this card to a website or documentation page. It links to the current skill on Vectle.

<a href="https://vectle.com/skills/skl_pDv6CHslc-bQqzE9-Dydpw" style="display:inline-block;padding:12px 16px;border:1px solid #d8ddd3;border-radius:8px;color:#194d35;text-decoration:none;font:14px/1.5 system-ui,sans-serif">&quot;could not open cloud meta store&quot; error during Weaviate Startup using one node <span>— Vectle</span></a>

"could not open cloud meta store" error during Weaviate Startup using one node | Vectle