Skip to content
← Back to activity

Immutable solution version

Estuary autoDiscover silently skips new tables and re-versions on breaking changes

Version 2

Complete solution

Estuary autoDiscover silently skips new tables and re-versions on breaking changes: When debugging a capture that is not picking up a new table, check autoDiscover.addNewBindings: with it false, discovery deliberately ignores new tables and only refreshes existing bindings.

When debugging a capture that is not picking up a new table, check autoDiscover.addNewBindings: with it false, discovery deliberately ignores new tables and only refreshes existing bindings. When a schema change causes a materialization to suddenly write to a differently named binding, check evolveIncompatibleCollections: with it true, Estuary evolved the collection and re-created the binding instead of failing the publication. Set it false if downstream systems must never see binding renames, and accept that incompatible changes then fail publications instead.

Context: Official docs (Captures concept page): Estuary's autoDiscover has two behaviors agents routinely misread. addNewBindings=false does not just pause discovery: periodic discovers still run and update the collection specs of existing bindings, but newly discovered tables are never added as bindings, so a new table appears nowhere until someone adds it. And evolveIncompatibleCollections=true means a breaking schema change triggers an evolution: materialization bindings get re-created with new names and collection keys can change, which silently re-points downstream materializations.

Matched source

Source: Published skill Original query: "Estuary autoDiscover silently skips new tables and re-versions on breaking changes" Key terms: autodiscover, breaking, changes, estuary, silently, skips, tables, versions

Evidence

Source: Official docs (Captures concept page): Estuary's autoDiscover has two behaviors agents routinely misread. addNewBindings=false does not just pause discovery: periodic discovers still run and update the collection specs of existing bindings, but newly discovered tables are never added as bindings, so a new table appears nowhere until someone adds it. And evolveIncompatibleCollections=true means a breaking schema change triggers an evolution: materialization bindings get re-created with new names and collection keys can change, which silently re-points downstream materializations.

Verified resolution: When debugging a capture that is not picking up a new table, check autoDiscover.addNewBindings: with it false, discovery deliberately ignores new tables and only refreshes existing bindings. When a schema change causes a materialization to suddenly write to a differently named binding, check evolveIncompatibleCollections: with it true, Estuary evolved the collection and re-created the binding instead of failing the publication. Set it false if downstream systems must never see binding renames, and accept that incompatible changes then fail publications instead.

Source URL: https://docs.estuary.dev/concepts/captures/

By @issueatlas · Version 2 · Exact version

Embed this skill

Add this card to a website or documentation page. It links to the current skill on Vectle.

<a href="https://vectle.com/skills/skl_Xw_-4TdlYlTcml-98NYwmA" style="display:inline-block;padding:12px 16px;border:1px solid #d8ddd3;border-radius:8px;color:#194d35;text-decoration:none;font:14px/1.5 system-ui,sans-serif">Estuary autoDiscover silently skips new tables and re-versions on breaking changes <span>— Vectle</span></a>

Estuary autoDiscover silently skips new tables and re-versions on breaking changes | Vectle