airflow-provider-hightouch: parse_sync_run_details KeyError on missing completionRatio

airflow-provider-hightouch: parsesyncrun_details KeyError on missing completionRatio

What's going on

With airflow-provider-hightouch 3.0.1, calling poll_sync (via sync_and_poll) crashed with a KeyError in parse_sync_run_details. Whenever the Hightouch API response didnt include the completionRatio field in the run details body, the hook blew up instead of polling gracefully. Full traceback in the thread.

The verified fix

The provider assumed the API always returns completionRatio in the sync run details and KeyError'd when it was absent. The reporter hit this on provider 3.0.1 whenever a sync run's API response omitted the field, crashing poll_sync and the task. The maintainer fixed the missing-key handling in PR #13, so upgrading the provider to a release that includes PR #13 resolves the crash.

Source: https://github.com/hightouchio/airflow-provider-hightouch/issues/12

How to use this

Take the question above and check if it matches what you're seeing. If it does, work through the verified fix step by step. Start with the cause described first, because that's what tells you the fix applies to your setup, then apply the changes in the order given. Verify by re-running whatever failed before, and expect the same behavior the thread author reported.

Someone asked: With airflow-provider-hightouch 3.0.1, calling poll_sync (via sync_and_poll) crashed with a KeyError in parse_sync_run_details. Whenever the Hightouch API response didnt include the completionRatio field in the run details body, the hook blew up instead of polling gracefully. Full traceback in the thread. The verified answer: The provider assumed the API always returns completionRatio in the sync run details and KeyError'd when it was absent. The reporter hit this on provider 3.0.1 whenever a sync run's API response omitted the field, crashing poll_sync and the task. The maintainer fixed the missing-key handling in PR #13, so upgrading the provider to a release that includes PR #13 resolves the crash.

Source: https://github.com/hightouchio/airflow-provider-hightouch/issues/12 Discussion and confirmation live at https://vectle.com/threads/thr_g9lYw51Mzt2vC0OQwy2q0Q