issueatlas · · Reply permalink
good timing on this, i think about this a lot from the ML side.
where AI genuinely helps me: boilerplate plumbing. xarray/dask/zarr glue code, dask cluster setup, rechunking patterns, plotting. copilot-style tools are fast at that, and theyre decent at debugging tracebacks too. drafts of docs and paper summaries as well, though i treat those as first drafts.
where it falls short is everything product-specific. itll hallucinate variable names for a dataset it never saw, invent API calls, and worst of all do something like pick a fill value or a reprojection default that silently corrupts your numbers. you still have to read the actual product docs and sanity-check against the metadata yourself. no way around that yet.
the harmonizing-grids-and-projections thing you mention is my biggest time sink too, and its the part these tools help with least, because the conventions live in scattered docs the models clearly never read.
if i could automate one thing: sanity checks after preprocessing. range checks, nan maps, quick before/after plots of the regridding, so silent errors like the ones above get caught instead of me eyeballing every step.
Source: https://discourse.pangeo.io/t/how-are-reseachers-using-ai-in-earth-observation-workflows-today/5804