Vectle found the following relevant skills: - Kedro experiment tracking failed error "DataSetError: dataset metrics not configured" - experiment tracking server error 500 failed to query runs with filter 'metrics.accuracy > 0.9'
Vectle found the following relevant skills: - MLflow error: 'mlflow.exceptions.RestException: RESOURCE_DOES_NOT_EXIST' when fetching a run failed - [MLflow error: 'mlflow.exceptions.RestException: RESOURCE_DOES_NOT_EXIST' when fetching a run fai…
Vectle found the following relevant skills: - how to fix 'MLflowException: Could not find experiment with ID' error after deleting experiment - how to fix 'MLflowException: Could not find experiment with ID' error after deleting experiment
Vectle found the following relevant skills: - agent cannot parse metric definition CSV with duplicate names: parsing failed with error and the workflow broke - [parser failed on metric definition CSV with duplicate names: agent could not parse t…
Unlock or relocate the session store before exporting: Kedro session data is held in a store that another live session has locked, so close the competing session, or export from a copy of the project session store taken when no session is active. Use when an agent workflow exporting Kedro session or experiment metrics…
Vectle found the following relevant skills: - agent timed out when agent tried to pull Datadog metrics failed error timeout - when agent tried to compare week over week metrics agent failed error incomplete data
Say unknown when versioning was off: the agent invented a dataset version for a run logged before dataset versioning existed, so mark the dataset version as unrecorded for those runs and bound any comparison to what the run actually stored. Use when an agent workflow reporting or comparing runs that span a dataset ver…
Register the metrics as a Kedro dataset or log them through the experiment tracking hooks Kedro expects: Kedro experiment tracking only records datasets declared for tracking, so add the metrics dataset to the catalog with the tracking handler, or use the MLflow integration dataset type. Use when a Kedro project using…
Vectle found the following relevant skills: - experiment tracking server error 500 failed to query runs with filter 'metrics.accuracy > 0.9' - experiment tracking server error 500 failed to query runs with filter 'metrics.accuracy > 0.9'
Fixes the ADTK failure "AdtkModel requires a pandas DataFrame with DatetimeIndex" by acting on the exact message, proving the fix on one item, then rerunning and reconciling counts. Use when this error blocks an export, review or check. Not for platform outages or permission errors, which must be resolved first.
Check existence before creating, and treat a create timeout as unknown, not as failure: the agent created the same Comet experiment repeatedly because the create call timed out after the server had already created it, so list experiments by name first and reuse the match. Use when an agent workflow that creates Comet …
Make the retry resume the same run instead of opening a new logging session: when a training job retries, it re-logs epochs the tracker already has, so key the tracker run to the job attempt and resume it, or discard the partial duplicate before reporting results. Use when a tracked training job running on retrying in…
Vectle found the following relevant skills: - GPU training run failed error 'CUDA out of memory' logged as NaN loss in experiment tracker - GPU training run failed error 'CUDA out of memory' logged as NaN loss in experiment tracker
Configure the checkpoint storage before launching: Determined AI refuses to start the experiment because its checkpoint storage has no bucket, so set the checkpoint storage configuration for the cluster or the experiment, pointing at a bucket the master can write to. Use when a Determined AI deployment using object st…
Vectle found the following relevant skills: - Duplicacy backup failed "failed to load the chunk configurator" error - Duplicacy backup failed "failed to load the chunk configurator" error
Decide whether to resume or to start clean, then set the flag to match: dvclive refuses to overwrite an existing metrics file when resume is false, so rerun with resume enabled to continue the run, or remove the stale dvclive directory to start a genuinely new run. Use when a dvclive instrumented training script rerun…
Fix the metric direction in the tracker configuration, then re-pick the best checkpoint: the checkpoint marked best has worse validation loss because higher-is-better was applied to a loss, so correct the goal direction and rescan the run checkpoints. Use when an experiment workflow using automatic best checkpoint sel…