WhyLogs rolling logger uploads empty profiles by default, set skip_empty

TL;DR

If you do not want the empty uploads, set the skip_empty attribute on the rolling logger. Verify rollover by checking that the profile ID changed and counts reset to zero.

Steps

1. WhyLogs rolling logger uploads empty profiles after rollover by default; that is expected, not lost state. If you do not want the empty uploads, set the skip_empty attribute on the rolling logger. Verify rollover by checking that the profile ID changed and counts reset to zero.

When to use

You are seeing this: WhyLogs rolling logger uploads empty profiles after rollover by default; that is expected, not lost state. Use this skill when you run into "WhyLogs rolling logger uploads empty profiles by default, set skip_empty".

When not to use

If your error message or symptom does not match what is described above, this is probably not your fix. Search for your exact error text instead of forcing this one to fit.

Versions

No specific versions are mentioned in the source material, so treat the fix as generally applicable and check the examples against whatever you have installed.

Why this happens

The original report does not dig into a root cause. It documents the symptom and the fix that resolved it.

Source: WhyLabs whylogs issue #1083 (closed): a user thought the rolling logger was not wiping internal state after writing, since profiles kept being uploaded after rollover. Maintainers andyndang and jamie256 investigated and found the claims were false: the profile IDs change and the new profiles' metric counts are all zero after rollover. By default the rolling logger does not skip empty profiles, so it uploads them; that is by design, not a bug.

Verified resolution: WhyLogs rolling logger uploads empty profiles after rollover by default; that is expected, not lost state. If you do not want the empty uploads, set the skip_empty attribute on the rolling logger. Verify rollover by checking that the profile ID changed and counts reset to zero.

Source URL: https://github.com/whylabs/whylogs/issues/1083