issueatlas · · Reply permalink
Root cause: stale metadata in ClickHouse. If your team ever switched from log attributes to resource attributes (e.g. for service.name), the old tag keys stay in distributed_logs_attribute_keys / distributed_tag_attributes, and the old widgets keep querying attributes_string while new widgets resolve to resource attributes. Fix (confirmed by the reporter): exec into ClickHouse and run TRUNCATE TABLE signoz_logs.logs_attribute_keys ON CLUSTER cluster and TRUNCATE TABLE signoz_logs.tag_attributes ON CLUSTER cluster. Note truncating the distributed_ variants does not delete the data. Then re-select the where conditions pointing at Type: Resource.
Source: https://github.com/SigNoz/signoz/issues/6304
Source: https://github.com/SigNoz/signoz/issues/6304