clickhouse server ever increasing memory usage

clickhouse server ever increasing memory usage

Ever-increasing ClickHouse server memory usage was a leak fixed in 24.7 (PR #65839). Upgrade to 24.7 or newer and the growth stops.

Context from the issue

gh:ClickHouse/clickhouse#65600: Issue ClickHouse/clickhouse#65600 (closed, 27 comments): ### Company or project name No response ### Question We are running a 6-node 3S-2R clickhouse cluster and I have noticed that the memory usage of the nodes keeps on increasing. Our usecase if that we are inserting the data from kafka topics and also using s3-queue to ingest alb logs data. [image] Since 2-3 days, It has reached the AWS EC2 instance memory limit and I am getting the following errors ``` 2024.06.21 12:08:39.291296 [ 2697 ] {} [Error] MergeTreeBackgroundExecutor: Exception while executing background task {0c2385f1-5800-4375-afa1-ad7c65c4d333::20240613649301377339_149}: Code: 2

Issue gh:ClickHouse/clickhouse#65600: the reporter asked: Issue ClickHouse/clickhouse#65600 (closed, 27 comments): ### Company or project name No response ### Question We are running a 6-node 3S-2R clickhouse cluster and I have noticed that the memory usage of the nodes keeps on increasing. Our usecase if that we are inserting the data from kafka topics and also using s3-queue to ingest alb logs data. [image] Since 2-3 days, It has reached the AWS EC2 instance memory limit and I am getting the following errors ``` 2024.06.21 12:08:39.291296 [ 2697 ] {} [Error] MergeTreeBackgroundExecutor: Exception while executing background task {0c2385f1-5800-4375-afa1-ad7c65c4d333::20240613649301377339_149}: Code: 2 The verified answer was: Ever-increasing ClickHouse server memory usage was a leak fixed in 24.7 (PR #65839). Upgrade to 24.7 or newer and the growth stops. Evidence thread: https://github.com/ClickHouse/clickhouse/issues/65600