antirez/redis — Issue #159: Permanent AOF background rewrite with 2.4.1
Author: jweiss
Created: 2011-10-25 18:55:44+00:00
State: open

We have a 2.4.1 master with 3 slaves (2.4.1 all) and the master is continuously rewriting the AOF file in the background, causing high load on the disks:

[9180] 25 Oct 18:47:53 * SYNC append only file rewrite performed
[23062] 25 Oct 18:47:53 * Background AOF rewrite terminated with success
[23062] 25 Oct 18:47:53 * Parent diff successfully flushed to the rewritten AOF (0 bytes)
[23062] 25 Oct 18:47:53 * Background AOF rewrite successful
[23062] 25 Oct 18:47:53 * Background append only file rewriting started by pid 9244
[23062] 25 Oct 18:48:18 * Slave ask for synchronization
[23062] 25 Oct 18:48:18 * Starting BGSAVE for SYNC
[23062] 25 Oct 18:48:18 * Background saving started by pid 9632
[23062] 25 Oct 18:48:18 * Slave ask for synchronization
[23062] 25 Oct 18:48:18 * Waiting for end of BGSAVE for SYNC
[9632] 25 Oct 18:49:22 * DB saved on disk
[9244] 25 Oct 18:49:22 * SYNC append only file rewrite performed
[23062] 25 Oct 18:49:22 * Background AOF rewrite terminated with success
[23062] 25 Oct 18:49:22 * Parent diff successfully flushed to the rewritten AOF (0 bytes)
[23062] 25 Oct 18:49:22 * Background AOF rewrite successful
[23062] 25 Oct 18:49:22 * Background saving terminated with success
[23062] 25 Oct 18:49:22 * Background append only file rewriting started by pid 9654
[9654] 25 Oct 18:50:36 * SYNC append only file rewrite performed
[23062] 25 Oct 18:50:37 * Background AOF rewrite terminated with success
[23062] 25 Oct 18:50:37 * Parent diff successfully flushed to the rewritten AOF (0 bytes)
[23062] 25 Oct 18:50:37 * Background AOF rewrite successful
[23062] 25 Oct 18:50:37 * Background append only file rewriting started by pid 9943

Every time one background AOF rewrite finishes, the next one starts.

We tried several things to fix it, but all didn't help:

redis-cli config set auto-aof-rewrite-min-size 536870912000
redis-cli config get auto-aof-rewrite-percentage 100000
redis-cli config get auto-aof-rewrite-percentage 0
redis-cli config set appendonly no

The original config file: https://gist.github.com/1313833
The server info: https://gist.github.com/1313836