Skip to content

增量同步过程中突然停止更新 #956

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
sofiajie opened this issue May 9, 2025 · 3 comments
Open

增量同步过程中突然停止更新 #956

sofiajie opened this issue May 9, 2025 · 3 comments
Labels
type: question Further information is requested

Comments

@sofiajie
Copy link

sofiajie commented May 9, 2025

问题描述(Issue Description)

请在这里简要描述你遇到的问题。

使用redis-shake 做全量和增量同步,在增量同步一段时间后,突然停止更新,read_count不再改变

环境信息(Environment)

  • RedisShake 版本(RedisShake Version):
    redis-shake version v4.4.0 linux/amd64 (Git SHA: bbca45b)
  • Redis 源端版本(Redis Source Version):
    3.0.2
  • Redis 目的端版本(Redis Destination Version):
    6。2.5
  • Redis 部署方式(standalone/cluster/sentinel):
    standalone
  • 是否在云服务商实例上部署(Deployed on Cloud Provider):

日志信息(Logs)

{"level":"info","time":"2025-05-07T14:11:09+08:00","message":"read_count=[118222597], read_ops=[123.39], write_count=[118222597], write_ops=[123.39], syncing aof, diff=[0]"}
{"level":"info","time":"2025-05-07T14:11:14+08:00","message":"read_count=[118223267], read_ops=[134.01], write_count=[118223267], write_ops=[134.01], syncing aof, diff=[0]"}
{"level":"info","time":"2025-05-07T14:11:19+08:00","message":"read_count=[118223898], read_ops=[126.20], write_count=[118223898], write_ops=[126.20], syncing aof, diff=[0]"}
{"level":"info","time":"2025-05-07T14:11:24+08:00","message":"read_count=[118224530], read_ops=[126.41], write_count=[118224530], write_ops=[126.41], syncing aof, diff=[0]"}
{"level":"info","time":"2025-05-07T14:11:29+08:00","message":"read_count=[118225176], read_ops=[129.20], write_count=[118225176], write_ops=[129.20], syncing aof, diff=[0]"}
{"level":"info","time":"2025-05-07T14:11:34+08:00","message":"read_count=[118225513], read_ops=[67.40], write_count=[118225512], write_ops=[67.20], syncing aof, diff=[0]"}
{"level":"info","time":"2025-05-07T14:11:39+08:00","message":"read_count=[118225513], read_ops=[0.00], write_count=[118225512], write_ops=[0.00], syncing aof, diff=[0]"}
{"level":"info","time":"2025-05-07T14:11:44+08:00","message":"read_count=[118225513], read_ops=[0.00], write_count=[118225512], write_ops=[0.00], syncing aof, diff=[8397134]"}
{"level":"info","time":"2025-05-07T14:11:49+08:00","message":"read_count=[118225513], read_ops=[0.00], write_count=[118225512], write_ops=[0.00], syncing aof, diff=[17853317]"}
{"level":"info","time":"2025-05-07T14:11:54+08:00","message":"read_count=[118225513], read_ops=[0.00], write_count=[118225512], write_ops=[0.00], syncing aof, diff=[30477689]"}
{"level":"info","time":"2025-05-07T14:11:59+08:00","message":"read_count=[118225513], read_ops=[0.00], write_count=[118225512], write_ops=[0.00], syncing aof, diff=[40357926]"}
{"level":"info","time":"2025-05-07T14:12:04+08:00","message":"read_count=[118225513], read_ops=[0.00], write_count=[118225512], write_ops=[0.00], syncing aof, diff=[50875782]"}

其他信息(Additional Information)

未见error 日志,在增量同步时read_count不更新,diff 逐渐变大
查看目的端redis,在shake.toml中配置的地址为redis cluster 的一个节点,该节点在上午10点半左右发生了failover,但当时redis-shake 正常同步,下午14:11分未见异常

@sofiajie sofiajie added the type: question Further information is requested label May 9, 2025
@suxb201
Copy link
Member

suxb201 commented May 9, 2025

问题不好查。首先 redis-shake 没有处理 failover 的场景,理论上出现 failover 就会出错才对。建议你再跑试试,看看没有 failover 的时候是否运行正常。

@sofiajie
Copy link
Author

sofiajie commented May 9, 2025

重跑后正常运行了,想找到什么原因会导致redis-shake这样停止更新的情况?

@suxb201
Copy link
Member

suxb201 commented May 9, 2025

@sofiajie 我也第一次遇到,你可以打栈看看

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type: question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants