Skip to content

Unexpected czkawka Termination During Large-Scale Duplicate Scan #1511

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
radiodus opened this issue Apr 21, 2025 · 1 comment
Open

Unexpected czkawka Termination During Large-Scale Duplicate Scan #1511

radiodus opened this issue Apr 21, 2025 · 1 comment
Labels
bug Something isn't working

Comments

@radiodus
Copy link

radiodus commented Apr 21, 2025

I’m trying to perform a duplicate check between a 150TB SMB shared folder on UNRAID and an external hard drive connected to my PC.

However, for some reason, czkawka keeps exiting during the hash checking process—without showing any errors!

Here are the two methods I’ve tried:

  1. Connecting the external hard drive directly to UNRAID and running the scan using Docker.
  2. Connecting the external hard drive to my Windows 11 24H2 PC and scanning it against the SMB-shared folder from UNRAID.
    UNRAID and my Windows 11 PC are directly connected via 10G NIC.

In both cases, czkawka suddenly exits at some point without any error message.
My UNRAID system has 32GB of RAM, and my PC has 64GB. Other specs are more than sufficient.

It’s been almost a week now, and I haven’t been able to complete a single scan because of these crashes.
Is there any log where I can check why czkawka is terminating like this?

Unraid 7.0.0
Windows 11 24H2 26100.3775
Windows_czkawka_gui_412.
(windows_czkawka_gui_46 is crashing on my system)

@radiodus radiodus added the bug Something isn't working label Apr 21, 2025
@qarmin
Copy link
Owner

qarmin commented May 3, 2025

Can you check if problems happens with latest nightly app version? - https://github.com/qarmin/czkawka/actions/runs/14809352891 / https://github.com/qarmin/czkawka/releases/tag/Nightly

I believe the issue might be related to a corrupted cache. The latest version appears to have resolved such crashes and introduced memory limits.

Additionally, the cache folder should contain a log file with information about what went wrong.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants