Repository navigation
[RFC] Get file hashing sum by faster algorithms like xxh #4290
Description
According to Use Fast Data Algorithms, md5sum is slow for the trusted data hashing. And the better alternative is xxh. Here are the results for a 21G image data hashing:
➜ ~ du -sh /var/lib/libvirt/images/win11.qcow2
21G /var/lib/libvirt/images/win11.qcow2
➜ ~ time md5sum /var/lib/libvirt/images/win11.qcow2
8c4fa4df69d95a8b18af68d46213cf5b /var/lib/libvirt/images/win11.qcow2
md5sum /var/lib/libvirt/images/win11.qcow2 27.35s user 2.51s system 36% cpu 1:22.86 total
➜ ~ time xxh3sum /var/lib/libvirt/images/win11.qcow2
XXH3_b8b1976b55cd6f59 /var/lib/libvirt/images/win11.qcow2
xxh3sum /var/lib/libvirt/images/win11.qcow2 0.50s user 2.29s system 99% cpu 2.798 total
It will save much time for the hashing of big data.
To use xxh hash algorithm, the package xxhash of rpm or python should be installed.
Activity
coderabbitai commentedon Dec 19, 2025
📝 CodeRabbit Plan Mode
Generate an implementation plan and prompts that you can use with your favorite coding agent.
Examples
🧪 Issue enrichment is currently in open beta.
You can configure auto-planning by selecting labels in the issue_enrichment configuration.
To disable automatic issue enrichment, add the following to your
.coderabbit.yaml:💬 Have feedback or questions? Drop into our discord or schedule a call!