[Grml] dupmerge - : Value too large for defined data type

hansbkk at gmail.com hansbkk at gmail.com
Sun Feb 6 16:59:54 CET 2011


First of all, heaps of gratitude for the excellent contribution,
tremendously helpful tool.

I really like the way you keep my mdadm raids in order, compared to
some of the mangling I see under other "rescue disks" (actually
rw-writing the preferred minor?)

What brought me to Grml was the fact that you include the dupmerge
tool out of the box, but in running it over a large set of video files
(around 5 TB at the moment, ext3 filesystem) I'm getting tons of the
above error messages on large files (some are up to 16GB). Having such
a tool fail on the largest files kind of defeats the purpose doesn't
it 8-)

I see you're running v1.70, while Sourceforge lists v1.73 as current
(as of 2008!), and I see references on the interwebs to v1.74, so
consider this if nothing else a request to update.

If it's not difficult it's also be great to be able to check out
another one or two similar deduplication tools unless you've already
checked them all out and consider dupmerge2 the best?

Here's a good overview:

http://www.asheesh.org/note/software/duplicate-files.html

My vote would be for freedup and rdfind.

Thanks for your consideration


More information about the Grml mailing list