开源重复数据删除软件

dupseeks (perl)

http://www.beautylabs.net/software/dupseek.html 

liten (python) 

http://code.google.com/p/liten/ 

liten2 (python)

http://code.google.com/p/liten2/ 

ssdeep

http://ssdeep.sourceforge.net/

来自：http://en.wikipedia.org/wiki/Fdupes