Deduper can do that. This software is easy to use and scans a folder and all its subfolders for images. It gives the user the choice to automatically run and delete images or display ever duplicate that was found so that the user can finalize the process. The user has the choice to select a folder that is save so to speak which means that the duplicate of an image in that folder will be deleted and not the image in the folder specified.

One weak point of Deduper is the fact that it only recognizes binary identical images which means that it does not recognize a dupe if it finds an image in two different sizes or one with text and one without text but the same size. I guess that’s why it’s so fast. A test run on a folder with 18000 wallpaper images did not take longer than a few minutes and had the result that almost 50% of the images were dupes resulting in a saving of more than 700 Megabytes on my hard drive.

Deduper is a nice fast program that definitely has its uses if you regularly download images from the Internet or already have many images on your hard drives.

Certain file types can be excluded from scan, the default configuration exlcudes dll, sys, vxd and inf files from the scan. You could add more files that are important in your case or remove any of the default ones. You could on the other hand limit the scan to files matching a certain filter. It would be easy to setup a scan that would only scan for images for instance using this filter. (good way to check for duplicates in image collections of 100000+ images)

Last but not least you can leave out files that have a certain file attribute such as read only, system or hidden. System files are excluded from scans by default. A last parameter makes it easy to define a rule that files will not be scanned if the file size exceeds or undercuts a give size.

The lenghts of a scan depends on various factors such as hard drive space, filters that have been set and speed of hard drive. Doublekiller is a clever program that makes it easy to scan through a large list of files and free up disk space in the progress.