Find and Remove Duplicate Images

Martin — Mon, 07 Apr 2008 17:11:05 +0000

If you download many images from the Internet, bulk collections for instance from Usenet or P2P, then you will eventually face the problem that you have duplicate images in your collection. Manually exploring and deleting duplicate images should be out of the question if the collection contains 10K+ images unless you really have lots of time at hand. The best way would be to use a software that scans the entire image collection and either automatically deletes all dupes or displays possible hits so that the user only needs to confirm if it is indeed a dupe.

Deduper can do that. This software is easy to use and scans a folder and all its subfolders for images. It gives the user the choice to automatically run and delete images or display ever duplicate that was found so that the user can finalize the process. The user has the choice to select a folder that is save so to speak which means that the duplicate of an image in that folder will be deleted and not the image in the folder specified.

One weak point of Deduper is the fact that it only recognizes binary identical images which means that it does not recognize a dupe if it finds an image in two different sizes or one with text and one without text but the same size. I guess that’s why it’s so fast. A test run on a folder with 18000 wallpaper images did not take longer than a few minutes and had the result that almost 50% of the images were dupes resulting in a saving of more than 700 Megabytes on my hard drive.

Deduper is a nice fast program that definitely has its uses if you regularly download images from the Internet or already have many images on your hard drives.

Tags: deduper, dupes, duplicates, images, software, Windows

Remove duplicate files

Martin — Sun, 28 Jan 2007 12:54:37 +0000

Doublekiller scans the selected folders and hardrives for duplicate files that are detected by comparing at least one of the following filters: identical names, identical files sizes, identical dates and identical CRC-32 checksums. Subdirectories are automatically included in the scan, additional filters can be defined to narrow down the scan.

Certain file types can be excluded from scan, the default configuration exlcudes dll, sys, vxd and inf files from the scan. You could add more files that are important in your case or remove any of the default ones. You could on the other hand limit the scan to files matching a certain filter. It would be easy to setup a scan that would only scan for images for instance using this filter. (good way to check for duplicates in image collections of 100000+ images)

Last but not least you can leave out files that have a certain file attribute such as read only, system or hidden. System files are excluded from scans by default. A last parameter makes it easy to define a rule that files will not be scanned if the file size exceeds or undercuts a give size.

The lenghts of a scan depends on various factors such as hard drive space, filters that have been set and speed of hard drive. Doublekiller is a clever program that makes it easy to scan through a large list of files and free up disk space in the progress.

Tags: detect, doublekiller, dupes, duplicate-files, files, freeware, hard-drive, remove-duplicates, scan

gHacks technology news » dupes

Find and Remove Duplicate Images

Related posts

Remove duplicate files

Related posts