<?xml version="1.0" encoding="UTF-8"?> <rss
version="2.0"
xmlns:content="http://purl.org/rss/1.0/modules/content/"
xmlns:wfw="http://wellformedweb.org/CommentAPI/"
xmlns:dc="http://purl.org/dc/elements/1.1/"
xmlns:atom="http://www.w3.org/2005/Atom"
xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
> <channel><title>gHacks Technology News &#124; Latest Tech News, Software And Tutorials &#187; remove-duplicates</title> <atom:link href="http://www.ghacks.net/tag/remove-duplicates/feed/" rel="self" type="application/rss+xml" /><link>http://www.ghacks.net</link> <description>A technology news blog covering software, mobile phones, gadgets, security, the Internet and other relevant areas.</description> <lastBuildDate>Fri, 10 Feb 2012 20:51:26 +0000</lastBuildDate> <language>en</language> <sy:updatePeriod>hourly</sy:updatePeriod> <sy:updateFrequency>1</sy:updateFrequency> <generator>http://wordpress.org/?v=3.3.1</generator> <atom:link rel="hub" href="http://pubsubhubbub.appspot.com"/><atom:link rel="hub" href="http://superfeedr.com/hubbub"/> <item><title>NoDupe, Fast, Versatile Duplicate File Finder</title><link>http://www.ghacks.net/2011/08/06/nodupe-fast-versatile-duplicate-file-finder/</link> <comments>http://www.ghacks.net/2011/08/06/nodupe-fast-versatile-duplicate-file-finder/#comments</comments> <pubDate>Sat, 06 Aug 2011 07:45:36 +0000</pubDate> <dc:creator>Martin Brinkmann</dc:creator> <category><![CDATA[Software]]></category> <category><![CDATA[Windows]]></category> <category><![CDATA[duplicate-files]]></category> <category><![CDATA[nodupe]]></category> <category><![CDATA[remove-duplicates]]></category> <category><![CDATA[windows software]]></category> <guid
isPermaLink="false">http://www.ghacks.net/?p=48696</guid> <description><![CDATA[Finding duplicate files on your Windows PC does not have to be an hour long marathon of searching, comparing and finding anymore. With NoDupe, it is almost to easy to find the duplicate files on your system. When you first start the application you will notice the minimalistic interface. Users who just want to start [...]]]></description> <content:encoded><![CDATA[<p>Finding duplicate files on your Windows PC does not have to be an hour long marathon of searching, comparing and finding anymore. With NoDupe, it is almost to easy to find the duplicate files on your system. When you first start the application you will notice the minimalistic interface. Users who just want to start need to select hard drives or folders on their system before they push the start button.</p><p>It is usually not a good idea to search on all hard drives and storage devices for all kinds of duplicate files, considering that you will end up with many duplicate Windows system files in the process.</p><p><img
src="http://www.ghacks.net/wp-content/uploads/2011/08/nodupe-duplicate-file-finder1.png" alt="nodupe-duplicate-file-finder" title="nodupe-duplicate-file-finder" width="600" height="471" class="alignnone size-full wp-image-48698" /></p><p>The Search Type filter helps in this regard. You can switch it from All Files to Music Files or Directories, or click the customise button to add your own filters to the application. You could for instance create a media filter to find duplicates for all your media files, or a document filter for Office documents.</p><p>Configuring the right file filters can speed up the duplicate file search tremendously. The customise search menu can be used to add or delete file filters. Each filter consists of a descriptive name and one or multiple file extensions. Only the file extensions listed under the filter will be checked for duplicate files if that filter is selected in the main program window.</p><p><img
src="http://www.ghacks.net/wp-content/uploads/2011/08/duplicate-file-filter.png" alt="duplicate-file-filter" title="duplicate-file-filter" width="557" height="293" class="alignnone size-full wp-image-48707" /></p><p>NoDupe displays the results in a table. Identical files are shown as groups in the interface, along with their length, filename, directory, extension and data.</p><p><img
src="http://www.ghacks.net/wp-content/uploads/2011/08/duplicate-files1.png" alt="duplicate-files" title="duplicate-files" width="600" height="471" class="alignnone size-full wp-image-48706" /></p><p>You can select individual files for removal and deletion, or use the Auto Mark feature to let the program do that for you. A click on Delete removes the selected files and folders from the system.</p><p>Advanced options, linked to from the main interface, can be used to further customize the duplicate file finding process. Here it is possible to select a minimum or maximum file size that you want to be considered, configure file deletion warnings or enable permanent deletion of deleted files.</p><p>Windows users looking for a straightforward but nevertheless sophisticated duplicate file finder should take a closer look at NoDupe. The program is compatible with 32-bit and 64-bit editions of the Windows 7 operating system. It can be downloaded <a
href="http://nodupe.co.uk/">from the</a> developer website.</p> ]]></content:encoded> <wfw:commentRss>http://www.ghacks.net/2011/08/06/nodupe-fast-versatile-duplicate-file-finder/feed/</wfw:commentRss> <slash:comments>12</slash:comments> </item> <item><title>Duplicate Photo Finder</title><link>http://www.ghacks.net/2011/01/01/duplicate-photo-finder/</link> <comments>http://www.ghacks.net/2011/01/01/duplicate-photo-finder/#comments</comments> <pubDate>Sat, 01 Jan 2011 17:12:07 +0000</pubDate> <dc:creator>Martin Brinkmann</dc:creator> <category><![CDATA[Software]]></category> <category><![CDATA[Windows]]></category> <category><![CDATA[duplicate photo finder]]></category> <category><![CDATA[duplicate-files]]></category> <category><![CDATA[remove-duplicates]]></category> <category><![CDATA[windows software]]></category> <guid
isPermaLink="false">http://www.ghacks.net/?p=38583</guid> <description><![CDATA[There is definitely no shortage of duplicate file finders for the Windows operating system. Most of the programs on the other hand are complicated to use which may confuse or irritate some users. Duplicate Photo Finder&#8217;s premise is to be a comfortable and easy to use application to find and manage duplicate images stored on [...]]]></description> <content:encoded><![CDATA[<p>There is definitely no shortage of duplicate file finders for the Windows operating system. Most of the programs on the other hand are complicated to use which may confuse or irritate some users.</p><p>Duplicate Photo Finder&#8217;s premise is to be a comfortable and easy to use application to find and manage duplicate images stored on the PC.</p><p>The interface of the application can be best described as minimalistic but sufficient for most users. It begins with the selection of a comparison method at the top. Duplicate Photo Finder supports comparison by file sizes or file hashes. The first option is fast, the second more reliable but slower.</p><p><img
src="http://www.ghacks.net/wp-content/uploads/2011/01/duplicate-photo-finder-457x550.png" alt="duplicate photo finder" title="duplicate photo finder" width="457" height="550" class="alignnone size-medium wp-image-38584" /></p><p>A scan can then be started once the original folder and the duplicate folder have been selected from the folder browser. The program will not search through folders recursively which can limit its use if photos are stored in a lot of subfolders. It would be nice if the developer could add the option to include subfolders and their images in the scan.</p><p>All duplicate images that are found in the process are displayed in a listing at the bottom of the screen. The interesting option here is that it is possible to select them to display both photos next to each other in the interface which makes it easy to look through the duplicate images before they are deleted.</p><p>The program offers controls to delete some or all of the duplicate images at once. Duplicate Photo Finder is  handy software program for the Windows operating system. It requires the Microsoft .NET Framework 4.0 and runs fine on 32-bit and 64-bit editions of Windows. Downloads are <a
href="http://renegademinds.com/Products/DuplicatePhotoFinder/tabid/122/Default.aspx">available</a> at the homepage of the developer.</p> ]]></content:encoded> <wfw:commentRss>http://www.ghacks.net/2011/01/01/duplicate-photo-finder/feed/</wfw:commentRss> <slash:comments>9</slash:comments> </item> <item><title>Duplicate File Finder Duplicate Cleaner 2.0</title><link>http://www.ghacks.net/2010/11/10/duplicate-file-finder-duplicate-cleaner-2-0/</link> <comments>http://www.ghacks.net/2010/11/10/duplicate-file-finder-duplicate-cleaner-2-0/#comments</comments> <pubDate>Tue, 09 Nov 2010 23:36:06 +0000</pubDate> <dc:creator>Martin Brinkmann</dc:creator> <category><![CDATA[Software]]></category> <category><![CDATA[Windows]]></category> <category><![CDATA[duplicate cleaner]]></category> <category><![CDATA[duplicate file finder]]></category> <category><![CDATA[duplicate-files]]></category> <category><![CDATA[remove-duplicates]]></category> <category><![CDATA[windows software]]></category> <guid
isPermaLink="false">http://www.ghacks.net/?p=36691</guid> <description><![CDATA[Computer users have numerous reasons for finding and deleting duplicate files on their systems. Some of the top reasons include freeing up storage space and better manageability of files in the operating system. The duplicate file finder Duplicate Cleaner 2 has just been released as a beta preview. Duplicate Cleaner is a sophisticate duplicate file [...]]]></description> <content:encoded><![CDATA[<p>Computer users have numerous reasons for finding and deleting duplicate files on their systems. Some of the top reasons include freeing up storage space and better manageability of files in the operating system. The duplicate file finder Duplicate Cleaner 2 has just been released as a beta preview.</p><p>Duplicate Cleaner is a sophisticate duplicate file finder with lots of options to configure the scanning and duplicate file checking. The main program window is used to configure the search criteria. Duplicate Cleaner can be configured to find files based on the following parameters:</p><ul><li>Same content (checked by comparing MD5 hashes)</li><li>Same file name</li><li>Same size</li><li>Same created date</li><li>Same modified date</li><li>For music files: same artist, same title, same album</li></ul><p>Filters can be added to reduce the number of files to be scanned by the program. It is possible to configure a file size filter, which will only scan files of a specific size range, file dates, which will only scan files that have been created or modified between dates specified and file name filters that can be used to include or exclude files based on names and extensions. All file scanning parameters can be combined in the scan.</p><p>Folders, partitions and drives can be added easily in the same window. Only the selected folders will be scanned by the duplicate file finder.</p><p><a
href="http://www.ghacks.net/wp-content/uploads/2010/11/duplicate-file-finder1.jpg"><img
src="http://www.ghacks.net/wp-content/uploads/2010/11/duplicate-file-finder1-500x369.jpg" alt="duplicate file finder" title="duplicate file finder" width="500" height="369" class="alignnone size-medium wp-image-36693" /></a></p><p>The time it takes to scan the folder depends on the speed of the hard drive and computer, as well as the files and folders and how much disk space they occupy on the selected drives. A report is displayed at the end of the scan listing the number of files that have been scanned, the time it took to scan the files and the number and size of the duplicate files that have been found.</p><p><a
href="http://www.ghacks.net/wp-content/uploads/2010/11/duplicate-file-scan.jpg"><img
src="http://www.ghacks.net/wp-content/uploads/2010/11/duplicate-file-scan-500x261.jpg" alt="duplicate file scan" title="duplicate file scan" width="500" height="261" class="alignnone size-medium wp-image-36694" /></a></p><p>A listing of all duplicate files is then displayed to the user. Individual files can be selected manually, and a preview is available for images for a visual aid.</p><p>The Selection Assistant can aid the user if many duplicate files have been found on the system.</p><p><a
href="http://www.ghacks.net/wp-content/uploads/2010/11/selection-assistant.jpg"><img
src="http://www.ghacks.net/wp-content/uploads/2010/11/selection-assistant-500x342.jpg" alt="selection assistant" title="selection assistant" width="500" height="342" class="alignnone size-medium wp-image-36695" /></a></p><p>Here it is possible to select multiple files at once, based on lots of different criteria including:</p><ul><li>Shortest or longest filename</li><li>Oldest or newest file based on creation / modification</li><li>Smallest or largest file</li><li>By audio attributes (keep highest bitrate, highest sample rate, longest length)</li><li>By text patterns in file name, path, sitze and lots of other variables. Supports regular expressions</li><li>By location based on a selected path</li></ul><p>Once the duplicate files have been selected for removal it is possible to configure deletion options. Standard options exist like deleting the duplicates to the recycle bin / without moving them to the recycle bin. Interesting options are available to automatically rename the duplicate files, move or copy them instead or create hardlinks (only on NTFS file systems). The option to create hardlinks could be interesting for users who fear that the removal of files could result in dead links or accessibility problems.</p><p><a
href="http://www.ghacks.net/wp-content/uploads/2010/11/delete-duplicate-files.jpg"><img
src="http://www.ghacks.net/wp-content/uploads/2010/11/delete-duplicate-files-500x292.jpg" alt="delete duplicate files" title="delete duplicate files" width="500" height="292" class="alignnone size-medium wp-image-36696" /></a></p><p>It is additionally possible to remove empty folders in the process. Duplicate Cleaner is an impressive program that comes with lots of additional options that have not been mentioned yet. It is for instance possible to change the file comparison algorithm, include network drives in the search and to import and export the results to CSV files.</p><p>Here is the feature list of Duplicate Cleaner as listed on the developer website:</p><ul><li>Find Duplicate Files by content, fast!</li><li>Cleaner hard drives means faster performance</li><li>Fast Scanning and accurate duplicate comparison (Uses the MD5 Hash algorithm)</li><li>Deep scans music &#8211; locate duplicate music formats (MP3, iTunes, etc)</li><li>Flexible search parameters</li><li>Intelligent Selection Assistant</li><li>Search home or networked drives</li><li>Search multiple locations</li><li>Export / Import results in CSV format</li><li>View Path,Size and Date of files</li><li>Large, resizable list window</li><li>Image preview window</li><li>Delete duplicate files to the Recycle bin</li><li>Move dupe files to a new location</li><li>Turn duplicate file into hard links (NTFS file systems only)</li><li>Protection for Windows and system files</li><li>Supports multiple languages</li></ul><h3>Duplicate Cleaner Download And Compatibility</h3><p>It is surprising that this high quality application is available free of charge. It is one of the best duplicate cleaners available for the Windows operating system. The duplicate file finder is compatible with 32-bit and 64-bit editions of Microsoft Windows 2000, Windows XP, Windows Vista and Windows 7. It should also run fine on Windows Server installations. Downloads and additional information are available at the developer website at <a
href="http://www.digitalvolcano.co.uk/content/duplicate-cleaner">DigitalVolcano.co.uk</a>.</p> ]]></content:encoded> <wfw:commentRss>http://www.ghacks.net/2010/11/10/duplicate-file-finder-duplicate-cleaner-2-0/feed/</wfw:commentRss> <slash:comments>6</slash:comments> </item> <item><title>Duplicate Commander, Find And Delete Duplicate Files</title><link>http://www.ghacks.net/2010/09/24/duplicate-commander-find-and-delete-duplicate-files/</link> <comments>http://www.ghacks.net/2010/09/24/duplicate-commander-find-and-delete-duplicate-files/#comments</comments> <pubDate>Fri, 24 Sep 2010 09:09:50 +0000</pubDate> <dc:creator>Martin Brinkmann</dc:creator> <category><![CDATA[Software]]></category> <category><![CDATA[Windows]]></category> <category><![CDATA[duplicate cleaner]]></category> <category><![CDATA[duplicate commander]]></category> <category><![CDATA[duplicate-files]]></category> <category><![CDATA[remove-duplicates]]></category> <category><![CDATA[windows software]]></category> <guid
isPermaLink="false">http://www.ghacks.net/?p=35142</guid> <description><![CDATA[Duplicate files are not such a big problem anymore for most users, unlike a few years ago. This can be mainly attributed to the increase in storage space of the average PC. Even one Gigabyte of duplicate contents does not mean a lot if the PC has storage space of 1 Terabyte or above. Still, [...]]]></description> <content:encoded><![CDATA[<p>Duplicate files are not such a big problem anymore for most users, unlike a few years ago. This can be mainly attributed to the increase in storage space of the average PC. Even one Gigabyte of duplicate contents does not mean a lot if the PC has storage space of 1 Terabyte or above. Still, there are situations where it makes sense to find and delete duplicate files. Users with Solid State Drives for instance need to take good care of the space that is provided by their SSDs. The same is true for users of older PC systems. And even users who have lots of space may want to consider removing duplicate files every now and then, to free up disk space but also for usability reasons.</p><p>Duplicate Commander is a free software for Windows for this exact purpose. The program is compatible with 32-bit and 64-bit editions, and requires the Microsoft .net Framework 4.0 to run.</p><p>On first glance, it looks like a standard duplicate file finder. A click on Search opens a folder browser to add folders to the search. Only a handful of options are provided, including the ability to filter by file type or size. A byte by byte comparison can be launched from the listing of results.</p><div
id="attachment_35143" class="wp-caption alignnone" style="width: 394px"><a
href="http://www.ghacks.net/wp-content/uploads/2010/09/finding-duplicate-files.png"><img
src="http://www.ghacks.net/wp-content/uploads/2010/09/finding-duplicate-files.png" alt="finding duplicate files" title="finding duplicate files" width="384" height="420" class="size-full wp-image-35143" /></a><p
class="wp-caption-text">finding duplicate files</p></div><p>Duplicate Commander then processes the files in the selected directories based on the configured rules. This can take some time, depending on the speed of the hard drive, the performance of the computer and the amount of files stored in those directories. The status window displays the progress of the operation. It includes a progress bar, and information about the number of duplicates found, and their size on the disk.</p><div
id="attachment_35145" class="wp-caption alignnone" style="width: 510px"><a
href="http://www.ghacks.net/wp-content/uploads/2010/09/duplicate-files.png"><img
src="http://www.ghacks.net/wp-content/uploads/2010/09/duplicate-files-500x360.png" alt="duplicate files" title="duplicate files" width="500" height="360" class="size-medium wp-image-35145" /></a><p
class="wp-caption-text">duplicate files</p></div><p>Once the scan has finished a list containing all duplicate files found is displayed to the user in the main program interface. Duplicate files are linked, and checkboxes are provided to select some or even all to deal with them. Controls are provided to make the selection easier. It is for instance possible to click on a button to automatically select specific duplicates from the list, for instance the first or last of the group, the oldest or newest, or the duplicate with the smallest sizes.</p><p>Once duplicate files have been selected, it is possible to click on the delete button to remove the files from the system, or use the unique hard links option to create hard links to the remaining files.</p><p>Creating hard links offers an interesting alternative to deleting the files outright. Creating those links ensures that the system still acts as if the files exist in the location, even though they have been deleted by the duplicate file finder.</p><p>This obviously makes a lot of sense if the user is unsure about the consequences of deleting the files outright.</p><p>Duplicate Commander is available for download at the developer website. The hard link feature makes it a very interesting option for users who want to delete duplicate files from their system.</p> ]]></content:encoded> <wfw:commentRss>http://www.ghacks.net/2010/09/24/duplicate-commander-find-and-delete-duplicate-files/feed/</wfw:commentRss> <slash:comments>6</slash:comments> </item> <item><title>Duplicate File Finder</title><link>http://www.ghacks.net/2009/04/28/duplicate-file-finder/</link> <comments>http://www.ghacks.net/2009/04/28/duplicate-file-finder/#comments</comments> <pubDate>Tue, 28 Apr 2009 16:01:13 +0000</pubDate> <dc:creator>Martin Brinkmann</dc:creator> <category><![CDATA[Software]]></category> <category><![CDATA[Windows]]></category> <category><![CDATA[duplicate cleaner]]></category> <category><![CDATA[duplicate file finder]]></category> <category><![CDATA[duplicates]]></category> <category><![CDATA[files]]></category> <category><![CDATA[remove-duplicates]]></category> <category><![CDATA[windows software]]></category> <guid
isPermaLink="false">http://www.ghacks.net/2009/04/28/duplicate-file-finder/</guid> <description><![CDATA[Duplicate files can take up valuable storage space on computer systems. They are created accidentally most of the time. Some possible scenarios include date backups but also the download of file packages that contain hundreds or even thousands of files. Most duplicate files are media related, mainly images, videos and music. It can be quite [...]]]></description> <content:encoded><![CDATA[<p>Duplicate files can take up valuable storage space on computer systems. They are created accidentally most of the time. Some possible scenarios include date backups but also the download of file packages that contain hundreds or even thousands of files. Most duplicate files are media related, mainly images, videos and music. It can be quite cumbersome and time consuming to check the files on a computer system for duplicates. This is especially true when large collections of files are stored on the hard drives and storage devices.</p><p><span
id="more-12439"></span>Duplicate file finders like <a
href="http://www.digitalvolcano.co.uk/content/duplicate-cleaner">Duplicate Cleaner</a> aid the user in finding duplicate files. The software program has been designed to scan a computer system thoroughly for duplicate files. It provides access to a file search but also to a specialized music search in its interface. The music search will scan mp3, wma, ogg, flac and ape files on the computer system and compare artists, titles and albums in the meta tags plus the usual file size and file name. Files on the other hand can be checked for various parameters including crc, name, file size and date.</p><p><img
src="http://www.ghacks.net/wp-content/uploads/2009/04/duplicate_file_finder-500x375.jpg" alt="duplicate file finder" title="duplicate file finder" width="500" height="375" class="alignnone size-medium wp-image-12437" /></p><p>Specific folders and partitions can be added to the scan which will create three listings in the end. One will display the duplicate files found in the selected folders, another will display all zero byte files and the last will display all files that have been scanned by the program.</p><p>A selection assistant is provided to make the selection of duplicate files easier. The options offered are quite extensive. It is possible to keep audio files with the highest bitrate, length or sample rate. Other filters include selection by date and time, file size, group, pattern in name or path and those that are not located in a master path.</p><p><img
src="http://www.ghacks.net/wp-content/uploads/2009/04/duplicate_cleaner-500x278.jpg" alt="duplicate cleaner" title="duplicate cleaner" width="500" height="278" class="alignnone size-medium wp-image-12438" /></p><p>Scan time will vary depending on the parameters of the scan, the number of folders and files and the speed of the drives. Duplicate Cleaner is a sophisticated computer software program to find duplicates on a computer system.</p> ]]></content:encoded> <wfw:commentRss>http://www.ghacks.net/2009/04/28/duplicate-file-finder/feed/</wfw:commentRss> <slash:comments>12</slash:comments> </item> <item><title>Remove duplicate files</title><link>http://www.ghacks.net/2007/01/28/remove-duplicate-files/</link> <comments>http://www.ghacks.net/2007/01/28/remove-duplicate-files/#comments</comments> <pubDate>Sun, 28 Jan 2007 12:54:37 +0000</pubDate> <dc:creator>Martin Brinkmann</dc:creator> <category><![CDATA[Operating Systems]]></category> <category><![CDATA[Tools]]></category> <category><![CDATA[Windows]]></category> <category><![CDATA[detect]]></category> <category><![CDATA[doublekiller]]></category> <category><![CDATA[dupes]]></category> <category><![CDATA[duplicate-files]]></category> <category><![CDATA[files]]></category> <category><![CDATA[freeware]]></category> <category><![CDATA[hard-drive]]></category> <category><![CDATA[remove-duplicates]]></category> <category><![CDATA[scan]]></category> <guid
isPermaLink="false">http://www.ghacks.net/2007/01/28/remove-duplicate-files/</guid> <description><![CDATA[Doublekiller scans the selected folders and hardrives for duplicate files that are detected by comparing at least one of the following filters: identical names, identical files sizes, identical dates and identical CRC-32 checksums. Subdirectories are automatically included in the scan, additional filters can be defined to narrow down the scan.]]></description> <content:encoded><![CDATA[<p><a
href="http://www.bigbangenterprises.de/en/doublekiller/" title="remove duplicate files" target="_blank">Doublekiller</a> scans the selected folders and hardrives for duplicate files that are detected by comparing at least one of the following filters: identical names, identical files sizes, identical dates and identical CRC-32 checksums. Subdirectories are automatically included in the scan, additional filters can be defined to narrow down the scan.</p><p>Certain file types can be excluded from scan, the default configuration exlcudes dll, sys, vxd and inf files from the scan. You could add more files that are important in your case or remove any of the default ones. You could on the other hand limit the scan to files matching a certain filter. It would be easy to setup a scan that would only scan for images for instance using this filter. (good way to check for duplicates in image collections of 100000+ images)</p><p><span
id="more-1142"></span> Last but not least you can leave out files that have a certain file attribute such as read only, system or hidden. System files are excluded from scans by default. A last parameter makes it easy to define a rule that files will not be scanned if the file size exceeds or undercuts a give size.</p><p>The lenghts of a scan depends on various factors such as hard drive space, filters that have been set and speed of hard drive. Doublekiller is a clever program that makes it easy to scan through a large list of files and free up disk space in the progress.</p> ]]></content:encoded> <wfw:commentRss>http://www.ghacks.net/2007/01/28/remove-duplicate-files/feed/</wfw:commentRss> <slash:comments>5</slash:comments> </item> </channel> </rss>
