Duplicate detection
Quickly and easily monitor all your images and listings for exact and near duplicates

Duplicate listing detection
While permitted in many international markets, duplicate listings significantly deteriorate the user experience. When a users sees the same listing more than once, they become confused and are left questioning the validity of the property and/or owner. Our API-based duplicate listing solution has been developed to help portals understand which listings are duplicates so they can be handled accordingly.



Duplicate image analysis
Our duplicate listing solution is built upon our Sherlock similarities technology that is able to understand how visually similar two images are to one another. We’ve found this method to be much more robust than the basic hashing approaches employed by many companies today. Our API-based solution enables companies to monitor and update their entire dataset to continually keep track of the duplicated content on their site.
BENEFITS
Why should you look
into duplicate listings on your site?
50 fraudulent
listings/day
manually detected on property websites
Up to 20%
of listings
amount of duplicated content on portals
$750 to $150K
per image
in copyright violation damages
We flag all kinds of duplicates
1.
Re-used images
Agents may improperly reuse another agent's image exposing your site up to potential copyright issues
2.
Edited photos
We detect "near-duplicate" images, or images that have been edited in some way, such as being cropped, enhanced, resized, etc.
3.
Different watermarks
Identical images where content has been artificially added, for instance two images with different watermarks
USE CASES
Ensure your site is clean, consistent and beautiful
Avoid copyright violations
A REALTOR sees an image of the community pool on another listing and decides to include it on their own. This is a copyright violation and MLSs spend countless hours handling them. Our automated monitoring solution has helped companies reduce time spent on manual moderation by 25%.
Prevent SEO issues
Google penalizes text that appears on more than one page on your website. If your site has a lot of duplicates, your page rankings will suffer from it and your site will be harder to reach organically. Up to 20% of portals listings are duplicates.
Improve user experience
Users become confused and disengaged when they browse multiple listings with identical photos, particularly if each property has a different price or contact. After removing duplicate listings, our clients have seen a 15% increase in unique properties viewed.
Reduce costs
With many real estate sites featuring millions of images, duplicates create sizable storage and maintenance costs. These problems only grow over time and become bigger issues if not detected immediately. With our real-time monitoring in place, we’ve helped clients reduce their database size by over 20%.
How do we determine whether
a listing is a duplicate?

Unique digital fingerprint
All images are analyzed and given a digital fingerprint based on over 1,000 different features.
Report generation
After the index is created, reports can be generated at any time to identify potential duplicates. The similarity threshold can be adjusted.
Non-stop monitoring
Photos are continually analyzed and duplicate images are immediately flagged, reflecting any added, removed or modified images.
Unique fingerprint
All images are analyzed and given a digital fingerprint based on over 1,000 different features.
Unique fingerprint
Report generation
Non-stop monitoring
Effortless moderation. Clean listings. Engaged users.