Duplicate detection

Quickly and easily monitor all your images and listings for exact and near duplicates

Duplicate detection

Duplicate listing detection

While permitted in many international markets, duplicate listings significantly deteriorate the user experience. When a users sees the same listing more than once, they become confused and are left questioning the validity of the property and/or owner. Our API-based duplicate listing solution has been developed to help portals understand which listings are duplicates so they can be handled accordingly. 

 

Our solution even identifies duplicates when the images are taken by two different photographers
Duplicate listing detection
Duplicate images tagged in property listing

Duplicate image analysis

Our duplicate listing solution is built upon our Sherlock similarities technology that is able to understand how visually similar two images are to one another. We’ve found this method to be much more robust than the basic hashing approaches employed by many companies today.  Our API-based solution enables companies to monitor and update their entire dataset to continually keep track of the duplicated content on their site.

 

BENEFITS

Why should you look
into duplicate listings on your site?

50 fraudulent
listings/day

manually detected on property websites

Up to 20%
of listings

amount of duplicated content on portals

$750 to $150K
per image

in copyright violation damages

We flag all kinds of duplicates


1.

Re-used images

Agents may improperly reuse another agent's image exposing your site up to potential copyright issues



2.

Edited photos

We detect "near-duplicate" images, or images that have been edited in some way, such as being cropped, enhanced, resized, etc.


3.

Different watermarks

Identical images where content has been artificially added, for instance two images with different watermarks


USE CASES

Ensure your site is clean, consistent and beautiful

Avoid copyright violations

A REALTOR sees an image of the community pool on another listing and decides to include it on their own. This is a copyright violation and MLSs spend countless hours handling them. Our automated monitoring solution has helped companies reduce time spent on manual moderation by 25%.

Prevent SEO issues

Google penalizes text that appears on more than one page on your website. If your site has a lot of duplicates, your page rankings will suffer from it and your site will be harder to reach organically. Up to 20% of portals listings are duplicates.

Improve user experience

Users become confused and disengaged when they browse multiple listings with identical photos, particularly if each property has a different price or contact. After removing duplicate listings, our clients have seen a 15% increase in unique properties viewed.

Reduce costs

With many real estate sites featuring millions of images, duplicates create sizable storage and maintenance costs. These problems only grow over time and become bigger issues if not detected immediately. With our real-time monitoring in place, we’ve helped clients reduce their database size by over 20%.

How do we determine whether
a listing is a duplicate?


Unique digital fingerprint


All images are analyzed and given a digital fingerprint based on over 1,000 different features.


Report generation


After the index is created, reports can be generated at any time to identify potential duplicates. The similarity threshold can be adjusted.


Non-stop monitoring


Photos are continually analyzed and duplicate images are immediately flagged, reflecting any added, removed or modified images.


Unique fingerprint


All images are analyzed and given a digital fingerprint based on over 1,000 different features.

Unique fingerprint

All images are analyzed and given a digital fingerprint based on over 1,000 different features.

Report generation

After the index is created, reports can be generated at any time to identify potential duplicates. The similarity threshold can be adjusted.

Non-stop monitoring

Photos are continually analyzed and duplicate images are immediately flagged, reflecting any added, removed or modified images.

Effortless moderation. Clean listings. Engaged users.