Bing Visual Search is a new feature of Bing's Image Search tool that allows you to select objects in images to run searches for them.
The new feature, which is live already on Bing, provides you with options to run searches for objects or people that are displayed in images that are returned by Bing's Image Search tool.
The process itself works similarly to how you would capture a rectangular screenshot on the screen. You draw a rectangle around the object, Bing identifies it, and returns results that match it.
Lets take a closer look at how this all works.
First thing you do is head over to Bing, and run a search using the search engine's image search tool.
Select one of the results that you are interested in. You will notice the new "search within this image" icon that Bing Images displayed in the top left corner of the image. When you click on it, the Visual Search tool is loaded so that you can select an object or person on the screen to run that search on Bing.
The Visual Search tool on Bing displays a selection rectangle on the screen which you can move around, and change in size. This works via dragging and dropping. You may also draw a new rectangle on the screen instead; the old is removed when you do so.
Bing returns information whenever you move the rectangle, or change its size. It is not necessarily the case that the "related images" change when you do, but they may depending on your selection.
The Visual Search tool displays only related images, which means that you cannot use it for other things. An option to identify elements on a picture would certainly be useful as well.
All you get right now however is a list of image that Bing believes are related to the selected area of the source image.
The identification works surprisingly well for some queries. While you should not expect 100% percent matches, especially when multiple images are returned, it works better than reverse image search engines.
Microsoft notes that this works really well for shopping related searches. Mark a chandelier in your dream home, and get chandeliers that look like it (or similar), in the results. All you have to do then is follow the links to find out how much it costs, and where you can buy it.
Microsoft reveals how this new Visual Search tool processes the queries:
Bing Visual Search is a promising feature that worked really well during tests. Your mileage may vary depending on what you search for and highlight in the images though. If you run some searches, let me know how that turned out for you.
I wish Microsoft would improve the basic feature in the future to return text results as well.
Now You: What's your take on Bing Visual Search?
Advertising revenue is falling fast across the Internet, and independently-run sites like Ghacks are hit hardest by it. The advertising model in its current form is coming to an end, and we have to find other ways to continue operating this site.
We are committed to keeping our content free and independent, which means no paywalls, no sponsored posts, no annoying ad formats (video ads) or subscription fees.
If you like our content, and would like to help, please consider making a contribution:
Ghacks is a technology news blog that was founded in 2005 by Martin Brinkmann. It has since then become one of the most popular tech news sites on the Internet with five authors and regular contributions from freelance writers.