aba events

    Do You See What I See? A New Visual Search Tool from Google

    Here are two truths:
    1.Some people are always looking for easier ways to do hard things.
    2.Technology can be amazing.

    There are a lot of people anxiously waiting for WeBIRD, the promised birdsong equivalent to Shazam and MusicID, but they may have to wait a little bit longer. Music databases can make a match to a digitally produced song, but they can’t match you singing exactly the same song. The variations in the human voice make that kind of analysis a less than exact science. A person can recognize that you are singing Happy Birthday; Shazam can’t. Similarly, there is enough variation in birdsong that it’s very difficult to get a computer to recognize the nuances. You can teach one to recognize some of the songs some of the time, but a reliable tool is not available yet.

    But can we use technology to recognize visual cues and help us to ID birds? New birders are being encouraged by some to post their birding photos to the Internet in order to get an ID, instead of using field guides or birding mentors. Crowd-sourcing identification is certainly one way to handle it, but it would  be much “cleaner” if we could somehow get the computer to do the work for us, wouldn’t it? Enter Google Search by Image. Seriously! You can upload an image or provide a URL to images.google.com, and Google will search for similar images. How cool is that! Just click on the little camera at the right of the search field and follow the instructions.

    Google search bar

    When I learned of this, I knew an experiment was in order! I uploaded a picture of a Hermit Thrush, clicked “Search” and waited to see how Google would handle the difficult Catharus species challenge. My uploaded image shows at the top of the screenshot below:

    Hermit thrush image

    Can you say “Epic Fail”? None of these pictures is even close, except for the background colour tones. None were even of birds, let alone thrushes. I guess I should have expected that. Maybe it was much too challenging. How about something simpler, like a Barred Owl? The Internet is crawling with owl pictures. This should be easy!

    Barred owl image
    Sigh… Not even a little bit better. More diversity in the selection of “matches”, but still no birds and certainly no owls. Maybe the whole bird has to be visible. Here’s a Burrowing Owl, Google. What can you do with this?

    Burrowing Owl image
    Um, no. But it’s interesting to see how many celebrities resemble Burrowing Owls. Brangelina? The algorithm seemed to be focussing on color-matching. What about a bird with a distinctive color and shape? Easy–Great Blue Heron!

    Great Blue Heron image

    Eureka! It matched one! Admittedly it’s the fifth image the program chose, and it somehow thought that a better match for my heron was a staged suicide scene ( in the top row), but at least it got a bird, and the right bird at that!

    I was prepared to completely dismiss this function as useless, but then an interesting thing happened. A birder from Ontario sent me a picture he took while visiting Vancouver to see the Red-flanked Bluetail. It was a great photo of a bird that he (and those I showed it to) identified as a Veery, an almost unimaginable bird to be in Vancouver this time of year. But with a Brambling and a Bluetail around, never say never, right?

    People send me pictures all the time, but there was something about this report that made me suspicious. Spidey-sense, some people call it. I asked for more information, which did not come. I did a little online detective work and didn’t find anything reassuring. So I posted the report–along with my reservations–on the Vancouver birding bulletin boards, mindful of those who think that all rare birds should be reported and not wanting anyone to miss out on this potential rarity. Then I remembered the Google Search by Image tool. I uploaded my suspect image–another Catharus–and guess what? Here are the results:

    Veery image

    Epic win! The person reporting this bird was a prankster (very funny-not!), my spidey-sense was on the mark, and within seconds, Google found the image in an almost-two-year-old blog post from Massachusetts. I don’t know what motivated the hoax, but I’m delighted that the perpetrator was found out before an onslaught of inevitably frustrated birders wasted their time.

    For bird ID, Google Search by Image has a very long way to go. There are some things that humans can still do better than our current technology. But today, I, and all my lookalikes below,  are giving a big alula up to Google!Ann image

    The following two tabs change content below.
    Ann Nightingale

    Ann Nightingale

    Ann Nightingale (and yes, that is her real name) is an avid birder and amateur naturalist. A relative late-comer to birding, Ann took up the binoculars and scope in the mid 1990’s and has been making up for lost time since. Ann serves on the board of Rocky Point Bird Observatory, a migration monitoring station on the southern tip of Vancouver Island (the place with the Skylarks!) She first volunteered at RPBO in 1997 and over the years has become a licensed passerine, hummingbird and owl bander. Also active with the Victoria Natural History Society, Ann leads local birding field trips and coordinates the Christmas Bird Count for the Victoria circle. Recently she has added coordination of southern Vancouver Island and the Gulf Islands for the British Columbia Breeding Bird Atlas to her “administrative birding” activities.
    Ann Nightingale

    Latest posts by Ann Nightingale (see all)

    • http://baypoll.blogspot.com Corey Husic

      I’m not sure of the details, but the Cornell Lab of Ornithology is apparently “teaming up with computer vision researchers at UC-San Diego, UC-Berkeley and Caltech to tackle the challenge of using computers to identify birds in images.”


    Birders know well that the healthiest, most dynamic choruses contain many different voices. The birding community encompasses a wide variety of interests, talents, and convictions. All are welcome.
    If you like birding, we want to hear from you.
    Read More »

    Recent Comments




    via email

    Enter your email address to subscribe to this blog and receive notifications of new posts by email.

    • Open Mic: Searching for Snowy Owls in Ohio March 25, 2015 5:22
      At the beginning of this year, I remembered missing the chance to spot a Snowy Owl when the bird stormed across the United States the previous winter, so I was determined to see one of these birds this winter. […]
    • Mothing: The Nighttime Addiction March 18, 2015 5:49
      Note: Although this may not seem to be a relevant post on The Eyrie, I thought it would be a good idea to share the obsession that sparked my passion for the natural world as a whole. I hope this post will inform and excite you about moths; perhaps even making them an obsession of […]
    • Book Review: Ten Thousand Birds March 10, 2015 5:36
      Ten Thousand Birds: Ornithology Since Darwin, by Tim Birkhead, Jo Wimpenny, and Bob Montgomerie Princeton University Press, 2014 544 pages, $45.00 hardcover ABA Sales / Buteo Books How did today’s birds come to be? How has the history of ornithology evolved since Darwin’s time. These questions, and many more, are answered comprehensively in the […]

    Follow ABA on Twitter