Google can now recognize objects in videos using machine learning

This new “Video Intelligence API” was demoed onstage, and it offered the kind of “whoa” moment you expect from a Google keynote. By playing a short commercial, the API was able to identify the dachshund in the video, when it appeared in the video, and then understand that the whole thing was a commercial. In another demo, we saw a simple search for “beach” and was able to find videos which had scenes from beaches in them, complete with timestamps. That’s similar to how Google Photos lets you search for “sunset” and pull up your best late-day snapshots.