Had to include a Friends GIF to stay relevant with the times (and unless you're living under a rock, there's a reunion-show coming out soon).
But similar to the amount of time in life I've spent watching Friends, this tech-letter is going to be short and sweet.
Today's tech-tool isn't necessarily one you'll use in your day-to-day, unless you have very specific day-to-days, but it's a good one to bookmark for eventual use.
This is one I randomly stumbled upon and was 100% sure it was not going to work but I was 100% wrong.
Here's a quick scenario: Imagine you have a 30 minute recording of your friend walking on the beach, and at some point in these 30 minutes you see a very pretty kite at a distance. You later get home and figure you want to look at that kite again for whatever reason (maybe you're a fan of kites). You have 2 options: 1) go through all 30 minutes of footage trying to identify the exact second you saw the kite, or 2) realise that kites aren't all that, and move on.
That is, until you read today's tech-letter.
As the image above explains, Which Frame is an online tool that lets you upload videos (up to 20MB heavy), and searching for specific content, using words (~semantically).
So back to our example, you can now upload your friend-walking-on-a-beach video, and instead of hunting for the kite manually, simply tell this tech-tool what you're looking for. Which Frame will go through the entire video searching for your exact keyword, and provide screenshots of the frames (and timestamp) where your keyword appeared.
To test this out, I uploaded a random YouTube video, and looked for 'shoes'. Here are my results:
The video is almost 2 minutes long, and Which Frame identified 5 frames for me with exactly what I was looking for.
If you're curious how this works, OpenAI is an AI research company that introduced a neural network (computing software that simulates the way our brains process and analyse information) called CLIP, which can identify visual concepts. This is what Which Frame uses to make this tool be good at what it does.
You're not only able to search through video frames using text, but also images. So if I uploaded a random picture of shoes, Which Frame would match that with the closest thing on the video (which, in this case, provides the same frames of the man's shoes).
Told you, short and sweet. Which Frame is a website that lets you upload short videos and search through them semantically, identifying exact frames featuring content you're specifically looking for. You can search through video using text or even by uploading images. It's free, and sure seems very convenient.