Soundify

Maker

Hi everyone! I made a simple (free) tool that lets you search a video *semantically* with machine learning. For example, try a natural language search query like "a person with sunglasses". ✨ You can try out the live web app at http://whichfra.me ✨ The querying is powered by OpenAI’s CLIP neural network for performing "zero-shot" image classification and the interface was built with Streamlit. Please share your interesting searches and let me know where I can improve. Thanks! :)

Report

4yr ago

Eugene Hauptmann

LLC Toolkit

@chuanenlin Wow, great job! Any plans for YouTube/Vimeo integration?

Report

4yr ago

David Chuan-En Lin

Soundify

Maker

@eugenehp Thanks, it currently supports YouTube integration (you can search a YouTube video instead of uploading a video yourself).

Report

4yr ago

Eugene Hauptmann

LLC Toolkit

Awesome!

Report

4yr ago

Harsh Gelda

This tool is legendary!!

Report

4yr ago

David Chuan-En Lin

Soundify

Maker

@harsh_gelda Thanks, did you come across any interesting searches?

Report

4yr ago

Harsh Gelda

@chuanenlin I live in India and most women in India wear this traditional clothing called "sarees" When I searched for this word "saree" in the video, i was amazed that it actually came up! I did try many other searches just to test out the tool. Works flawlessly! Great work :)

Report

4yr ago

David Chuan-En Lin

Soundify

Maker

@harsh_gelda Love the local example, thanks for sharing!

Report

4yr ago