Hi guys,
Here is a simple web application for generating immersive sound effects based on visuals!
In a nutshell, the system first tries to capture a detailed understanding of the visual scene. Then, the system asks a language model (like ChatGPT) to brainstorm plausible sound descriptions. Finally, the system generates the audio files from sound descriptions.
If interested, feel free to read our short research paper: https://arxiv.org/pdf/2311.05609.... In addition, this work was built on top of a previous full research paper: https://arxiv.org/pdf/2112.09726....
Thanks and enjoy!
will it work for creation short sounds for a video games development process? I mean, for example, sound of jumps, steps, punches, and other... By the way, it would be interesting, for example, to voice comics. Anyway, good luck guys!
Congratulations Team Soundify on your innovative launch on ProductHunt! Love the idea of generating immersive sounds from visuals - It breathes life into still images. As a suggestion, you might consider integrating a feature for users to mix and match sounds for creating their unique audio immersion. Looking forward to seeing how Soundify develops. All the best!
Congratulations on the launch of Soundify! The ability to generate immersive sounds from an image is a creative and exciting concept that opens up a new realm of possibilities for artists, designers, gamers, and content creators.
Soundify is an innovative and cutting-edge platform that harnesses the power of artificial intelligence to seamlessly generate captivating sounds tailored for visuals. With Soundify, the process of enhancing visual content with immersive and harmonious audio experiences becomes effortless and efficient.
This revolutionary tool employs advanced AI algorithms to analyze and interpret visual elements, translating them into a rich auditory landscape. Whether you're a content creator, filmmaker, animator, or designer, Soundify allows you to elevate your projects by automatically generating soundscapes that perfectly complement the mood and atmosphere of your visuals.
I tried it out, and although the voice recognition of the cartoon images I uploaded wasn't particularly accurate, I can't deny that it's a really neat and useful tool! I really like it! Congratulations on the launch!
Great work @chuanenlin on your product launch for Soundify! What an exciting way to generate sounds for visuals using AI. I'm sure this product will help many creatives explore and discover ideas with sound.
@chuanenlin
This is so cool! 🔊 Turning visuals into sound effects sounds like magic. 🪄 How does the system handle different types of visuals? Can it capture both simple scenes and more complex, dynamic ones? Excited to explore the auditory side of images! 🎨🎶
Replies
Soundify
AIWatchfulCompanion
GhostCut
Crustdata
Amabay.ai
ProGPTs
WeirdSpot.fyi by humit