Created by Twitter-user Kyle Goodrich, the DreamGenerator is a compact handheld shooter that runs Secure Diffusion to remodel the pictures you’re taking. With as many as 30 themes to select from, you may immediate the digital camera to make your pictures retro, sci-fi, zombie, pirate-themed, and far more. The picture you’re taking is displayed on the DreamGenerator’s viewfinder show, and in a matter of seconds, is remodeled into one thing completely new, created by the Secure Diffusion program operating throughout the digital camera.
Designer: Kyle Goodrich
Introducing DreamGenerator! 📸✨
A digital camera that transforms your pictures into one thing new utilizing the facility of generative AI.
Select from 30 prompts, seize, and watch as your picture morphs right into a one-of-a-kind masterpiece proper earlier than your eyes! 🧵 pic.twitter.com/NJMxQ09Rna
— Kyle Goodrich (@_kylegoodrich) July 18, 2023
The DreamGenerator was constructed by Kyle Goodrich, a 3D artist and augmented-reality product designer at Snapchat. Seeing that the majority AI-gen instruments could be extraordinarily difficult on the floor, Goodrich determined to make a point-and-shoot-style digital camera with a straightforward UX to assist democratize the act of AI artwork technology. The digital camera appears to be like fairly easy on the surface (it jogs my memory of Spotify’s Automobile Factor), however hides some spectacular tech on the within. A easy digital camera module feeds pictures to the DreamGenerator’s Raspberry Pi laptop, which runs an occasion of Secure Diffusion and ControlNet to create AI artwork primarily based on mentioned picture. AI generative instruments often require an immense quantity of GPU and computing energy – properly past the capabilities of a Raspberry Pi, which leads one to imagine that the AI technology occurs over the cloud.
A easy interface enables you to click on a photograph after which toggle via a set of 30 totally different immediate themes. As soon as chosen, you may immediately remodel your picture primarily based on the immediate, creating AI artwork that’s closely impressed by the picture you simply clicked. All of the computing occurs in real-time, and is seen on the digital camera’s show. Totally different buttons additionally allow you to generate variations of the identical enter picture.
Though at present only a one-off prototype, it isn’t instantly clear if Goodrich plans on open-sourcing the DreamGenerator and even promoting the digital camera on-line. The tech is relatively spectacular, although, simplifying AI instruments in a method that basically permits anybody to mess around with them.
Nonetheless, this isn’t the primary time creators have labored on AI-powered cameras. We lately coated the Paragraphica, an AI digital camera that captures pictures with no digital camera lens. As a substitute of utilizing picture inputs, the Paragraphica would use Google Avenue View knowledge together with just a few different parameters to generate textual content prompts for the text-to-image AI mannequin.
