Technology

This AI distorts live video in real time

Introduction to Dean Leitersdorf He himself was on Zoom and then typed a prompt that made me feel like I had just taken a psychedelic mushroom: “Wild West, Universe, Roman Empire, Golden, Underwater.” He fed the words into an AI model developed by his startup VATART, which manipulated live videos in real time.

“I don’t know what will happen,” Lightsdorf smiled.

Leitersdorf looked a little crazy-long hair rolling downwards, fingers performing with acrobatics. As we talk, his screen image oscillates in a surreal way as the model tries to predict the appearance of each new frame. Leitersdorf puts his hands on his face and transforms with more feminine traits. His pens jump between different colors and shapes. He added more tips that took us to a new realm of psychedelics.

PECART’s video to video model Mirage is both an impressive feat of engineering and a sign that AI may soon change the live streaming industry. Tools such as Openai’s Sora can evoke increasingly realistic videos with text prompts. Mirage can now manipulate videos in real time.

On Thursday, vatar launched a website and app that will allow users to create their own videos and modify YouTube clips. The site offers several default themes including “Anime”, “Dubai Skyline”, “Cyberpunk” and “Versailles”. In our interview, Leitersdorf uploaded a person who played Fortnite The scene changes from the familiar Grand Royal World to the version set underwater.

Patart’s technology has huge gaming potential. In November 2024, the company demonstrated a game called oasis Use similar phantom methods to generate playable Minecraft– Just like the world. The user can move near the texture and zoom in again to create a new playable scene inside the game.

Real-time manipulation of live scenarios is even more cost-effective. Decart wrote low-level code to extrude high-speed computing from NVIDIA chips to achieve this feat. Mirage produces 20 frames per second at 768×432 resolution with a delay of 100 milliseconds per frame, enough to obtain quality-quality Tiktok clips.

Related Articles

Leave a Reply

Your email address will not be published. Required fields are marked *

Back to top button