{"id":2600,"date":"2025-07-18T08:02:09","date_gmt":"2025-07-18T08:02:09","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/2600\/"},"modified":"2025-07-18T08:02:09","modified_gmt":"2025-07-18T08:02:09","slug":"this-ai-warps-live-video-in-real-time","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/2600\/","title":{"rendered":"This AI Warps Live Video in Real Time"},"content":{"rendered":"

Dean Leitersdorf introduces himself over Zoom, then types a prompt that makes me feel like I\u2019ve just taken psychedelic mushrooms: \u201cwild west, cosmic, Roman Empire, golden, underwater.\u201d He feeds the words into an artificial intelligence<\/a> model developed by his startup, Decart, which manipulates live video in real time.<\/p>\n

\u201cI have no idea what\u2019s going to happen,” Leitersdorf says with a laugh, shortly before transforming into a bizarre, gold-tinged, subaquatic version of Julius Caesar in a poncho.<\/p>\n

Leitersdorf already looks a bit wild\u2014long hair tumbling down his back, a pen doing acrobatics in his fingers. As we talk, his onscreen image oscillates in surreal ways as the model tries to predict what each new frame should look like. Leitersdorf puts his hands over his face and is transformed with more feminine features. His pen jumps between different colors and shapes. He adds more prompts that take us to new psychedelic realms.<\/p>\n

Decart\u2019s video-to-video model, Mirage<\/a>, is both an impressive feat of engineering and a sign of how AI might soon shake up the livestreaming industry. Tools like OpenAI\u2019s Sora<\/a> can conjure increasingly realistic video footage with a text prompt. Mirage now makes it possible to manipulate video in real time.<\/p>\n

On Thursday, Decart is launching a website<\/a> and app that will allow users to create their own videos and modify YouTube clips. The website offers several default themes including \u201canime,\u201d \u201cDubai skyline,\u201d \u201ccyberpunk,\u201d and “Versailles Palace.\u201d During our interview, Leitersdorf uploads a clip of someone playing Fortnite and the scene transforms from the familiar Battle Royale world into a version set underwater.<\/p>\n

Decart\u2019s technology has big potential for gaming. In November 2024, the company demoed a game called Oasis<\/a> that used a similar approach to Mirage to generate a playable Minecraft-like world on the fly. Users could move close to a texture and then zoom out again to produce new playable scenes inside the game.<\/p>\n

Manipulating live scenes in real time is even more computationally taxing. Decart wrote low-level code to squeeze high-speed calculations out of Nvidia chips to achieve the feat. Mirage generates 20 frames per second at 768 \u00d7 432 resolution and a latency of 100 milliseconds per frame\u2014good enough for a decent-quality TikTok clip.<\/p>\n","protected":false},"excerpt":{"rendered":"Dean Leitersdorf introduces himself over Zoom, then types a prompt that makes me feel like I\u2019ve just taken…\n","protected":false},"author":2,"featured_media":2601,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,3974,254,255,64,63,2565,105,446,3975,3973],"class_list":{"0":"post-2600","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-algorithms","10":"tag-artificial-intelligence","11":"tag-artificialintelligence","12":"tag-au","13":"tag-australia","14":"tag-machine-learning","15":"tag-technology","16":"tag-video","17":"tag-video-games","18":"tag-youtube"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/2600","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=2600"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/2600\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/2601"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=2600"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=2600"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=2600"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}