Real-Time Live!

Real-Time Live! celebrates the top original, jury-reviewed interactive projects of the year. Enjoy the excitement of a live event where you’ll get an electrifying sample of what’s new in real-time.

Below is a listing of the work presented at the SIGGRAPH 2020 Real-Time Live!. To explore the content in detail, please review the program’s listing on the ACM Digital Library.

View Content Details

Real-Time Live! is an exciting evening showcasing the hottest new, real-time project demos of the year. Whether you are showing off the latest game technology or your real-time scientific visualization; revealing some amazing new motion capture technology or your augmented reality app; or demonstrating a military simulation or your latest research results, Real-Time Live! is the place to put your best six minutes forward and vie for your chance to be named the best new real-time demo of 2020!

Real-Time Live! is open to all types of technology demos, as long as they are real-time, exciting, and most of all, live!

Marc Olano University of Maryland, Baltimore County


Expand All | Collapse All
4pm-6pm
AI-Synthesized Avatars: From Real-Time Deepfakes to Photoreal AI Virtual Assistant
SessionReal-Time Live!
Contributors
Zejian Wang
Koki Nagano
Hao Li
Liwen Hu
Lain Goldwhite
Hanwei Kung
Aviral Agarwal
Lingyu Wei
Yenchun Chen
Qingguo Xu
Jaewoo Seo
Huiwen Luo
Event Type
Real-Time Live!
Interest Areas
Gaming & Interactive
New Technologies
TimeTuesday, 25 August 20204pm - 6pm PST
Location
DescriptionWe introduce a real-time deep learning-based facial synthesis technology for photoreal AI-avatars, and demonstrate two novel applications. We showcase the first zero-shot real-time deepfake system allowing anyone to swap their faces with another subject. Then, we demonstrate how this technology can enable an AI-based photoreal virtual assistant.
Contributors
Zejian Wang
Pinscreen
Koki Nagano
Pinscreen
Hao Li
Pinscreen
Liwen Hu
Pinscreen
Lain Goldwhite
Pinscreen
Hanwei Kung
Pinscreen
Aviral Agarwal
Pinscreen
Lingyu Wei
Pinscreen
Yenchun Chen
Pinscreen
Qingguo Xu
Pinscreen
Jaewoo Seo
Pinscreen
Huiwen Luo
Pinscreen
Chroma Tools: AI-enhanced Storytelling for Motor Racing Sports
SessionReal-Time Live!
Contributors
JesĂşs Hormigo
David Daniel AlbarracĂ­n Molina
Francisco Javier Vargas GarcĂ­a-Donas
Jacinto Sevilla Esteban
José Manuel Castro Ríos
José Miguel García Navarrete
Event Type
Real-Time Live!
Interest Areas
Gaming & Interactive
New Technologies
TimeTuesday, 25 August 20204pm - 6pm PST
Location
DescriptionTypically, TV producers of motor-racing programs manually overlay visuals to provide on-screen context, such as a driver’s name, position, or photo. Chroma Tools, deployed on live Formula E broadcast, automates these tasks and enables dynamic overlays that track the racers as they appear on the screen in strict real time.
Contributors
JesĂşs Hormigo
Virtually Live
David Daniel AlbarracĂ­n Molina
Virtually Live
Francisco Javier Vargas GarcĂ­a-Donas
Virtually Live
Jacinto Sevilla Esteban
Virtually Live
José Manuel Castro Ríos
Virtually Live
José Miguel García Navarrete
Virtually Live
DrawmaticAR - Automagical AR Content From Written Words!
SessionReal-Time Live!
Contributor
Yosun Chang
Event Type
Real-Time Live!
Interest Areas
Gaming & Interactive
New Technologies
TimeTuesday, 25 August 20204pm - 6pm PST
Location
DescriptionDrawmaticAR is an AI-AR app capable of creating interactive 3D animated experiences from story words written in the designated section on an AR marker (Magic Paper).
Contributor
Yosun Chang
AReality3D
Permute.xyz
Introduction to Real Time User Interaction in Virtual Reality Powered by Brain Computer Interface Technology
SessionReal-Time Live!
Contributors
Anna Jo
Brian Yongwook Chae
Event Type
Real-Time Live!
Interest Areas
Gaming & Interactive
New Technologies
TimeTuesday, 25 August 20204pm - 6pm PST
Location
DescriptionHow can VR/AR platforms personalize the user experience? I discuss how Looxid Link, the most VR-compatible, brain-sensing technology, can connect users' minds to VR by visualizing, interacting with, and analyzing the users' minds in VR by demonstrating real-time examples using users' EEG feature and mind indexes.
Contributors
Anna Jo
Looxid Labs
Brian Yongwook Chae
Looxid Labs
Interactive Style Transfer to Live Video Streams
SessionReal-Time Live!
Contributors
Ondřej Texler
David Futschik
Michal KuÄŤera
Ondřej Jamriška
Šárka Sochorová
Menglei Chai
Sergey Tulyakov
Daniel Sýkora
Event Type
Real-Time Live!
Interest Areas
Gaming & Interactive
New Technologies
TimeTuesday, 25 August 20204pm - 6pm PST
Location
DescriptionOur tool allows artists to create living paintings or stylize a live video stream using their own artwork with minimal effort. While an artist is painting the image, our framework learns their artistic style on the fly and transfers it to the provided live video stream in real time.
Contributors
Ondřej Texler
CTU in Prague, FEE
David Futschik
CTU in Prague, FEE
Michal KuÄŤera
CTU in Prague, FEE
Ondřej Jamriška
CTU in Prague, FEE
Šárka Sochorová
CTU in Prague, FEE
Menglei Chai
Snap Inc.
Sergey Tulyakov
Snap Inc.
Daniel Sýkora
CTU in Prague, FEE
Limitless Dynamic Landscapes of 1 mm per Pixel Density, Zooming Included
SessionReal-Time Live!
Contributors
Michael Lubimov
Davyd Vidiger
Denis Shergin
Event Type
Real-Time Live!
Interest Areas
Gaming & Interactive
New Technologies
TimeTuesday, 25 August 20204pm - 6pm PST
Location
DescriptionThe new ObjectLandscapeTerrain system in UNIGINE Engine fulfills a very challenging combination of requirements: very dense details (down to 1 mm per pixel) together with huge terrain size (up to 10,000 x 10,000 km), real-time terrain geometry modification, non-destructive team collaboration, and binoculars/scope support (up to x20 zoom).
Contributors
Michael Lubimov
UNIGINE HOLDING S.Ă .r.l
Davyd Vidiger
UNIGINE HOLDING S.Ă .r.l
Denis Shergin
UNIGINE HOLDING S.Ă .r.l
Sketch-to-Art: Synthesizing Stylized Art Images From Hand-drawn Sketches With No Semantic Labeling
SessionReal-Time Live!
Contributors
Ahmed Elgammal
Bingchen Liu
Kunpeng Song
Event Type
Real-Time Live!
Interest Areas
Gaming & Interactive
New Technologies
TimeTuesday, 25 August 20204pm - 6pm PST
Location
DescriptionSketch-to-Art is an AI tool that allows creatives to sketch an idea and get fully rendered images, stylized the way they want in real time. Users can define a style by either choosing a reference image, or a group of images, and selecting an artist, or an art movement.
Contributors
Ahmed Elgammal
Artrendex Inc
Rutgers University
Bingchen Liu
Artrendex Inc
Kunpeng Song
Artrendex Inc
The Technology Behind Millennium Falcon: Smugglers Run
SessionReal-Time Live!
Contributors
Eric Smolikowski
Steve Nash
Event Type
Real-Time Live!
Interest Areas
Gaming & Interactive
New Technologies
TimeTuesday, 25 August 20204pm - 6pm PST
Location
DescriptionDemonstrate the technological innovations behind the delivery of Millennium Falcon: Smugglers Run interactive attraction. This will show and explain the pieces of technology we had to write to achieve our goals of high fidelity, high resolution and high frame rate for the experience.
Contributors
Eric Smolikowski
Walt Disney Imagineering
Steve Nash
Nvidia
Volumetric Human Teleportation
SessionReal-Time Live!
Contributors
Ruilong Li
Kyle Olszewski
Yuliang Xiu
Shunsuke Saito
Zeng Huang
Hao Li
Event Type
Real-Time Live!
Interest Areas
Gaming & Interactive
New Technologies
TimeTuesday, 25 August 20204pm - 6pm PST
Location
DescriptionExisting volumetric capture systems require many cameras and lengthy post processing. We introduce the first system that can capture a completely clothed human body (including the back) using a single RGB webcam and in real time. Our deep-learning-based approach enables new possibilities for low-cost and consumer-accessible immersive teleportation.
Contributors
Ruilong Li
University of Southern California
Kyle Olszewski
University of Southern California
Yuliang Xiu
University of Southern California
Shunsuke Saito
University of Southern California
Zeng Huang
University of Southern California
Hao Li
University of Southern California
Pinscreen