I led the technical end of a first-of-it’s-kind vTuber live gameshow hybrid alongside designers Strangeloop Studios, vTuber events agency ETC, and the top US vTuber creator Filian represented by Mythic Talent. Together, we aimed to build a show to occur alongside TwitchCon 2023 in Las Vegas that replicated the hit Japanese game show Brain Wall 脳カベ from decades prior.
Our goal was to design, build, and execute a live stream of having 6 vTubers motion captured live in a digital space as they jump through cutouts on moving physical walls and compete. Filian’s vision was to promote a raw variety show that would allow multiple vTubers to interact in one space, improv with the various XR tools provided, all the meanwhile performing the show live in secret to keep the assumed anonymity of each participating artist. We did so under strict covid health and safety protocols and accomplished a day-of execution with no prior talent rehearsal.
We streamed in real-time from Unity live @ 1080p60 to an eager audience on Twitch.
While the deadline was tight, we were able to integrate features such as:
A modular physical wall tracked on rails to sync with it’s digital counterpart
A handheld camera any performer could pick up
In-world interactive objects and avatar physics
Live vocal interaction with Neruosama (a popular AI vTuber)
Live concurrent motion capture in a single space beyond XSens’ 4-person limit
Adapting each vTuber’s avatar for full 3D live motion capture
Drive each performer’s mic to drive their own avatar’s face
Custom sponsor integrations
The show was a success, assuring Filian’s throne with her fanbase as one of the most popular and forward thinking creators to collaborate with in the world, eager to work with those who can push the boundaries of this space to new heights.
Client: Mythic Talent, Strangeloop Studios
Tools: Unity 2022, Movella MVN Animate Pro, MVN Link, OBS, Cinema 4D, VRM, NDI, Vive, Audinate Dante, NodeJS, lots of velcro