London-based video architecture firm BAJT has created the volumetric content for DEX, the beautiful new sculptural video installation at the Mall of Scandinavia in Stockholm. BAJT was commissioned by Mediatec to showcase the full creative potential of the huge volumetric installation, which is 65 meters long and comprised of 3,800 LED strips, each with a maximum of 64 individually controlled pixels.
The Mall of Scandinavia is Scandinavia’s biggest shopping venue. It is located 5 kilometers from Stockholm’s city center. DEX is a permanent architectural installation, mounted in the ceiling, which runs 24/7.
To meet the DEX challenge Mediatec and BAJT assembled a toolkit featuring the d3 creative suite, the Notch realtime 3D engine and Autodesk 3ds Max 3D animation software. BAJT used these tools to generate, visualize, sequence and play back volumetric content in realtime. Content includes shimmering Northern Lights effects and three-dimensional wave patterns.
“The main brief from the client was to create a Northern Lights look, which would further enhance the Scandinavian feel of the mall,” says David Bajt who served as content creator and media engineer. “I also chose to create another look: 3D waves flowing through the volume and utilizing the rather magnificent scale of this installation.”
“The goal was to use fluid effects to create a memorable and eye-catching display,” adds Magnus Lewren, project engineer from Mediatec. “The content also needed to help set a relaxing and joyful mood for the shoppers.”
To accomplish this Lewren and Bajt generated and visualized the 3D content in Notch, baked the 3D content into the UV map in realtime, and sequenced and played back the content in d3 Technologies’ 2x2plus media server.
d3 was chosen for its ability to work with Notch to create realtime rendering of volumetric video. “d3 is still the only media server that lets the content creator work independently of the technical limitations of LED processors,” says Bajt. “In practice this meant that as the content creator I could work with any formatted unwrap of the 3D model, create 3D content baked into the texture and use d3 to output video to the LED processor completely independent of the of the 3D model’s unwrap. I could use d3’s feed view to chop up the unwrap and re-arrange the UV map output to 3,800 individual strips.”
He notes that, “separating the creative and technical workflows, even though they are interlinked, has always been d3’s strong suit. d3 also allows you to previs the volumetric content. And because it’s so tightly integrated with Notch, the visual programming was done entirely within d3. Not a single video file is played back: It’s all Notch realtime generative content, sequenced by a d3 Designer connected to a d3 2x2plus server placed in a control room at some distance from the actual hall.”
Lewren says d3’s feed tools made “very fast” work of mapping the 3,800 LED strips according to the LED processors. He explains that, “Being on site we could, with ease, alter parameters live in d3 and see the effect in realtime on the LED structure. This was a real timesaver when it came to content production. We could directly see what speeds and colors worked best. And we didn’t have to pre-render every frame out as video.
That saved us half the workflow when producing the video. d3 and Notch superseded that time consuming workflow by rendering everything in realtime.”
The process also enabled the client “to provide feedback on site during the whole production period,” Lewren says. “Changes could be very easily made right then and there with an instant effect on the LEDs.”
“The fact that we could sit down in the hall and tweak the Northern Lights parameters in realtime was just mind blowing,” says Bajt. “The alternative of working traditionally with pre-rendered content would have been extremely slow and painful and not very appealing to the client. The traditional route would have required hours of waiting with no guarantees that the results would be right in the end.”
d3 played a key role in the extensive previsualization required by the project. “We were able to create visualizations of the set up and different scenarios using d3 Designer,” says Lewren. “We also used d3 Designer to produce ‘Stage Movies’ so the client could get a good idea of the impact and feel of such a grand ceiling structure.”
d3 2x2plus has been “running solidly since the DEX installation was launched,” reports Bajt. “Both hardware and software have been remarkably stable,” adds Lewren. “I can’t recall a single issue with either d3’s software or hardware.”
Going forward, Lewren says, “the client would like the ability to alter colors and speeds of scenarios in DEX depending on different events and happenings in the Mall. This will be a cost-efficient solution using OSC and a handheld device. The client will have control over colors and speeds, within limitations easily set inside d3, using faders on a tablet.’
About d3
d3 is the world’s first fully integrated visual production system for video professionals, combining a real-time 3D stage visualizer, timeline, video playback engine and projection mapping tools into one product. d3’s unique integrated workflow assists the designer at all stages of the project, from pitch through development to final delivery. For more information visit www.d3technologies.com
Also visit www.bajt.com and www.mediatecgroup.com
