by 
What are lightfields and why are they important? This is a question we’ve asked over the past month to lightfield thought leaders, and got to do so again last week by interviewing Lytro at the VR/AR Association SF Chapter Event (video below).
The practice of lightfields is split between capture (cameras and lens arrays) and display (Holographic panels and VR headsets). Lytro is the industry leader in capture, with a range consumer to professional/cinematic cameras. It’s latest work is Hallelujia produced with Within.
In fact, our discussion with Lytro came one week before Hallelujia’s public release. You can see that here, making this week’s Friday video a double feature. The full Hallelujia production involves 6DOF positional tracking, but this more portable version offers 3DOF head tracking.
As for our discussion with Lytro, the company’s insights on lightfield capture have been formed over a long tenure in the field. Starting with refocusing cameras, it evolved into cinematic rigs, and on to today’s flagship Immerge camera, which was used in the Hallelujia production.
One thing evident from the discussion is the degree that lightfield capture blends optical and digital technologies, as we discussed recently with Ryan Damm (below). Challenges on the digital side will recede as Moore’s Law improves processing and compression of lightfield data.
But Moore’s Law doesn’t govern optical technologies. Notice how camera lenses haven’t gotten much smaller while chip-based consumer tech like smartphones and laptops have. Optical equipment is generally the size it needs to be to do its job (a bottleneck in smartphone design).
So while the digital barriers of lightfield capture will lower with Moore’s law, some of the camera rigs and lens arrays required to capture lightfields will remain large (not a bad thing). For example, the degree of parallax you can achieve from a lens array is a function of its diameter.
Lightfields will also coexist with polygon (graphics) approaches in AR & VR. The latter is prevalent today in volumetric VR, and will continue to be advantageous for interactivity (games, training etc.). But lightfields will excel for playback of photorealistic or cinematic content.
“We absolutely see them coexisting,” said Lytro Senior Architect Colvin Pitts. “It’s a little bit tricky to manipulate lightfield data in real time, but combining the two is absolutely on the table.”
See the full interview below with Pitts and Lytro Director of Engineering for VR, Alex Song. And stay tuned for more coverage of this key segment of immersive computing.
For a deeper dive on AR & VR insights, see ARtillry’s new intelligence subscription, and sign up for the free ARtillry Weekly newsletter.
Disclosure: ARtillry has no financial stake in the companies mentioned in this post, nor received payment for its production. Disclosure and ethics policy can be seen here.