LIBRARY: Tutorials Reviews Interviews Editorials Features Business Authors RSS Feed

The Evolution of Immersive Media

COW Library : : Katie Hinsen : The Evolution of Immersive Media
CreativeCOW presents The Evolution of Immersive Media --  Editorial


Auckland, New Zealand
CreativeCOW.net. All rights reserved.


Immersive media is not new. Emerging technologies, such as VR and AR as we currently know them, are simply part of an evolutionary path making media more immersive.

Many commentators and industry professionals became cynical after the short life-cycle of Stereoscopic 3D, and are hesitant to embrace VR, calling it “another fad”. I see it differently, these technologies are simply steps within a much wider ecosystem, leading us towards what immersive media is to become.





From the Alphabet to the Goddess
One of my favorite books of all time is The Alphabet Versus the Goddess, by Physicist and Anthropologist, Leonard Schlain. It explores the links and impacts of literacy in opposition to iconography to cultures across history. Anthropology and early written/spoken communication is also the point where the journey of narrative storytelling towards immersiveness begins.

People are always looking for ways to draw the audience in deeper, whatever the media. Use of technology is one way in which storytellers have worked towards this goal. It’s not just about telling better stories, because the development of our cultural tools has not brought us better artists. It has brought us ways to better enhance the experience of consuming a narrative, allowing stories to be told in more immersive ways.

Early cultures enhanced the immersiveness of storytelling by adding moving images and other visual elements such as dance, performance, puppetry and illustrations (not to be confused with iconographic written language). From this came the media of Theater.


Taking the Script to the Screen
Well-documented early reactions to people seeing motion picture films, casts no doubt on the unprecedented jump in immersiveness for audiences, between theater and movies. From the early days of low frame-rate, black and white motion pictures, a minute-or-so in length, it was clear that people wanted to harness technology to take themselves deeper into new worlds and experiences. We added sound, smoother motion, and color. We began using special effects.


Beyond the Screen (Take 1)
The first 3D movies were an attempt to break the wall of the screen itself, merging the real and the narrative worlds. While movies took narrative to places theater couldn’t, it couldn’t bring those places into the same physical space as the viewer. Experiments in 3D, and early “4-D” experiences, blending the Film and the Ride forms of entertainment, attempted to take steps beyond a passive consumer model of media consumption.


Having Another Go At 3D: Beyond the Screen (Take 2)
The second generation of stereoscopic 3D used the accuracy provided by newer technology, to give audiences an immersive experience without the distraction of having to resolve primitive dual-strip and anaglyph projection methods. Adding to this, was digital surround audio and CG visual effects. Audiences had problems with this new-wave of 3D movies, they were underwhelmed and demanded something more radically improved than what they were getting. Autostereoscopy went into development, but the technology wasn’t mature enough when it first hit market, and again, audiences were unimpressed.


VR and AR
To be clear, these are not the same thing. They are simply lumped together in our lexicon because we have a collective emerging technology overload, and can’t bring ourselves to separate two media that we talk about in similar terms.

Virtual Reality is a world that we enter, through a headset and headphones. It is not part of our world. We have 360 degree 3D audio visuals, and can explore narratives through our physical movement. Augmented Reality is when the narrative enters our own world through graphics, holograms or other virtual media.

While VR is a natural extension of Stereoscopic 3D, AR is beginning to break down some of the barriers to its mainstream adoption. Audiences still don’t like having to wear large headsets or glasses, and VR in its current form is especially restrictive to people with visual impairments. VR is not easily shared with others, and humans tend to respond best when they can have experiences that are social.

Augmented reality, as proven by basic applications such as Pokemon Go and Snapchat, feeds the need of consumers to be social. That’s why I see tech like Microsoft Hololens having more commercial success than the VR headsets currently on the market.





That said, the other thing positively driving VR/AR is accessibility. 360 is thriving because it’s accessible (you only need an iPhone for the most basic 360 photos) and social (it was native to Facebook from very early on in its lifecycle).


Out of The Screen and Into Your Head
My colleague Boon Shin Ng has a pretty good theory of “what’s next” in the evolution of immersive media. I am convinced she’s right, and I have coopted it as an extension of my own theory. Using data to personalize content to the viewer is powerful, and as more data is being collected, the more useful it’s becoming. So beyond the screen, the only barrier left to narratives being truly immersive, is an ability to get directly in to the audience’s heads.

The amount of data collected on every individual is already so vast, that “the cloud” may in fact know us better than we know ourselves.

What’s even more compelling about this notion, is that the content we put online is our aspirational lives, not our real lives. To storytellers and advertisers, this is stronger than the truth. The personalized content delivered to you, through the media technology of the future, will be what you want to see, when and how you want to see it.

Currently we are exploring how to best tell non-linear narratives in VR/AR worlds. By using data about the consumer, rather than attempting to lead her through your narrative, you can preemptively know what her behaviors are likely to be, and adapt the content. While the story arc might remain consistent, the characters might change, or the dominant themes. Using this data can also help individual stories converge- my partner and I are very different, but Netflix knows what to recommend we watch on a Monday night.

What could be more immersive than media that feels like it’s gotten into your head?


Evolution of Species
If we look at each technology as a point in the evolution of an entire “species” (which is “immersive media”), we can better understand and appreciate the value of every product, regardless of its Darwinian life-cycle. Failures (like Autostereoscopic 3D) are as necessary as great, disruptive successes (like motion picture film), because they are variances which lead us in the right direction toward the thing we all seek from entertainment: a compelling enough experience through sensory immersion, that we might “escape” into the narrative of a great story.







Katie Hinsen
Katie Hinsen is an international award-winning Finishing Artist with credits on over 80 major productions. Over a 20-year career she has worked as an engineer, editor, VFX artist, Stereoscopic 3D artist, colorist and finishing artist; on commercials, documentaries, television, music videos, short and feature films. She currently serves as the Head of Operations at Auckland's Department of Post.

Katie has throughout her career been involved in both production and R&D of new digital acquisition and distribution formats including Stereoscopic/ Autostereoscopic 3D, RED, HFR, HDR, 4K+ and DCP. She is considered both a world expert in a number of technologies including High Dynamic Range and High Resolution 4K-8K workflows, and celebrated as a major Thought Leader in the post production industry, writing, advising and speaking at industry conferences.

Outside of the office she is a passionate advocate for emerging talent, speaking at industry events, providing mentorship, and serving a number of industry-based non-profit organizations including Gaia Community Initiatives and the One Voice project in New Zealand, and the Blue Collar Post Collective and Society of Motion Picture & Television Engineers (SMPTE) in the United States. In addition to her technical expertise, Hinsen is an expert in the issues of talent development, diversity and mentorship.

We at the COW thank Katie for allowing us to share this story, originally posted at KatieHinsen.com.

Katie Hinsen on Twitter
Katie Hinsen on IMDb
Blue Collar Post Collective



Related Articles / Tutorials:
An Open Letter to Incoming Women Freshmen in Media Programs, by Kylee Peña

An Open Letter to Incoming Women Freshmen in Media Programs, by Kylee Peña

A lot of so-called “open letters” on the internet address the outgoing graduates of programs. And while they should bask in the glow of congratulations and good luck because they worked hard, they earned it, and they have some serious challenges on the horizon, this letter isn’t for them. It’s for you: the young woman who is leaving high school behind and beginning your first year of college in the next few weeks. Read on as Hollywood workflow supervisor and president of the Blue Collar Post Collective Kylee Peña reminds you: You have so much ahead of you!


Creative COW
My Illegal Internships: An Oral History, by Kylee Peña

My Illegal Internships: An Oral History, by Kylee Peña

Sure, unpaid internships aren’t exclusive to post production; however, for some reason we’ve collectively decided that the single biggest way to prove one’s merit is by working in some capacity for free. It’s almost as if everyone believes that because they suffered the difficulty of doing often humiliating or degrading work for free, everyone else should too. There are certainly times that personal enrichment worth the sacrifice to work for free, but employers, do you know if what you're asking interns to do for you is even legal? Follow along as Kylee gives examples from her own past internships to highlight current requirements, and lays out some suggestions to a fairer, more productive future for everyone.


Kylee Peña
An Editor's Epic Journey, by Katie Toomey

An Editor's Epic Journey, by Katie Toomey

What do you do when your company folds and there's no local work? Whatever you have to. For Katie Toomey, that meant emptying her savings and heading 2000 miles west to Los Angeles, with no job in hand. The only options were make it or break it. The journey itself was difficult, but the hardest part may have been the only thing that made it all possible: asking for help. This is a truly inspiring story with tons of real-world examples of how to accomplish what feels impossible at the time.


Katie Toomey
The Cinematography of Get Out: Toby Oliver, ASC

The Cinematography of Get Out: Toby Oliver, ASC

Toby Oliver, ASC is the award winning cinematographer behind the lens of Jordan Peel's debut film Get Out. “Get Out” has received high praise from critics (99% Fresh rating at Rotten Tomatoes) and moviegoers around the world for its story, acting, and cinematography. Toby shares all his lighting and lensing techniques that gave Get Out its uniquely horrifying look. He and Go Creative Show host Ben Consoli discuss the blending of horror and comedy, why Toby choose to shoot with zoom lenses, the challenges of a limited budget, and so much more.

Feature, People / Interview
Ben Consoli
Panasonic at NAB Show 2017

Panasonic at NAB Show 2017

Panasonic’s booth at NAB is going to packed with the range of goodness that showgoers have come to expect, including the Cinema VariCam Experience, a look at the control room of the future, cloud-based news production, transparent and AR displays, and much more that we’ll be reporting throughout the week. Just before the show officially opened, Panasonic offered a preview of some of what’s in store for their customers, at the show and beyond, starting with a new camera system for live broadcast of 360-degree uncompressed 4K/30.


Creative COW
DJI Introduces Ronin 2, A More Powerful, Versatile and Intelligent Stabilizer For Film And Video Professionals

DJI Introduces Ronin 2, A More Powerful, Versatile and Intelligent Stabilizer For Film And Video Professionals

DJI, the world’s leader in creative camera technology, today introduced Ronin 2, the three-axis camera stabilizer redesigned to give filmmakers the freedom to capture any scene they can imagine. Based on DJI’s transformative gimbal technology, Ronin 2 has more power and torque to carry larger cameras, is more versatile to be used in every situation, and has more intelligent features to allow for unprecedented camera moves that help realize every creative vision.


Creative COW
HP Announces DreamColor Cinema 4K 31" and 24" Displays, Secure Mobile Workstations

HP Announces DreamColor Cinema 4K 31" and 24" Displays, Secure Mobile Workstations

Today at NAB, HP Inc. announced true Cinema 4K displays, arming color professionals with new features, like color-critical accuracy and automatic calibration, to produce the films and animations of tomorrow: the new HP DreamColor Z31x Studio and HP D


Creative COW
Blackmagic Design Announces DaVinci Resolve 14

Blackmagic Design Announces DaVinci Resolve 14

Blackmagic Design today announced DaVinci Resolve 14, the biggest release in the history of the product, and an update. New features include up to 10 times performance improvement, a whole new audio post production suite with Fairlight audio built into DaVinci Resolve, and multi user collaboration tools that let multiple people edit, color and mix audio from multiple systems, all in the same project at the same time. What this means is that DaVinci Resolve 14 is like 3 high end applications in one. Customers get professional editing, color correction and the new Fairlight audio tools, with a new reduced price of $299.


Creative COW
AJA Ki Pro Ultra Plus: 4-Channel HD Recording, with 4K Apple ProRes/Avid DNxHD Support

AJA Ki Pro Ultra Plus: 4-Channel HD Recording, with 4K Apple ProRes/Avid DNxHD Support

AJA Ki Pro Ultra Plus is a Multi-Channel Apple ProRes recorder offering up to 4-Channels of simultaneous HD recording, or in Single-Channel mode a 4K/UltraHD/2K/HD Apple ProRes® or Avid DNxHD® MXF recorder and player supporting the latest connectivity including 3G-SDI, Fiber and HDMI 2.0, as well as large raster high frame rate workflows, including 4K 60p.


Creative COW
Award-Winning BMI Composer Laura Karpman Talks About Bridging the Gap for Women in Music

Award-Winning BMI Composer Laura Karpman Talks About Bridging the Gap for Women in Music

When little girls think of what they’d like to be when they grow up, they can add “renowned composer” to the list, thanks in part to the work, both musical and influential, of BMI composer Laura Karpman. Musically, the four-time Emmy and GRAMMY


Creative COW
MORE
© 2017 CreativeCOW.net All Rights Reserved
[TOP]