Twice a year Adobe engineers take the stage at Adobe MAX and Adobe Summit to show off early tech innovations to 1000s of people in a theater and millions more online. These demos are experiments — ‘pre-release’ technology — that may not even make their way into future products. Often with no training in public speaking, showing off not-ready-for-primetime technology, with a celebrity host — the Adobe Sneak Peek presenters are a special breed.
The “Sneak peeks” program (or Sneaks, for short) is a perennial fan-favorite, started at Omniture in the late 1990’s (before Adobe acquired the company in 2009) as part of their customer events. The session was interactive, where product managers would show off new analytics tool features and attendees would vote on their favorites. The program’s popularity made it a must-have as Adobe evolved the event into Summit. And of course, if marketers were so interested in early martech, well then it only made sense that not-yet-released creative app features would also make a great show.
“You get to be a mini-celebrity,” said Geoffrey Oxholm, senior research manager, explaining how the MAX stage is great visibility for development teams working on new products.
Oxholm is now an old pro, presenting his Adobe Research team’s work in 2015 (with Project Dollhouse, which adds perspective to drawings) and 2016 (with Loop Welder, which makes looping short videos for social media). It was in 2017, with the demo of Project Cloak, that Oxholm truly experienced the real power of Adobe Sneak Peeks.
Sneaks has two main objectives: “To demonstrate the commitment to ongoing innovation, and to gauge interest in those innovations,” said Ben Forta, senior director, education initiatives at Adobe and Sneaks program director. A former Sneaks host and presenter himself, Forta said roughly half the projects shown in Sneaks go on to become products.
“I’ve done presentations that have become product, and I’ve done some presentations that bombed and the demo totally crashed,” he said. A flawed presentation doesn’t mean the project won’t move to product, though. The projects selected for Sneaks are picked because they show promise. In fact, according to Forta, some have been pulled from consideration because they were already planned for imminent release.
The projects must be forward-looking “genre-defining” features, said Forta. “We want to show things no one has thought of before,” he said. They also need to be real developments, “not simply a PowerPoint” that can be demonstrated to an interested crowd. They need not be completely finished, but they must be real, no smoke-and-mirrors, no faking it, this is all real working technology, often in the earliest of development stages. Adobe research teams pitch their Sneaks to the events’ selection committees and the final ones selected are a mix of features and products that will resonate with the diverse MAX audience. “We don’t look for 10 Sneaks that are all Photoshop-related,” Forta added.
Project Cloak (Oxholm’s 2017 entry) developed into Content-Aware Fill (CAF) for video, a new feature later released in After Effects, in Adobe Creative Cloud. The feature allows editors and visual effects artists to remove unwanted elements from video clips (such as production gear, drone shadows, or even stand-in actors for CGI characters) and replaces them with backgrounds generated from adjacent pixels and other frames in the clip.
https://www.youtube.com/watch?v=TzBZWBht02I
For the 2017 Sneaks program, Oxholm was last to present. He paced backstage, trying to stay focused. Once onstage, he zeroed in on what he’d practiced, opening with some applause lines to get a few laughs and break the tension, and working up to the grand finale, where two people were first shown walking through a canyon, and then were removed from the footage.
“It was barely working (a few days before the show), so I was working really hard to get it to be where it should be.” By the day of the presentation? “At last, the results looked pretty good,” said Oxholm.
“The real exciting stuff comes after… on Twitter and social media, where people are sharing their reactions. Some of them are saying: ‘There's no way this is real.’ It just makes you want to get it to the customers and show them that they can actually have this,” said Oxholm.
“Sometimes it’s eye opening to see how the audience responds to what they are seeing,” said Forta. “There definitely have been times where the reaction has been so extreme that it elicited (from us) a, ‘yeah, we need to have that thing’, kind of response.”
Immediately after Oxholm’s 2017 Sneaks session, the reaction on social media and from people in the industry was clear: this technology was needed in the product.
“We had folks mailing us hard drives with footage where they wanted to remove something,” even before the feature was available, said Oxholm. In one video file they received, a damaged sensor had ruined footage. In another, an entire recording of an interview with a famous personality was marred by a lighting mistake. Oxholm and his team actually fixed both those expensive errors and sent back clean footage. “And in both these cases, the folks on the phone were so grateful they were emotional,” he said. For the team, it was an opportunity to work out some of the technology issues, and of course: demonstrate the product in real life.
The reaction after Sneaks, “really made it clear that this should be a thing that we work on.” The original inventors of After Effects had already shown interest in the function Oxholm was developing, and “that's as much of a guarantee as you can get.”
Around the same time, a senior developer on the After Effects team joined Oxholm’s team and helped integrate the new feature. Since its first release in 2019, Content-Aware Fill for Video has been iterated on in subsequent releases based on additional customer feedback, the feature is now faster, uses less memory and supports changes in background lighting or exposure.
A slot at Sneaks doesn’t mean a project is more likely to move to production, but, said Forta, “Often it’s very clear on the day we’re running through this, which are the ones people will go: ‘I’ve got to a have that.’”