IBC 2023: Adobe unveils powerful new AI and 3D features in Adobe Premiere Pro and Adobe After Effects, with enhanced storage capabilities in Frame.io.
As members of the media and broadcast community pack their bags for the 2023 IBC Show, Adobe is proud to announce powerful new AI and 3D innovations across its family of video and audio applications.
With new beta releases across Premiere Pro, After Effects and Frame.io, Adobe’s fast, reliable and intuitive toolset enables seamless collaboration for creative professionals. AI-powered features automate time-intensive tasks so video editors and motion designers can bring their vision to life at the speed of imagination, while dozens of user-requested workflow enhancements improve productivity.
Adobe’s top priority is delivering powerful tools that are designed with the editor in mind. This year, the Adobe Creative Cloud video team spoke with more than 1,000 professional editors to solicit feedback — much of which has been incorporated in today’s release.
New in Premiere Pro (beta)
Premiere Pro adds cutting-edge AI-powered features including Enhance Speech for quicker dialog cleanup, filler word detection and removal in Text-Based Editing, and improved Auto Tone Mapping for more consistent color output. The timeline is now five times faster*, which makes editing, trimming, and just about everything else you do in the Timeline smoother and more responsive.
Enhance Speech
Sometimes you need a little help to improve the overall speech quality in your videos. Whether it’s due to scenarios like a poorly placed mic, excessive background noise or, low-quality archive footage or any other reason, poor audio can be very difficult to clean up. Enhance Speech uses AI to magically remove background noise and improve the quality of poorly recorded dialogue, making it sound as if it was recorded in a professional studio. You can also use the mix slider to incorporate some of the background noise to make it sound just right.
In addition, the new Audio Category Tagging uses AI to determine which clips contain dialogue, which contain music, and which are sound effects or ambient noise. When each audio clip is selected, the most relevant tools are automatically displayed. Together with Enhance Speech, editors can get valuable time back in their day by achieving professional-level audio quality with just a few clicks.
You can find Enhance Speech and Audio Category Tagging in the Essential Sound panel. Both features process in the background so you can keep working without skipping a beat.
Text-Based Editing improvements
Premiere Pro introduced Text-Based Editing earlier this year to help make creating rough cuts as simple as copying and pasting text. We’re proud that Text-Based Editing has been recognized with several industry innovation awards—including the prestigious HPA Engineering Excellence Award. Today, it gets even better with enhancements based on top requests from the Adobe community.
Text-Based Editing now includes filler word detection to automatically identify "ums" and "uhs" in dialogue. You can quickly remove those filler words, pauses or any other unwanted dialogue in one step using bulk delete. These features can be accessed in the Transcript panel in Text-Based Editing workspace.
Performance optimizations
The latest version of Premiere Pro includes massive 5x timeline performance improvements* for faster editing, and new tools such as the Effects Manager to help you find incompatible plug-ins to optimize system performance. Automatic project recovery helps ensure you can seamlessly pick-up right where you left off with in the event of a problem.
Color
New color preferences and improved tone mapping make it easier to get great color. Automatic Tone Mapping has been improved to include three new tone mapping methods. There are also new consolidated settings in the Lumetri Color panel as well as improved LUT management and relinking. Finally, you can ensure your colors look exactly as you expect in QuickTime Player by adjusting the new Viewer Gamma option.
Top requests from the community
Sometimes it’s the little things that count the most. That’s why you’ll find things like new project templates so you can get started faster, custom export locations, a new metadata and timecode burn-in effect, batch selection of markers and dozens of other minor, but mighty workflow enhancements that make a huge difference to editors using Premiere Pro all day. Each of these features were highly requested from the professional video community.
New in After Effects (beta)
Next-generation AI rotoscoping streamlines After Effects workflows by removing objects faster and more accurately while a new, true 3D workspace integrates 3D models for stunning VFX composites and motion graphics.
True 3D Workspace
After Effects introduces a true 3D workspace, opening the door to an entirely new way to design in motion. Add depth and dimension to compositions in a unified space with native import of 3D models. Image-Based Lighting realistically places models into a scene with complementary lighting and shadows using any image as a light source, making objects appear as though they naturally belong there. Beautiful 3D motion graphics are generated using an advanced 3D renderer, with the fast performance, high-quality antialiasing, and fantastic transparency. A unique way to combine 2D and 3D in a composition has also been added. Effects that reference another layer, such as Displacement Map, Vector Blur, or Calculations, can use a 3D model layer as a source to create highly stylized renders.
AI-Powered Roto Brush
Hard-to-isolate objects such as overlapping limbs, hair, and transparencies are separated from their background with ease thanks to an all-new AI model in the popular Roto Brush tool. With this addition, editors, motion designers, and VFX artists can shave off hours of tedious rotoscoping work, enabling you to focus on the more creative aspects of your projects.
New in Frame.io
The Frame.io vision has always been to empower creatives so you can work more efficiently and stay in the creative flow. For this IBC, we’re releasing new features and announcing partnerships designed to help teams customize their workflows to accommodate the ever-increasing demand for new content across every segment of the industry.
Frame.io Storage Connect
Introducing Frame.io Storage Connect, which accelerates collaboration and cuts costs for Enterprise customers needing solutions to scale profitably allowing them to use the storage they already own, while maintaining full control of their assets. Storage Connect enables direct connection to AWS S3 storage with lightweight proxies available in Frame.io. Storage Connect will be available later this year for Frame.io Enterprise customers.
Comparison Viewer
An increasing number of our customers create content for a vast array of purposes from broadcast to brands. That’s why we’ve refreshed our review and approval tools for creators who work with a wide range of assets and need to compare them.
The comparison viewer now supports viewing video, audio, photo, design file, and PDF assets side-by-side. Now, all Frame.io and Creative Cloud users can compare any two matching asset types with access to commenting and annotations, keeping you in the conversation as you carefully consider two different assets, or many versions of an asset or draft. This improvement to comparisons provides more nuanced review and approval capabilities for creatives and stakeholders who need to work faster and more efficiently.
Camera to Cloud Momentum
Supported on over 200+ camera systems through a vast network of integrations, Camera to Cloud is growing this year at IBC. Now with even more solutions for connecting your production to the cloud, we’re announcing five new Camera to Cloud connections for Frame.io and Creative Cloud customers.
Atomos has two new Camera to Cloud compatible devices, the new Ninja and Ninja Ultra. When paired with an Atomos CONNECT module, video teams can easily capture and automatically upload high-quality 10bit 4K H.265 assets to Frame.io after each take. The Ninja Ultra also unlocks duel-record ProRes RAW and HD proxy C2C capabilities for more advanced online/offline workflows.
Fujifilm’s new large-format mirrorless GFX-100ii (pronounced GFX-100 the second), allows photography and video teams to capture and upload 102MP RAW photos and up to 10bit 8K video clips remotely to Frame.io on a massive 55mm CMOS II HS sensor (11648 x 8736 pixel). The FUJIFILM GFX-100ii boasts a native integration, requiring no additional hardware for creators to leverage C2C on their next production.
New to the Camera to Cloud family is Accsoon, who unveils the SeeMo and SeeMo Pro devices. Both allow videographers, journalists, and news teams to use iPhones or iPads as professional video monitoring devices with features similar to those offered by Atomos, Black magic Design, or SmallHD.
The SeeMo, ideal for mirrorless cameras, attaches to cameras via HDMI. The heavier-duty SeeMo Pro attaches via HDMI or SDI and is perfect for ENG and mid-range cine cameras. With the new C2C integrations both allow you to monitor, record, and upload lightweight HD H.264 video clips from your connected iPhone or iPad directly to Frame.io.
For more information on Frame.io's features, please visit the Frame.io blog.
Availability
All these features are available now in beta and are planned to be generally available later this fall. For more information on how to access the beta apps, please visit the Premiere Pro (beta) and After Effects (beta) pages.
Adobe’s latest releases of Premiere Pro, After Effects and Frame.io will be on display at the 2023 IBC Show from September 15-18 in Amsterdam at booth 7.B35 in Hall 7. We hope to see you there.
* Premiere Pro 24.0 (beta) timeline drawing performance compared to Premiere Pro 23.4 on Mac and Windows. Tested by Adobe in August 2023.