Adobe’s AI Revolution: Editing Videos with a Single Frame
Adobe is pushing the boundaries of creative software with a suite of experimental AI tools, showcased at its Max conference. These “sneaks” promise to revolutionize how we edit photos, videos, and audio, offering intuitive new ways to manipulate content. The projects, like Photoshop’s Distraction Removal and Harmonize tools before them, may eventually become official features in Adobe’s Creative Cloud software or Firefly apps, signaling a significant shift in the creative landscape.
Project Frame Forward: Video Editing Reimagined
One of the most impressive of these new tools is Project Frame Forward. This innovative feature allows video editors to make changes to a single frame and have those edits automatically applied across the entire video. Instead of the time-consuming process of using masks to select and manipulate objects, Frame Forward can identify, select, and remove objects from footage with just a few clicks. For example, Adobe demonstrated the tool removing a woman from a video and replacing her with a natural-looking background, akin to Photoshop’s Context-aware Fill or Remove Background functions. The same principle applies to inserting objects: users can draw where they want an object, describe it with AI prompts, and the tool will insert it, contextually aware of the surrounding environment.
Beyond Video: New Tools for Photos and Audio
Adobe’s innovations extend beyond video editing. Project Light Touch leverages generative AI to reshape light sources in photos. Users can change the direction of light, add lamps to a room, and control the diffusion of light and shadow. The tool can also insert dynamic lighting that moves across the editing canvas, illuminating objects and altering the environment in real time. The color of these manipulated light sources can also be adjusted, allowing for both subtle and dramatic effects.
For audio editing, Project Clean Take offers a fresh approach to manipulating speech. This tool allows users to alter the enunciation of speech using AI prompts, eliminating the need to re-record audio clips. It can change the delivery or emotion of a speaker’s voice, replace words while preserving the speaker’s unique vocal characteristics, and automatically separate background noises, allowing for selective adjustments and improved clarity.
Other Notable Sneaks
Other notable “sneaks” include:
- Project Surface Swap: Instantly changes the material or texture of objects and surfaces.
- Project Turn Style: Edits objects in images by rotating them like a 3D image.
- Project New Depths: Edits photographs as if they were a 3D space.
These experimental tools represent a significant leap forward in creative software, offering unprecedented control and efficiency to creatives. While not yet available to the public, these “sneaks” hint at a future where complex editing tasks become more accessible and intuitive. As Adobe continues to refine these AI-powered features, we can expect even more innovative tools to emerge, further transforming the creative process. (Source: The Verge)
About the Author
