Sora comes to Adobe video editing software! The new version of Premiere Pro opens the era of AI editing

Estimated read time 4 min read

Sora is going to be integrated into Adobe video editing software.

In the latest Premier Pro concept demonstration, Adobe showed the results of its collaboration with OpenAI:

In addition to the main shot, a B-roll auxiliary shot was generated entirely by Sora.

In addition to Sora, other popular AI video tools Runway and Pika will also be available as options.

Runway is used similarly to Sora in the demonstration and can generate a new auxiliary shot.

Pika can naturally extend existing lenses for several seconds.

It should be emphasized that these features are still in the early preview and research stage , and it has not yet been revealed when they will be released.

In comparison, the functions supported by Adobe’s own AI product Firefly are more certain.

Professional editors can easily add and remove objects from video, as well as expand footage on the timeline , without leaving Premiere Pro .

Within this year, video editing workflow will officially enter the AI ​​era.

Demo teardown

Adobe’s promotional video this time mainly shows three major “functions”.

The first is to add objects to parts of the video and add new objects.

In the video, the man slowly walked towards the woman, and then the woman turned around and opened a suitcase placed on the trunk of the car.

Looking closely, the box contains some scattered diamonds.

Just click the “Add Object” button, then select the target area, enter the prompt word, and the number of diamonds that originally were only a few will increase and fill the entire box.

And the subsequent pictures also changed accordingly. With the slight movement of the camera, the diamonds also changed naturally, and there were no flaws at all.

In addition to such “addition”, “subtraction” operations – deleting existing objects in the video – Premier will also do.

With the blessing of the smart magic wand, it only takes one click to automatically identify the entire object, unlike ordinary magic wands that can only select areas with similar colors.

After the recognition is completed, objects can be eliminated with just one click, and the background of the corresponding area will be automatically completed.

Display boards on the wall and objects on the floor can all be removed with one click, leaving no trace of what once existed.

Between “addition” and “subtraction”, the replacement of objects is also realized.

The man in the video put on a new watch that could follow the movements of his wrist, but the rest of the video was not affected.

Being able to achieve these effects with one click is indeed very powerful, but this kind of operation of targeting local details is even more powerful, and there is video expansion .

When you find that there is a gap in the timeline and you don’t know what materials to put in it, Premiere can directly generate content to fill the gap, and you can complete it with just one click and drag.

In effect, it can be said to be a seamless connection.

The most critical thing is that all AI-generated results are not destructive to the original material .

You can roll back to the initial version at any time, or switch directly between different AI model results.

In addition, Adobe also provides a “content certificate” function. All videos produced by Premiere Pro will clearly indicate whether and which AI technology was used.

The release dates for the above features have not yet been determined, and no further information has been disclosed other than that they will be released within this year.

In addition, Deepa Subramaniam, vice president of product marketing for creative professional applications at Adobe, said that Adobe has not yet resolved the issue of how revenue generated from the use of third-party AI tools will be distributed between Adobe and partners.

To train its AI video models, Adobe is buying video clips from photographers and artists.

Short clips that include people showing daily activities and expressing various emotions pay between $2.62 and $7.25 per minute .

In this way, Adobe Firefly will ensure that AI-generated content is safe for commercial use.

You May Also Like

More From Author

+ There are no comments

Add yours