OpenAI could also be dialing again its efforts within the video technology market with the shutdown of its Sora app, however ByteDance on Thursday confirmed that its new audio and video mannequin, Dreamina Seedance 2.0, is now rolling out in its enhancing platform, CapCut.
ByteDance says the mannequin permits creators to draft, edit, and sync video and audio content material by utilizing prompts, pictures, or reference movies.
The phased rollout will start with CapCut customers in Brazil, Indonesia, Malaysia, Mexico, the Philippines, Thailand, and Vietnam, with extra markets added over time.
The information of the launch in CapCut follows a latest report that stated the mannequin’s world rollout could be paused, whereas it labored to deal with mental property points that drew criticism from Hollywood over alleged copyright infringement. That probably explains the restricted variety of markets the place the mannequin is at the moment accessible inside CapCut.
In China, the mannequin is offered to customers of ByteDance’s Jianying app.
The video technology mannequin works with out reference pictures, even when the creator solely makes use of a number of phrases to explain the scene they take note of, ByteDance says in its announcement. CapCut can also be good at rendering sensible textures, motion, and lighting throughout a variety of visible views and angles, which the corporate notes may very well be used to edit, improve, or appropriate creators’ personal footage.
One other use case could be permitting creators to check potential concepts based mostly on early ideas or sketches earlier than filming the true video.
As well as, Dreamina Seedance 2.0 can be utilized for a variety of content material, together with cooking recipes, health tutorials, enterprise or product overviews, and movies with movement or action-focused content material, the place AI video fashions have traditionally confronted challenges, the corporate explains.
At launch, the mannequin helps clips of as much as 15 seconds lengthy throughout six side ratios.
In CapCut, the mannequin will roll out throughout totally different areas, together with enhancing options similar to AI Video and technology instruments like Video Studio. It can additionally come to ByteDance’s AI technology platform, Dreamina, and its advertising platform, Pippit.
Given its capability to create sensible content material, ByteDance says it has added security restrictions, so the mannequin received’t have the power to make movies from pictures or movies that comprise actual faces. CapCut may also block using unauthorized technology of mental property. (Nonetheless, if the restrictions had been working correctly, the mannequin could be accessible now in america. Probably, extra tweaks are nonetheless being made.)
The content material produced by Dreamina Seedance 2.0 may also embrace an invisible watermark, which can assist to establish content material made with the mannequin when it’s shared off-platform, ByteDance added. This might assist in issues like takedown requests from rights holders within the occasion that the mannequin allowed copyright content material by way of.
ByteDance says it would companion with specialists and artistic communities because the mannequin rolls out to iterate and enhance upon the mannequin’s capabilities.
