YouTube announced a bunch of new experimental AI services, one of them being a feature called Dream Track in YouTube Shorts. Dream Track allows users to create up to 30-second soundtracks using AI-generated versions of artists’ voices. Despite concerns from musicians about the use of their voices for training models without permission or compensation, YouTube managed to get nine big names from the music industry to participate in this experiment. Some of these big names include John Legend, Troye Sivan, CharliXCX, and T-Pain.
Dream Track can be accessed by typing an idea into the creation prompt and choosing from one of the participating artists. It uses Google DeepMind’s Lyria, a powerful music generation model designed specifically for creating high-quality vocals and instrumentals. The user also has more control over the final product. Any content generated by Lyria will have a SynthID watermark, denoting it as such.
Charlie Puth and T-Pain created sample Dream Tracks, which YouTube has shared as inspiration. However, many of the artists involved expressed their apprehension about AI but remained hopeful that collaborative work could create positive, non-exploitative opportunities. CharliXCX said, “When I was first approached by YouTube I was cautious and still am. AI is going to transform the world and the music industry in ways we do not yet fully understand. This experiment will offer a small insight into the creative opportunities that could be possible and I’m interested to see what comes out of it.”
Additionally, YouTube is collaborating with its Music AI Incubator to bring Music AI Tools to the platform. These tools can create guitar riffs from a hummed melody or turn a pop track into a reggaeton anthem. Producer and songwriter, Louis Bell, created a sample video to showcase the capabilities of these tools.
While introducing AI tools, YouTube is also implementing new policies for labeling videos made using AI and allowing public figures, such as musicians, to report deepfakes. This demonstrates YouTube’s commitment to walking a fine line as it navigates the careful balance of introducing AI tools while protecting against misuse.
Currently, Dream Track is only available to a select group of creators and artists, while participants of the Music AI Incubator are expected to be able to test the tools later this year. Despite concerns and challenges along the way, it’s evident that YouTube is pushing forward with AI-powered tools and is committed to ensuring responsible and ethical usage within its platform.