TL;DR:

• MarioVGG is a new AI model that can generate plausible video of Super Mario Bros. from user inputs.
• The model was trained on over 737,000 frames of Mario gameplay.
• Despite limitations, MarioVGG shows potential for AI to replace game engines in the future.

The Future of Gaming: AI-Generated Video

Imagine playing your favourite video game without a traditional game engine. Instead, an AI model generates the gameplay based on video footage. This is the fascinating concept behind MarioVGG, a new AI model that simulates Super Mario Bros. from video data. Developed by researchers from Virtuals Protocol, MarioVGG represents a significant step towards AI-generated video games.

Training MarioVGG: A Massive Undertaking

To train MarioVGG, the researchers used a public dataset containing 280 levels of Super Mario Bros. gameplay. This dataset included over 737,000 individual frames, which were preprocessed into 35-frame chunks. The model focused on two inputs: “run right” and “run right and jump.” Even with these limitations, training the model took about 48 hours on a single RTX 4090 graphics card.

How MarioVGG Works

MarioVGG uses a standard convolution and denoising process to generate new frames of video from a static starting game image and a text input. The model can create gameplay videos of any length by using the last frame of one sequence as the first frame of the next. This results in “coherent and consistent gameplay,” according to the researchers.

Challenges and Limitations

Despite its impressive capabilities, MarioVGG has several limitations. The model downscales the output frames to a resolution of 64×48, much lower than the NES’s 256×240 resolution. It also condenses 35 frames of video into just seven generated frames, resulting in rougher-looking gameplay. Additionally, MarioVGG struggles to approach real-time video generation, taking six seconds to generate a six-frame video sequence.

Impressive Results Despite Limitations

Even with these limitations, MarioVGG can create passably believable video of Mario running and jumping. The model can infer game physics, such as Mario falling when he runs off a cliff and halting his forward motion when adjacent to an obstacle. MarioVGG can also hallucinate new obstacles for Mario, although these can’t be influenced by user prompts.

The Future of AI in Gaming

The researchers hope that MarioVGG represents a first step towards “producing and demonstrating a reliable and controllable video game generator.” They even suggest that AI models like MarioVGG could one day replace game development and game engines completely.

Comment and Share:

What do you think about the future of AI in gaming? Could AI models like MarioVGG really replace traditional game engines? Share your thoughts and experiences in the comments below. Don’t forget to subscribe for updates on AI and AGI developments.

You may also like:

• Unleash Your Creativity: Building Retro Games with AI Tools
• Revolutionising Gaming: The AI and AGI Impact in Asia
• AI Showdown: Video Game Performers Strike for AI Protections
• To learn more about AI & gaming, tap here.

TL;DR:

• Over 2,600 video game performers represented by SAG-AFTRA are on strike, primarily over AI protections.
• The strike, which began on July 26, 2024, affects major gaming companies like Activision, Disney, and Electronic Arts.
• Performers demand consent and fair compensation for AI-generated use of their voices, faces, and bodies.

In a groundbreaking move, video game performers represented by SAG-AFTRA have initiated a strike against major gaming companies. The primary concern? Artificial Intelligence (AI) protections. This strike, which began on July 26, 2024, affects over 2,600 voice and motion-capture actors in the video game industry.

Timing and Scope

The walkout commenced at 12:01 AM on July 26, 2024. This labor action, authorized by an overwhelming 98.32% of SAG-AFTRA members, encompasses a wide range of roles. These include off-camera and on-camera performers, stunt coordinators, singers, and puppeteers. The strike affects all 160,000 SAG-AFTRA members, as the union has declared that every member is covered by the strike order.

Main Issues: AI Protections

At the heart of the strike lies the demand for robust AI protections. Performers are seeking consent and fair compensation for any AI-generated use of their voices, faces, and bodies. This concern stems from the potential for gaming companies to replicate performers’ work without proper authorization or remuneration. Additional issues include:

• Wage increases to keep pace with inflation.
• Enhanced safety measures for on-camera performances.
• Improved rest periods to prevent vocal strain.
• Presence of set medics for hazardous jobs.

The union argues that unregulated AI use could provide game developers with a means to replace actors, particularly in background roles that often serve as stepping stones to larger parts.

Companies and Union Stance

Major gaming companies targeted by the strike include Activision, Disney, Electronic Arts, Warner Bros., and Take-Two Interactive. SAG-AFTRA argues that AI poses an “equal or even greater danger” to video game performers compared to film and TV actors. The union claims that companies have not offered sufficient AI protections in contract negotiations.

In response, gaming companies express disappointment in the decision to strike. They state they’ve reached agreements on 24 out of 25 proposals and offered “meaningful AI protections” that include requiring consent and fair compensation.

Historical Strikes in the Gaming Industry

The current SAG-AFTRA strike against video game companies is not without precedent in the gaming industry. In 2016, video game voice actors initiated a strike that lasted nearly a year, marking the first such action in the industry’s history. That strike, which also involved SAG-AFTRA members, focused on issues such as vocal stress, workplace safety, and compensation structures.

The resolution of the 2016-2017 strike led to some improvements in working conditions and pay for voice actors. However, certain issues remained unresolved, particularly those related to residual payments. This historical context underscores the ongoing challenges faced by performers in the video game industry. It highlights the evolving nature of labor relations in this rapidly changing technological landscape.

Potential Impacts and Context

Extended negotiations and a prolonged strike could potentially delay game development and releases. This would affect voice acting, motion capture, and other performance aspects of upcoming titles. This labor action follows the 2023 Hollywood writers’ and actors’ strikes, which also centered on AI concerns. It echoes a previous video game performers’ strike in 2016-2017.

The current dispute highlights the evolving landscape of the gaming industry. AI technology is increasingly intersecting with creative performances. As the $200 billion industry grapples with these challenges, the outcome of this strike may set important precedents for how AI is used and regulated in interactive entertainment.

The Role of AI in the Gaming Industry

AI has revolutionised the gaming industry in numerous ways. From creating more realistic characters to generating complex game environments, AI is integral to modern game development. However, the use of AI also raises ethical and legal questions, particularly regarding the rights of performers whose work is being replicated.

For more information about AI and the gaming industry tap here.

Comment and Share:

How do you think AI should be regulated in the gaming industry to protect performers’ rights? Share your thoughts and experiences in the comments below. Don’t forget to subscribe for updates on AI and AGI developments.

You may also like:

• Revolutionising Gaming: The AI and AGI Impact in Asia
• Create HTML5 Games with AI in Minutes
• The Rise of AI-powered Game Generation: A Glimpse into the Future of Gaming

• For more information about AI and the gaming industry tap here.

TL;DR:

• Sony Music Group issues warnings to over 700 AI companies against unauthorised use of content.
• The music industry grapples with AI’s rapid proliferation and potential copyright infringement.
• Artists and music executives push for legislation to protect intellectual property rights.

Sony Music Group’s Warning to AI Companies

Sony Music Group (SMG), a global powerhouse in the music industry, has issued formal warnings to over 700 generative AI companies and streaming platforms. The warning? Do not use SMG’s content to train AI models without explicit permission. This covers a broad spectrum of content, including audio recordings, musical compositions, cover artwork, and metadata.

The Impact of AI on the Music Industry

AI’s rapid proliferation in the music industry has sparked concerns over copyright infringement. With AI tools making it easier for anyone to scrape copyrighted content to produce AI-generated music, the industry is grappling with this new reality.

Sony’s Stance on AI Innovation

Sony recognises the potential of AI but insists on respect for songwriters’ and recording artists’ rights, including copyrights. In a letter to the companies, SMG stated that unauthorised use of their content for AI training deprives them of control and appropriate compensation, infringing on their intellectual property rights.

The Call for Confirmation

SMG has asked these companies to confirm whether they have used SMG’s content without permission. If they have, the companies must provide details about how the content was used in AI training.

The EU’s Artificial Intelligence Act

The European Union’s Artificial Intelligence Act, passed in March, includes a clause requiring AI model providers to make public a detailed summary of the content used to train their models. This law could set a precedent for AI regulation globally.

AI-Generated Music and Copyright Claims

AI-generated music has already led to copyright claims. Last year, a viral song called “heart on my sleeve” featuring AI-generated vocals resembling Drake and The Weeknd was taken down due to a copyright claim by Universal Music Group.

Artists and Executives Advocate for Protection

Artists and music executives are pushing for protection against AI misuse. Warner Music Group CEO Robert Kyncl testified before the Senate Judiciary subcommittee, advocating for legislation to protect against nonconsensual deepfakes. Over 200 artists signed an open letter calling on AI developers and tech companies not to use AI in ways that undermine human artistry.

The Future of AI in Music

The future of AI in music is uncertain, but one thing is clear: the industry is taking a stand to protect intellectual property rights. As AI continues to evolve, so too will the ways in which we protect and respect the rights of artists and creators.

Comment and Share

What are your thoughts on the use of AI in music? Do you believe it’s a threat to human artistry, or can it coexist harmoniously with traditional music creation? Share your thoughts in the comments below and don’t forget to subscribe for updates on AI and AGI developments.

You may also like:

• AI Music Showdown: Major Labels vs. AI Start-ups in Copyright Battle
• Unleashing Your Inner Composer: Discover AI Music Generators
• Adobe’s GenAI is Revolutionising Music Creation
• To learn more about copyright and AI tap here.