TL;DR:

• MarioVGG is a new AI model that can generate plausible video of Super Mario Bros. from user inputs.
• The model was trained on over 737,000 frames of Mario gameplay.
• Despite limitations, MarioVGG shows potential for AI to replace game engines in the future.

The Future of Gaming: AI-Generated Video

Imagine playing your favourite video game without a traditional game engine. Instead, an AI model generates the gameplay based on video footage. This is the fascinating concept behind MarioVGG, a new AI model that simulates Super Mario Bros. from video data. Developed by researchers from Virtuals Protocol, MarioVGG represents a significant step towards AI-generated video games.

Training MarioVGG: A Massive Undertaking

To train MarioVGG, the researchers used a public dataset containing 280 levels of Super Mario Bros. gameplay. This dataset included over 737,000 individual frames, which were preprocessed into 35-frame chunks. The model focused on two inputs: “run right” and “run right and jump.” Even with these limitations, training the model took about 48 hours on a single RTX 4090 graphics card.

How MarioVGG Works

MarioVGG uses a standard convolution and denoising process to generate new frames of video from a static starting game image and a text input. The model can create gameplay videos of any length by using the last frame of one sequence as the first frame of the next. This results in “coherent and consistent gameplay,” according to the researchers.

Challenges and Limitations

Despite its impressive capabilities, MarioVGG has several limitations. The model downscales the output frames to a resolution of 64×48, much lower than the NES’s 256×240 resolution. It also condenses 35 frames of video into just seven generated frames, resulting in rougher-looking gameplay. Additionally, MarioVGG struggles to approach real-time video generation, taking six seconds to generate a six-frame video sequence.

Impressive Results Despite Limitations

Even with these limitations, MarioVGG can create passably believable video of Mario running and jumping. The model can infer game physics, such as Mario falling when he runs off a cliff and halting his forward motion when adjacent to an obstacle. MarioVGG can also hallucinate new obstacles for Mario, although these can’t be influenced by user prompts.

The Future of AI in Gaming

The researchers hope that MarioVGG represents a first step towards “producing and demonstrating a reliable and controllable video game generator.” They even suggest that AI models like MarioVGG could one day replace game development and game engines completely.

Comment and Share:

What do you think about the future of AI in gaming? Could AI models like MarioVGG really replace traditional game engines? Share your thoughts and experiences in the comments below. Don’t forget to subscribe for updates on AI and AGI developments.

You may also like:

• Unleash Your Creativity: Building Retro Games with AI Tools
• Revolutionising Gaming: The AI and AGI Impact in Asia
• AI Showdown: Video Game Performers Strike for AI Protections
• To learn more about AI & gaming, tap here.

TL;DR:

• Over 2,600 video game performers represented by SAG-AFTRA are on strike, primarily over AI protections.
• The strike, which began on July 26, 2024, affects major gaming companies like Activision, Disney, and Electronic Arts.
• Performers demand consent and fair compensation for AI-generated use of their voices, faces, and bodies.

In a groundbreaking move, video game performers represented by SAG-AFTRA have initiated a strike against major gaming companies. The primary concern? Artificial Intelligence (AI) protections. This strike, which began on July 26, 2024, affects over 2,600 voice and motion-capture actors in the video game industry.

Timing and Scope

The walkout commenced at 12:01 AM on July 26, 2024. This labor action, authorized by an overwhelming 98.32% of SAG-AFTRA members, encompasses a wide range of roles. These include off-camera and on-camera performers, stunt coordinators, singers, and puppeteers. The strike affects all 160,000 SAG-AFTRA members, as the union has declared that every member is covered by the strike order.

Main Issues: AI Protections

At the heart of the strike lies the demand for robust AI protections. Performers are seeking consent and fair compensation for any AI-generated use of their voices, faces, and bodies. This concern stems from the potential for gaming companies to replicate performers’ work without proper authorization or remuneration. Additional issues include:

• Wage increases to keep pace with inflation.
• Enhanced safety measures for on-camera performances.
• Improved rest periods to prevent vocal strain.
• Presence of set medics for hazardous jobs.

The union argues that unregulated AI use could provide game developers with a means to replace actors, particularly in background roles that often serve as stepping stones to larger parts.

Companies and Union Stance

Major gaming companies targeted by the strike include Activision, Disney, Electronic Arts, Warner Bros., and Take-Two Interactive. SAG-AFTRA argues that AI poses an “equal or even greater danger” to video game performers compared to film and TV actors. The union claims that companies have not offered sufficient AI protections in contract negotiations.

In response, gaming companies express disappointment in the decision to strike. They state they’ve reached agreements on 24 out of 25 proposals and offered “meaningful AI protections” that include requiring consent and fair compensation.

Historical Strikes in the Gaming Industry

The current SAG-AFTRA strike against video game companies is not without precedent in the gaming industry. In 2016, video game voice actors initiated a strike that lasted nearly a year, marking the first such action in the industry’s history. That strike, which also involved SAG-AFTRA members, focused on issues such as vocal stress, workplace safety, and compensation structures.

The resolution of the 2016-2017 strike led to some improvements in working conditions and pay for voice actors. However, certain issues remained unresolved, particularly those related to residual payments. This historical context underscores the ongoing challenges faced by performers in the video game industry. It highlights the evolving nature of labor relations in this rapidly changing technological landscape.

Potential Impacts and Context

Extended negotiations and a prolonged strike could potentially delay game development and releases. This would affect voice acting, motion capture, and other performance aspects of upcoming titles. This labor action follows the 2023 Hollywood writers’ and actors’ strikes, which also centered on AI concerns. It echoes a previous video game performers’ strike in 2016-2017.

The current dispute highlights the evolving landscape of the gaming industry. AI technology is increasingly intersecting with creative performances. As the $200 billion industry grapples with these challenges, the outcome of this strike may set important precedents for how AI is used and regulated in interactive entertainment.

The Role of AI in the Gaming Industry

AI has revolutionised the gaming industry in numerous ways. From creating more realistic characters to generating complex game environments, AI is integral to modern game development. However, the use of AI also raises ethical and legal questions, particularly regarding the rights of performers whose work is being replicated.

For more information about AI and the gaming industry tap here.

Comment and Share:

How do you think AI should be regulated in the gaming industry to protect performers’ rights? Share your thoughts and experiences in the comments below. Don’t forget to subscribe for updates on AI and AGI developments.

You may also like:

• Revolutionising Gaming: The AI and AGI Impact in Asia
• Create HTML5 Games with AI in Minutes
• The Rise of AI-powered Game Generation: A Glimpse into the Future of Gaming

• For more information about AI and the gaming industry tap here.

TL;DR:

• The world premiere of “The Last Screenwriter,” a film with a script entirely generated by AI, was canceled due to public backlash.
• The controversy highlights the ongoing debate about AI’s role in creative industries.
• Director Peter Luisi aims to release the film online for free to promote transparency and discussion.

AI Takes Centre Stage: The Last Screenwriter’s Controversial Premiere

In a world where artificial intelligence (AI) is increasingly making its mark, the film industry is not immune to its influence. “The Last Screenwriter,” a film directed by Swiss filmmaker Peter Luisi, found itself at the centre of a heated debate about AI’s role in creative industries. The film’s screenplay, including plot, characters, and dialogue, was entirely generated by ChatGPT, OpenAI’s language model. The world premiere, originally scheduled for June 23, 2024, at London’s Prince Charles Cinema, was abruptly canceled following significant public opposition.

Public and Industry Backlash

The cancellation sparked mixed reactions on social media. Some praised the cinema for its stance on industry issues, while others accused it of stifling important discussions about AI’s impact on the arts. This controversy reflects broader concerns within the entertainment industry about AI’s role, which partly motivated the 2023 Hollywood strikes. Actors and writers, including notable figures like Charlie Kaufman, have expressed apprehension about the unregulated use of AI tools and their potential impact on livelihoods.

Director’s Response: A Call for Transparency

Peter Luisi, the director of “The Last Screenwriter,” expressed surprise at the backlash. He argued that the film could support screenwriters’ cause by demonstrating AI’s capabilities. Despite the public screening’s cancellation, Luisi remained committed to holding a private premiere for the cast and crew. He also plans to release the film online for free, along with the full screenplay and documentation detailing ChatGPT’s writing process. This move aims to promote transparency and further discussion on AI’s impact on the film industry.

AI’s Role in Creative Industries: A Growing Debate

The controversy surrounding “The Last Screenwriter” highlights the growing tension between technological advancement and creative industries. As AI capabilities expand, concerns about job displacement and the devaluation of human creativity have intensified. The film industry faces challenges as AI tools become more sophisticated, potentially capable of generating entire scripts or even full movies tailored to viewers’ preferences. This development raises questions about the future role of human filmmakers and the preservation of artistic integrity in an increasingly AI-driven world.

AI in Film Production: Beyond Screenwriting

The debate extends beyond screenwriting to other aspects of film production. For instance, performance cloning, as evidenced by Scarlett Johansson’s complaint against an AI company’s unauthorized use of her voice replica, raises ethical questions about consent and ownership in the age of AI.

Comment and Share

What are your thoughts on AI’s role in creative industries? Do you think AI tools can coexist with human creativity, or do they pose a threat to artistic integrity? Share your thoughts in the comments below and don’t forget to subscribe for updates on AI and AGI developments.

You may also like:

• Under Armour’s Controversial AI Commercial Stirs Debate in Asia
• The Rise of AI From Hollywood to Asia
• ChatGPT Overtakes Netflix: The Unstoppable Rise of AI and AGI in Asia
• To learn more about “The Last Screenwriter” tap here.