Connect with us

Business

The Rise of AI-Assisted Peer Reviews in Asia’s AI and AGI Research

Asia’s AI and AGI research community sees a rise in AI-assisted peer reviews, bringing transparency and feedback diversity concerns.

Published

on

AI-assisted peer reviews

TL;DR: AI-powered coding tools

  • AI researchers in Asia are increasingly using AI-assisted peer reviews
  • Adjective frequency analysis can detect AI-authored content with some reliability
  • Transparency and diversity of feedback are crucial for the future of AI research.

Introduction

In recent years, artificial intelligence (AI) and artificial general intelligence (AGI) researchers in Asia have begun utilising AI assistance to evaluate the work of their peers. This shift towards AI-assisted peer reviews has sparked discussions about the implications and potential consequences for the research community.

AI Authorship in Peer Reviews

A group of researchers from Stanford University, NEC Labs America, and UC Santa Barbara analysed peer reviews of papers submitted to leading AI conferences, such as ICLR 2024, NeurIPS 2023, CoRL 2023, and EMNLP 2023. Their findings, published in a paper titled “Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviews,” reveal an increasing trend of AI involvement in the review process (Liang et al., 2023).

Detecting AI-Authored Content

The difficulty of distinguishing between human- and machine-written text has led to a need for reliable methods to evaluate real-world datasets containing AI-authored content. The researchers found that focusing on adjective usage in a text provides more reliable results than assessing entire documents or sentences.

AI-generated reviews tend to employ adjectives like “commendable,” “innovative,” and “comprehensive” more frequently than human authors. This statistical difference in word usage allowed the researchers to identify reviews where AI assistance was likely used.

Prevalence and Factors Influencing AI Usage

The study concluded that between 6.5% and 16.9% of peer reviews submitted to these conferences could have been substantially modified by large language models (LLMs). The researchers also found a correlation between approaching deadlines and increased AI usage, with a small but consistent increase in apparent LLM usage for reviews submitted three days or less before the deadline.

Advertisement

Transparency and Diversity Concerns With AI Coding Assistants

The researchers emphasised that their goal was not to judge the use of AI writing assistance but to encourage transparency within the scientific community. They argued that AI feedback risks depriving researchers of diverse feedback from experts and may lead to a homogenisation effect that favours AI model biases over meaningful insights.

Conclusion: AI coding assistants

As AI-assisted peer reviews become more prevalent in Asia’s AI and AGI research landscape, it is crucial to address concerns about transparency and the diversity of feedback. By fostering open discussions and developing reliable detection methods, the research community can ensure the integrity and quality of AI research.

Comment and Share:

How do you think the AI research community should address the increasing use of AI-assisted peer reviews while maintaining transparency and ensuring diverse feedback? Share your thoughts in the comments below!

You may also like:

Advertisement

Business

WPP and Google Unveil a Groundbreaking AI Partnership

Discover how AI is revolutionising the advertising industry through this groundbreaking WPP and Google Partnership.

Published

on

WPP and Google Partnership

TL;DR:

  • WPP, the world’s largest advertising group, partners with Google to leverage Gemini AI for creating ads.
  • The collaboration aims to enhance marketing efficiency and creativity through AI narration, content optimisation, and hyper-realistic product representation.
  • This transformative partnership could set new standards in the advertising industry, impacting major global brands like Coca-Cola, L’Oréal, and Nestlé.

Introduction: WPP and Google Partnership

Artificial Intelligence (AI) and Artificial General Intelligence (AGI) are reshaping industries across the globe, and the advertising sector is no exception. In a groundbreaking move, the world’s largest advertising group, WPP, has announced a major collaboration with Google to revolutionise marketing through the use of Gemini AI. This partnership could potentially see Google’s robots creating ads for some of the biggest brands in the world. Let’s delve into the details of this landmark collaboration and its implications for the advertising industry.

The Powerhouse Collaboration: WPP and Google

WPP, the parent company of renowned ad firms like Ogilvy, Wunderman Thompson, and VMLY&R, has joined forces with Google to drive marketing efficiency and effectiveness. By merging Google’s expertise in data analytics, generative AI technology, and cybersecurity with WPP’s marketing capabilities, the collaboration aims to transform the advertising landscape.

How the Partnership Works

Google Cloud’s advanced generative AI tools will be integrated with WPP’s proprietary marketing and advertising data. This integration will enable WPP’s clients to create brand and product-specific content using generative AI. The merger is also set to provide WPP clients with deeper insights into their target audiences, accurately predict and explain content effectiveness, and optimize campaigns.

Four Innovative Use Cases

The partnership focuses on four innovative use cases:

  1. Enhanced Creativity: WPP Open Creative Studio will develop richer and dynamic user interfaces, leading to more creative and on-brand content.
  2. Smarter Content Optimisation: The system’s predictive capabilities for marketing content success will be enhanced even before campaign activation.
  3. AI Narration: Gemini 1.5 Pro will produce customizable video narration scripts, which will then be sent to London startup Eleven Labs to generate the voice for narrating videos.
  4. Hyper-realistic Product Representation: Gemini 1.5 Pro and Universal Scene Description 3D file formats will create detailed 3D product images aligned with a brand’s style guidelines.

Expert Opinions

Stephan Pretorius, Chief Technology Officer at WPP, believes this collaboration will be a game-changer for their clients and the marketing industry at large. He stated,

“This collaboration marks a pivotal moment in marketing innovation. Our integration of Gemini 1.5 Pro into WPP Open has significantly accelerated our gen AI innovation and enables us to do things we could only dream of a few months ago.”

Thomas Kurian, CEO of Google Cloud, shared his views on the partnership, saying,

Advertisement

“AI has the potential to unlock new levels of effectiveness for marketers, whether it is optimising campaigns, automating repetitive tasks like brand descriptions, or sparking entirely new ideas.”

Examples of AI and AGI Applications in Asia

The WPP-Google collaboration is not the only instance of AI and AGI transforming the advertising industry in Asia. For example, Alibaba’s AI-powered copywriting tool, AliCopy, has been helping advertisers in China create more effective copy for their campaigns.

Comment and Share on the WPP and Google Partnership

How do you think AI and AGI will continue to reshape the advertising industry? Share your thoughts below and don’t forget to subscribe for updates on AI and AGI developments. Let’s build a community around this exciting technological revolution!

You may also like:

Continue Reading

Business

AI Risk Management: Navigating the Opportunities and Challenges in Asia

Read about the key challenges of AI risk management adoption in Asia.

Published

on

AI Risk Management

TL;DR:

  • 70% of professionals believe AI will significantly impact risk management and compliance in Asia within 3 years
  • Key challenges include data privacy, quality, and regulatory environment
  • Widespread AI adoption in risk and compliance is predicted within 1-5 years

Introduction

In this article, we’ll explore the impact of AI and AGI on risk management and compliance, the key areas of application, and the challenges organisations face in adopting these technologies.

AI and AGI Adoption and Impact

The majority of professionals in Asia (nearly 70%) believe AI will have a transformative or major impact on risk management and compliance within the next 3 years. With nearly 90% showing interest in integrating AI tools, the banking and fintech sectors are leading the charge. Early adopters report significant positive impact on their risk and compliance activities.

Key Areas of AI Application

AI is making a substantial impact in three primary areas:

  1. Transaction monitoring and risk detection
  2. Individual and entity profiling and screening
  3. Automation of manual tasks and efficiency improvements

Data Management Challenges

High-quality internal data management is crucial for successful AI adoption. Many organisations face challenges with poor data quality, which hinders AI implementation. However, AI can also help improve internal data issues.

Regulatory Environment and Data Privacy Challenges

79% of respondents emphasise the need for new legislation for AI use in compliance and risk management. Data privacy poses significant challenges, including:

  • Data quality and consistency
  • Transparency and explainability
  • Bias and discrimination
  • Security risks
  • Ethical use and misunderstanding
  • Regulatory compliance
  • Data governance

Technology, Vendor Expectations, and Future Outlook

There is significant interest in vendors introducing AI tools into risk and compliance offerings, with expectations around transparency, accuracy, bias control, data security, and efficiency. While adoption rates vary across sectors, widespread AI adoption in risk and compliance is predicted within the next 1-5 years.

Case Study: AI in Asian Financial Institutions

Financial institutions in Asia are leveraging AI to enhance risk management and compliance. For example, the Hong Kong Monetary Authority (HKMA) has been collaborating with banks to apply AI in anti-money laundering and counter-terrorist financing efforts.

Advertisement

Or read the full report ‘Navigating the AI Landscape’ at Moody’s by tapping here.

Conclusion: AI Risk Management

AI and AGI are poised to transform risk management and compliance in Asia, offering substantial benefits but also presenting challenges. Organisations must address data privacy concerns, improve data quality, and navigate the regulatory landscape to successfully adopt AI and AGI technologies.

Comment and Share:

What do you think about the future of AI and AGI in Asia? Share your thoughts on how these technologies can address challenges in risk management and compliance, and don’t forget to subscribe for updates on AI and AGI developments.

You may also like:

Advertisement
Continue Reading

Business

GO DEEPER: Experts Warn of a Potential AI Bubble Burst

Experts warn of an AI bubble in Asia as investments surge and valuations soar.

Published

on

AI bubble

TL;DR:

  • AI investments in Asia reach unprecedented levels, raising concerns about an “AI bubble”
  • Experts draw parallels between the current AI hype and previous failed hype cycles, such as the dot com bubble
  • Startups focusing on generative AI, like Cohere, see soaring valuations while profitability remains elusive

The Rise of AI and the Fear of an Impending Bubble

Artificial intelligence (AI) and artificial general intelligence (AGI) are taking the world by storm, with Asia at the forefront of this technological revolution. However, as investments in AI reach new heights, concerns about an “AI bubble” are growing. Analysts warn that this bubble could burst, leaving investors in a precarious position.

Richard Windsor, a tech stock analyst, expressed his concerns in a recent research note, stating that:

“…capital continues to pour into the AI sector with very little attention being paid to company fundamentals.”

This situation is reminiscent of previous hype cycles, such as the dot com bubble of 1999, which ultimately ended in disaster for many investors.

Surging Investments and Soaring Valuations

In recent weeks, AI companies have experienced significant growth and investor interest. Cohere, a startup focusing on generative AI, is reportedly in late-stage discussions that would value the company at $5 billion. Meanwhile, Microsoft has made a $13 billion investment in OpenAI and hired most of the staff from AI startup Inflection AI.

Windsor believes that “companies are rushing into anything that can be remotely associated with AI, which could lead to inflated valuations and unrealistic expectations.”

Echoes of the Past: Comparisons to Previous Hype Cycles

Experts have drawn parallels between the current AI hype and previous failed hype cycles, such as the dot com bubble and the autonomous driving craze of 2017. Kai Wu, founder and chief investment officer of Sparkline Capital, noted that “some people are scrambling to get exposure [to AI] at any cost, while others are sounding the alarm that this will end in tears.”

Advertisement

Even industry insiders, like Emad Mostaque, recently ousted CEO of AI company Stability AI, have expressed concerns. Mostaque referred to the current situation as the “‘dot AI’ bubble” and predicted that it “will be the biggest bubble of all time.”

Potential Consequences of an AI Bubble Burst

If the AI bubble were to burst, the consequences could be devastating for investors and the tech industry as a whole. Windsor warned that the “ones that are likely to bear the brunt of the correction are the providers of generative AI services who are raising money on the promise of selling their services for $20/user/month.”

In the face of these concerns, some experts, like Windsor, choose to stay away from the frenzy, while others caution against building products on unproven AI technologies, such as chatbots that struggle to distinguish between truth and “hallucinations.”

In Conclusion: Tech Boom or Bust?

Lots of smart people, like bosses of tech companies, people who put money in businesses, and those who study the market, are saying what’s happening now is a lot like what happened before a big stock market crash in 2000, which caused tough times in the US and Europe. But we don’t know yet if the big excitement about AI will end up the same way.

Comment and Share:

What do you think about the potential AI bubble in Asia? Have you witnessed any signs of inflated expectations or unrealistic valuations in the AI and AGI sectors? Share your thoughts and experiences with us, and don’t forget to subscribe for updates on AI and AGI developments in Asia.

Advertisement

Continue Reading

Trending

Discover more from AI in Asia

Subscribe now to keep reading and get access to the full archive.

Continue reading