AI Drift will Pass Over, ChatGPT Like Models are Here to Grow

  • 22nd Aug,2023
  • 1.5K Views
  • 3 mins Read

AI

If you are an avid ChatGPT user (I assume many of you are), weren’t you fazed by recent news reports of the incredible chatbot going bankrupt by the end of 2024? OpenAI, the maker of ChatGPT is burning $700,000 (or Rs 5.8 crore) each day to keep the large language model (LLM) running. Despite this hefty operational expense, ChatGPT’s user base has been consistently dwindling over the past two months. It is Microsoft’s $10 billion funding and the money from other deep-pocket investors that’s keeping ChatGPT afloat. 

Concerns are rife regarding the viability of LLMs like ChatGPT. But this is just one side of the story. The other concern being bandied about is the performance of these Generative AI models. A team of researchers from the University of California at Berkeley and Stanford University found that the performance of LLMs, especially the ChatGPT4 version has dipped. In their study, the researchers found that ChatGPT4’s March version outperformed its June counterpart on parameters like solving math problems, answering sensitive questions, responding to opinion surveys, answering multi-hop knowledge-intensive questions, code generation, US Medical License exams, and completing visual reasoning tasks.

This phenomenon is startling because models like ChatGPT are supposed to get smarter and better with time and training. Why is then the model underperforming or delivering unanticipated outcomes? Experts have attributed it to AI drift. AI drift happens when an AI system's performance and behaviour change over time, often due to the changing nature of the data it learns from and interacts with. This can cause the AI system to deviate from its original design and purpose. AI model drift is a form of algorithmic bias that can have unintended consequences.

But I think the concerns about AI drift are overplayed. Language models like ChatGPT are the creation of an ever-evolving human mind. When ChatGPT first exploded into public consciousness, it was hailed as an incredible chatbot, a phenomenon. It amassed 100 million+ users in just two months of launch. Now when its user base is contracting and its performance is inconsistent on sundry occasions, questions have surfaced on its capabilities. I believe the performance of ChatGPT-like models is benchmarked against the swelling expectations of the users. We have known the array of things that ChatGPT can do- write a blog, formulate a GTM strategy or even compose a Shakespearean sonnet in a trice. 

ChatGPT

We were told that LLMs like ChatGPT would be insanely capable as time rolled on. What we weren’t told or did not realize is that even AI at its zenith can be fallible and vulnerable. They will be prone to some errors and flaws, just like you and me. When a master pianist loses her touch, a violinist hits an occasional sour note or an adept writer produces a below-par piece, don’t you dismiss them as aberrations? Why the same yardstick is then not applied to Generative AI models? If humans trip at their feet, the machines modelled by humans can stagger too.

These are still nascent days for LLMs. They are in the cradle of innovation. Let us give them ample time to mature and train them with data that is free of bias and inaccuracies. The quality of data you impart to any LLM will determine their output. That’s not something which a machine can control, it’s in the grip of a human behind the model. Just as a sponge soaks up both clear water and murky contaminants, these models absorb accurate data as well as bias. 

My point is not to debunk AI drift. We accept it as only a transient trend that will pass over soon. Just because a puny segment of the internet peddles misinformation and propaganda, would you recommend a ban on it? There should not be any trust deficit among stakeholders on the capabilities of AI models. Going ahead, they will be even more disruptive and transformational. The onus is on us to use Generative AI technology ethically and responsibly to enrich our lives. Here, the developers should make sure that the LLM is updated regularly and trained on high-quality data. They should appraise the LLM's performance and take corrective action if needed. Feedback loops from users and stakeholders are needed to spot if the AI model is straying from the intended purpose. No matter how capable an AI model is, human oversight is irreplaceable in critical decision-making processes to keep AI from drifting too far.

This blog was originally published in Priyadarshi Nanu Pany's LinkedIn account.

Image
AUTHOR:
Priyadarshi Pany

CEO & President

More Blog Posts from Priyadarshi Pany

Education - 3 MINS READ

Why B Schools Must Nurture Resilient Managers

Emerging Technologies - 3 MINS READ

Think ROI from Generative AI: Are we ready?

Smart City - 3 MINS READ

How Tier-II Cities Built The Tech Boom

Emerging Technologies - 2 MINS READ

Why You Should Switch to Green Coding for a net-zero Future

Social Registry - 3 MINS READ

Purpose over profit- Corporate Social Accountability is the new normal

Work Culture - 3 MINS READ

What companies are not talking on DEI

Emerging Technologies - 4 MINS READ

Tech in 2024- How do we separate signal from noise?

Emerging Technologies - 3 MINS READ

India can Lead Global Convergence on AI

Emerging Technologies - 2 MINS READ

How Generative AI can reboot Participatory Democracy

Work Culture - 4 MINS READ

The Big Takeaways from Indian IT’s Hiring Winter

Most Viewed Blog Posts

Mines & Minerals - 3 MINS READ

Digital Logistics for Pivoting To Mining 4.0

Mines & Minerals - 3 MINS READ

Big Data & Analytics For Mining Sector Transformation

Emerging Technologies - 3 MINS READ

Artificial Intelligence: The Future Is Here

Mines & Minerals - 3 MINS READ

Automated Industrial Inspections to Leapfrog Business Reforms

Emerging Technologies - 2 MINS READ

e-Governance: Adopting Agile Methodology

Digital Transformation - 3 MINS READ

How Digitization Reformed the Food Supply Chain in Odisha

Healthcare - 3 MINS READ

CoVaTrack: Tracking The Enigmatic Vaccine

Digital Transformation - 2 MINS READ

How This Budget with a Digital Pulse can Turnaround India

Blockchain - 1 MIN READ

Blockchain : The Trust Protocol for Data Integrity through Distributed Power

Emerging Technologies - 3 MINS READ

How Emerging Tech Can Empower Social Commerce


Subscribe
to our newsletter

Subscribe to have CSM's insights, articles, white papers delivered directly to your inbox. Privacy Policy


Join our exclusive newsletter community on Linkedin