Artificial Intelligence bot ChatGPT underperforms in India’s top engineering exam, highlighting limitations in current AI technology.
The Joint Entrance Examination (JEE) Advanced is an annual test conducted to determine admission into prestigious undergraduate engineering programs at top institutions such as the Indian Institutes of Technology (IITs). Considered one of the most difficult entrance exams globally, it attracts lakhs of students each year. However, OpenAI’s ChatGPT, an AI chatbot known for answering a wide range of queries, has failed to clear the JEE Advanced exam.
ChatGPT’s JEE Advanced Performance
According to a report by Livemint, ChatGPT attempted the JEE Advanced exam and received a negative score. It managed to solve only 11 questions across both papers. Furthermore, the AI bot scored 359 out of 800 in the National Eligibility cum Entrance Test (NEET), a medical entrance exam, with a total of 200 questions. While ChatGPT outperformed in the biology section, it only managed to achieve an overall 45% score.
The Limitations of AI Technology
ChatGPT’s underwhelming performance in these exams highlights the limitations of current AI technology. Although the chatbot has been trained on vast amounts of data, it still struggles to handle the complexity and challenges posed by competitive entrance examinations like the JEE Advanced and NEET. Some experts refer to this as the AI “hallucinating,” indicating that the technology remains in its nascent stage.
However, the buzz around ChatGPT continues to grow, primarily due to its ability to answer “almost anything” conversationally. Developed by AI non-profit OpenAI Inc., the chatbot is designed to engage in dialogue, answer follow-up questions, admit mistakes, and challenge incorrect premises. This revolutionary approach has garnered praise from many, including Microsoft co-founder Bill Gates.
What This Means for AI’s Future in Academia
ChatGPT’s inability to excel in competitive entrance exams serves as a reality check for AI’s role in academia. While the chatbot can provide valuable insights and answers to a vast range of queries, it still has limitations when it comes to complex problem-solving and critical thinking. The JEE Advanced and NEET results demonstrate that AI is not yet a substitute for human intelligence in areas requiring higher-order cognitive skills.
The Ongoing Development of AI Technology
Despite its limitations, the development of AI technology like ChatGPT continues to advance at a rapid pace. As researchers refine and improve upon AI models, it is likely that future iterations will be better equipped to handle complex academic challenges. For now, however, ChatGPT’s performance serves as a reminder that the technology still has a long way to go before it can fully compete with human intelligence in competitive examinations and other high-stakes academic settings.
Fantastic put up, very informative. I ponder why the other experts of this sector don’t understand this. You must proceed your writing. I am confident, you’ve a great readers’ base already!|What’s Taking place i am new to this, I stumbled upon this I have discovered It positively helpful and it has helped me out loads. I hope to give a contribution & aid different users like its helped me. Great job.