Abstract Chat Generative Pre-trained Transformer (ChatGPT) has gained significant interest
and attention since its launch in November 2022. It has shown impressive performance in …

Large language models (LLMs) are a special class of pretrained language models (PLMs)
obtained by scaling model size, pretraining corpus and computation. LLMs, because of their …

Over the last few years, large language models (LLMs) have emerged as the most important
breakthroughs in natural language processing (NLP) that fundamentally transform research …

Despite the existence of various benchmarks for evaluating natural language processing
models, we argue that human exams are a more suitable means of evaluating general …

This paper presents an exhaustive quantitative and qualitative evaluation of Large
Language Models (LLMs) for Knowledge Graph (KG) construction and reasoning. We …

Prompt engineering is a critical technique in the field of natural language processing that
involves designing and optimizing the prompts used to input information into models, aiming …

The study aimed to evaluate the performance of two Large Language Models (LLMs):
ChatGPT (based on GPT-3.5) and GPT-4 with two temperature parameter values, on the …

The development of open-source, multilingual medical language models can benefit a wide,
linguistically diverse audience from different regions. To promote this domain, we present …

Media coverage suggests that ChatGPT can pass examinations based on multiple choice
questions (MCQs), including those used to qualify doctors, lawyers, scientists etc. This poses …

Background. There has been significant interest in the performance of ChatGPT on
professional exams 11 used to assess doctors, scientists and others. These exams are …