The advent of large language models marks a revolutionary breakthrough in artificial
intelligence. With the unprecedented scale of training and model parameters, the capability …

Pre-trained Language Models (PLMs) which are trained on large text corpus via self-
supervised learning method, have yielded promising performance on various tasks in …

Modern language models capture a large body of factual knowledge. However, some facts
can be incorrectly induced or become obsolete over time, resulting in factually incorrect …

Foundation Models (FMs) are models trained on large corpora of data that, at very large
scale, can generalize to new tasks without any task-specific finetuning. As these models …

Large Language Models (LLMs) have taken Knowledge Representation--and the world--by
storm. This inflection point marks a shift from explicit knowledge representation to a renewed …

Language models are trained on large volumes of text, and as a result their parameters
might contain a significant body of factual knowledge. Any downstream task performed by …

Pop culture is an important aspect of communication. On social media people often post pop
culture reference images that connect an event, product or other entity to a pop culture …

Large amounts of training data are one of the major reasons for the high performance of
state-of-the-art NLP models. But what exactly in the training data causes a model to make a …

Symbolic knowledge graphs (KGs) have been constructed either by expensive human
crowdsourcing or with complex text mining pipelines. The emerging large pretrained …

Warning: This paper contains content that is offensive and may be upsetting. Biased or toxic
speech can be harmful to various demographic groups. Therefore, it is not only important for …