Heterogeneous contrastive learning for foundation models and beyond

L Zheng, B Jing, Z Li, H Tong, J He - Proceedings of the 30th ACM …, 2024 - dl.acm.org
In the era of big data and Artificial Intelligence, an emerging paradigm is to utilize contrastive
self-supervised learning to model large-scale heterogeneous data. Many existing foundation …

Introduction to mathematical language processing: Informal proofs, word problems, and supporting tasks

J Meadows, A Freitas - Transactions of the Association for …, 2023 - direct.mit.edu
Automating discovery in mathematics and science will require sophisticated methods of
information extraction and abstract reasoning, including models that can convincingly …

Dq-lore: Dual queries with low rank approximation re-ranking for in-context learning

J Xiong, Z Li, C Zheng, Z Guo, Y Yin, E Xie… - arXiv preprint arXiv …, 2023 - arxiv.org
Recent advances in natural language processing, primarily propelled by Large Language
Models (LLMs), have showcased their remarkable capabilities grounded in in-context …

Multimodal self-instruct: Synthetic abstract image and visual reasoning instruction using language model

W Zhang, Z Cheng, Y He, M Wang, Y Shen… - arXiv preprint arXiv …, 2024 - arxiv.org
Although most current large multimodal models (LMMs) can already understand photos of
natural scenes and portraits, their understanding of abstract images, eg, charts, maps, or …

Self-contrast: Better reflection through inconsistent solving perspectives

W Zhang, Y Shen, L Wu, Q Peng, J Wang… - arXiv preprint arXiv …, 2024 - arxiv.org
The reflection capacity of Large Language Model (LLM) has garnered extensive attention. A
post-hoc prompting strategy, eg, reflexion and self-refine, refines LLM's response based on …

An expression tree decoding strategy for mathematical equation generation

W Zhang, Y Shen, Q Nong, Z Tan, Y Ma… - arXiv preprint arXiv …, 2023 - arxiv.org
Generating mathematical equations from natural language requires an accurate
understanding of the relations among math expressions. Existing approaches can be …

Towards robust automated math problem solving: a survey of statistical and deep learning approaches

A Saraf, P Kamat, S Gite, S Kumar, K Kotecha - Evolutionary Intelligence, 2024 - Springer
Automated mathematical problem-solving represents a unique intersection of natural
language processing (NLP) and mathematical reasoning, posing significant challenges in …

Number-enhanced representation with hierarchical recursive tree decoding for math word problem solving

Y Zhang, G Zhou, Z Xie, JX Huang - Information Processing & Management, 2024 - Elsevier
Automatic solving math word problems (MWPs) is a number-intensive application in natural
language processing (NLP). However, these existing methods are far from achieving …

Text2MDT: extracting medical decision trees from medical texts

W Zhu, W Li, X Tian, P Wang, X Wang, J Chen… - arXiv preprint arXiv …, 2024 - arxiv.org
Knowledge of the medical decision process, which can be modeled as medical decision
trees (MDTs), is critical to build clinical decision support systems. However, the current MDT …

[PDF][PDF] Don't be Blind to Questions: Question-Oriented Math Word Problem Solving

Z Liang, J Zhang, X Zhang - … and the 3rd Conference of the Asia …, 2023 - aclanthology.org
Solving math word problems (MWP) is a challenging task for natural language processing
systems, as it requires to not only identify and comprehend the problem description within …