[PDF][PDF] PAL-BERT: an improved question answering model

W Zheng, S Lu, Z Cai, R Wang, L Wang… - Computer Modeling in …, 2023 - researchgate.net
In the field of natural language processing (NLP), there have been various pre-training
language models in recent years, with question answering systems gaining significant …

Using context-to-vector with graph retrofitting to improve word embeddings

J Zheng, Y Wang, G Wang, J Xia, Y Huang… - arXiv preprint arXiv …, 2022 - arxiv.org
Although contextualized embeddings generated from large-scale pre-trained models
perform well in many tasks, traditional static embeddings (eg, Skip-gram, Word2Vec) still …

Unsupervised simplification of legal texts

M Cemri, T Çukur, A Koç - arXiv preprint arXiv:2209.00557, 2022 - arxiv.org
The processing of legal texts has been developing as an emerging field in natural language
processing (NLP). Legal texts contain unique jargon and complex linguistic attributes in …

Distilling semantic concept embeddings from contrastively fine-tuned language models

N Li, H Kteich, Z Bouraoui, S Schockaert - Proceedings of the 46th …, 2023 - dl.acm.org
Learning vectors that capture the meaning of concepts remains a fundamental challenge.
Somewhat surprisingly, perhaps, pre-trained language models have thus far only enabled …

Semglove: Semantic co-occurrences for glove from bert

L Gan, Z Teng, Y Zhang, L Zhu, F Wu… - IEEE/ACM Transactions …, 2022 - ieeexplore.ieee.org
GloVe learns word embeddings by leveraging statistical information from word co-
occurrence matrices. However, word pairs in the matrices are extracted from a predefined …

Intelligent detection on construction project contract missing clauses based on deep learning and NLP

H Zhou, B Gao, S Tang, B Li, S Wang - Engineering, Construction and …, 2023 - emerald.com
Purpose The number of construction dispute cases has maintained a high growth trend in
recent years. The effective exploration and management of construction contract risk can …

A study on the effects of language and visual art integrated teaching on language learning performance and satisfaction of ethnic minority students in China

Y Zhang, S Jia - Frontiers in Psychology, 2022 - frontiersin.org
Innovative technological products are present in students' environments. Information
explosion and popularity are affecting their thoughts, and there is a large amount of …

FRGEM: Feature integration pre-training based Gaussian embedding model for Chinese word representation

Y Zhang, Y Liu, J Zhu, Z Chen, F Zhang - Expert Systems with Applications, 2025 - Elsevier
Most Chinese word representation approaches mine the lexeme of Chinese words by
predicting the target word or the contextual words. However, Chinese words may have …

[HTML][HTML] An efficient method for disaster tweets classification using gradient-based optimized convolutional neural networks with BERT embeddings

D Dharrao, MR Aadithyanarayanan, R Mital, A Vengali… - MethodsX, 2024 - Elsevier
Event of the disastrous scenarios are actively discussed on microblogging platforms like
Twitter which can lead to chaotic situations. In the era of machine learning and deep …

SGAN-SAM-ERNIE: A Novel and Effective Detection Scheme for Chinese Fake Reviews

M Zhang, Y Zhang, X Zhang - IEEE Access, 2024 - ieeexplore.ieee.org
Online reviews play a pivotal role in shaping consumer decisions on e-commerce platforms
and social media. Ensuring the authenticity and effectiveness of these reviews is essential …