Neural machine translation with latent tree attention

J Bradbury - US Patent 10,565,318, 2020 - Google Patents
We introduce an attentional neural machine translation model for the task of machine
translation that accomplishes the longstanding goal of natural language processing to take …

Sentinel gate for modulating auxiliary information in a long short-term memory (lstm) neural network

LU Jiasen, C Xiong, R Socher - US Patent 10,565,306, 2020 - Google Patents
The technology disclosed presents a novel spatial attention model that uses current hidden
state information of a decoder long short-term memory (LSTM) to guide attention and to …

Spatial attention model for image captioning

LU Jiasen, C Xiong, R Socher - US Patent 10,558,750, 2020 - Google Patents
The technology disclosed presents a novel spatial attention model that uses current hidden
state information of a decoder long short-term memory (LSTM) to guide attention and to …

Hierarchical and interpretable skill acquisition in multi-task reinforcement learning

C Xiong, SHU Tianmin, R Socher - US Patent 11,562,287, 2023 - Google Patents
US11562287B2 - Hierarchical and interpretable skill acquisition in multi-task reinforcement
learning - Google Patents US11562287B2 - Hierarchical and interpretable skill acquisition in …

Dense video captioning

Y Zhou, L Zhou, C Xiong, R Socher - US Patent 10,542,270, 2020 - Google Patents
Systems and methods for dense captioning of a video include a multi-layer encoder stack
configured to receive information extracted from a plurality of video frames, a proposal …

Adaptive attention model for image captioning

LU Jiasen, C Xiong, R Socher - US Patent 10,565,305, 2020 - Google Patents
The technology disclosed presents a novel spatial attention model that uses current hidden
state information of a decoder long short-term memory (LSTM) to guide attention and to …

Natural language processing using a neural network

B McCann, C Xiong, R Socher - US Patent 10,699,060, 2020 - Google Patents
A system includes a neural network for performing a first natural language processing task.
The neural network includes a first rectifier linear unit capable of executing an activation …

Sequence-to-sequence prediction using a neural network model

JEK Bradbury, J Gu - US Patent 11,604,956, 2023 - Google Patents
a given neural network model may be trained using a large number of training examples,
proceeding iteratively until the neural network model begins to consistently make similar …

Natural language processing using context specific word vectors

B McCann, C Xiong, R Socher - US Patent 10,817,650, 2020 - Google Patents
A system is provided for natural language processing. In some embodiments, the system
includes an encoder for generating context-specific word vectors for at least one input …

Multitask learning as question answering

NS Keskar, B McCann, C Xiong, R Socher - US Patent 11,501,076, 2022 - Google Patents
Approaches for multitask learning as question answering include a method for training that
includes receiving a plurality of training samples including training samples from a plurality …