The natural ecology of human language is face-to-face interaction comprising the exchange
of a plethora of multimodal signals. Trying to understand the psycholinguistic processing of …

Cognition results from interactions among functionally specialized but widely distributed
brain regions; however, neuroscience has so far largely focused on characterizing the …

In late fusion, each modality is processed in a separate unimodal Convolutional Neural
Network (CNN) stream and the scores of each modality are fused at the end. Due to its …

The inherent challenge of multimodal fusion is to precisely capture the cross-modal
correlation and flexibly conduct cross-modal interaction. To fully release the value of each …

Behavior, perception and cognition are strongly shaped by the synthesis of information
across the different sensory modalities. Such multisensory integration often results in …

Neurological insults, such as congenital blindness, deafness, amputation, and stroke, often
result in surprising and impressive behavioural changes. Cortical reorganisation, which …

The ability to use cues from multiple senses in concert is a fundamental aspect of brain
function. It maximizes the brain's use of the information available to it at any given moment …

A growing body of evidence shows that ongoing oscillations in auditory cortex modulate
their phase to match the rhythm of temporally regular acoustic stimuli, increasing sensitivity …

Multisensory integration has often been characterized as an automatic process. Recent
findings indicate that multisensory integration can occur across various stages of stimulus …

How the neocortex works is a mystery. In this paper we propose a novel framework for
understanding its function. Grid cells are neurons in the entorhinal cortex that represent the …