Unified vision and dialogue transformer with BERT

Y Wang, CH Hoi, SR Joty - US Patent 11,562,147, 2023 - Google Patents
US11562147B2 - Unified vision and dialogue transformer with BERT - Google Patents
US11562147B2 - Unified vision and dialogue transformer with BERT - Google Patents Unified …

Systems and methods for distilled BERT-based training model for text classification

W Liu, KC Au, S Harinath, B McCann… - US Patent …, 2024 - Google Patents
Embodiments described herein provides a training mechanism that transfers the knowledge
from a trained BERT model into a much smaller model to approximate the behavior of BERT …

Phone-based sub-word units for end-to-end speech recognition

W Wang, Y Zhou, C Xiong - US Patent 11,328,731, 2022 - Google Patents
Abstract System and methods for identifying a text word from a spoken utterance are
provided. An ensemble BPE system that includes a phone BPE system and a character BPE …

Spatial-temporal reasoning through pretrained language models for video-grounded dialogues

H Le, CH Hoi - US Patent 11,487,999, 2022 - Google Patents
A system and method for generating a response in a video grounded dialogue are provided.
A video-grounded dialogue neural network language model receives video input and text …

Systems and methods for structured text translation with tag alignment

K Hashimoto, R Buschiazzo, J Bradbury… - US Patent …, 2023 - Google Patents
Approaches for the translation of structured text include an embedding module for encoding
and embedding source text in a first language, an encoder for encoding output of the …

Structured text translation

K Hashimoto, R Buschiazzo, J Bradbury… - US Patent …, 2022 - Google Patents
Approaches for the translation of structured text include an embedding module for encoding
and embedding source text in a first language, an encoder for encoding output of the …

Proposal learning for semi-supervised object detection

C Ramaiah, P Tang, C Xiong - US Patent 11,669,745, 2023 - Google Patents
US11669745B2 - Proposal learning for semi-supervised object detection - Google Patents
US11669745B2 - Proposal learning for semi-supervised object detection - Google Patents …

Systems and methods for out-of-distribution classification

GS Ramachandran, KC Au, S Harinath, W Liu… - US Patent …, 2022 - Google Patents
An embodiment provided herein preprocesses the input samples to the classification neural
network, eg, by adding Gaussian noise to word/sentence representations to make the …

Systems and methods for out-of-distribution classification

GS Ramachandran, KC Au, S Harinath, W Liu… - US Patent …, 2022 - Google Patents
An embodiment proposed herein uses sparsification tech niques to train the neural network
with a high feature dimension that may yield desirable in-domain detection accuracy but …

Electronic device, action instance generation method, and recording medium

JY Moon, YJ Kwon, HI Kim, JY Park, KM Bae… - US Patent …, 2022 - Google Patents
An electronic device according to an embodiment disclosed herein may include a memory
including at least one instruc tion and a processor. By executing the at least one instruc tion …