Efficient decoding of output sequences using adaptive early exiting

T Schuster, AJ Fisch, JP Gupta, M Dehghani… - US Patent …, 2024 - Google Patents
Methods, systems, and apparatus, including computer programs encoded on computer
storage media, for generating output sequences using auto-regressive decoder neural …