Neural networks are widely used for almost any task of recognizing image content. Even
though much effort has been put into investigating efficient network architectures, optimizers …