Maximum entropy regularization and chinese text recognition

C Cheng, W Xu, X Bai, B Feng, W Liu - … , DAS 2020, Wuhan, China, July 26 …, 2020 - Springer
Document Analysis Systems: 14th IAPR International Workshop, DAS 2020, Wuhan …, 2020Springer
Chinese text recognition is more challenging than Latin text due to the large amount of fine-
grained Chinese characters and the great imbalance over classes, which causes a serious
overfitting problem. We propose to apply Maximum Entropy Regularization to regularize the
training process, which is to simply add a negative entropy term to the canonical cross-
entropy loss without any additional parameters and modification of a model. We theoretically
give the convergence probability distribution and analyze how the regularization influence …
Abstract
Chinese text recognition is more challenging than Latin text due to the large amount of fine-grained Chinese characters and the great imbalance over classes, which causes a serious overfitting problem. We propose to apply Maximum Entropy Regularization to regularize the training process, which is to simply add a negative entropy term to the canonical cross-entropy loss without any additional parameters and modification of a model. We theoretically give the convergence probability distribution and analyze how the regularization influence the learning process. Experiments on Chinese character recognition, Chinese text line recognition and fine-grained image classification achieve consistent improvement, proving that the regularization is beneficial to generalization and robustness of a recognition model.
Springer
以上显示的是最相近的搜索结果。 查看全部搜索结果