Many link prediction algorithms regarding single-layer social networks have been proposed, and however, how to predict interlayer links in multiplex social networks is still in the initial stage. In fact, the prediction of interlayer links in multiplex networks is of great significance, which is closely related to network security, product recommendation, social network mining, and so forth. Given that many social networks are sparse and the number of the first-order common matched neighbors (CMNs) is very few, it is not sufficient to implement link prediction only based on the first-order CMNs. Moreover, many social networks have scale-free property, leading to the roles of CMNs in link prediction which are significantly different. In doing so, we propose a second-order iterative degree penalty (SOIDP) algorithm to predict interlayer links in multiplex networks, in which the information of the first- and second-order CMNs is integrally considered, as well as a degree penalty mechanism is introduced to give larger weight to the CMNs with fewer connections. In particular, to solve the problem of cumulative error in the iterative process, we demonstrate that the interlayer links can be predicted by directly calculating the matching degree matrix without iteration. Experiments on real-world networks show that the performance of SOIDP algorithm in predicting interlayer links is always better than the baseline algorithms, and the accuracy is increased 10% at least. For synthetic networks, the improvement is also very surprising when networks are rather sparse.