As a promising research area in Internet of Things (IoT), Internet of Vehicles (IoV) has attracted much attention in wireless communication and network. In general, vehicle localization can be achieved by the global positioning systems (GPSs). However, in some special scenarios, such as cloud cover, tunnels or some places where the GPS signals are weak, GPS cannot perform well. The continuous and accurate localization services cannot be guaranteed. In order to improve the accuracy of vehicle localization, an assistant vehicle localization method based on direction-of-arrival (DOA) estimation is proposed in this paper. The assistant vehicle localization system is composed of three base stations (BSs) equipped with a multiple input multiple output (MIMO) array. The locations of vehicles can be estimated if the positions of the three BSs and the DOAs of vehicles estimated by the BSs are known. However, the DOA estimated accuracy maybe degrade dramatically when the electromagnetic environment is complex. In the proposed method, a sparse Bayesian learning (SBL)-based robust DOA estimation approach is first proposed to achieve the off-grid DOA estimation of the target vehicles under the condition of nonuniform noise, where the covariance matrix of nonuniform noise is estimated by a least squares (LSs) procedure, and a grid refinement procedure implemented by finding the roots of a polynomial is performed to refine the grid points to reduce the off-grid error. Then, according to the DOA estimation results, the target vehicle is cross-located once by each two BSs in the localization system. Finally, robust localization can be realized based on the results of three-time cross-location. Plenty of simulation results demonstrate the effectiveness and superiority of the proposed method.