The chaotic dynamics of fractional-order systems has attracted much attention recently. Chaotic synchronization of fractional-order systems is further studied in this paper. We investigate the chaos synchronization of two identical systems via a suitable linear controller applied to the response system. Based on the stability results of linear fractional-order systems, sufficient conditions for chaos synchronization of these systems are given. Control laws are derived analytically to achieve synchronization of the chaotic fractional-order Chen, Rössler and modified Chua systems. Numerical simulations are provided to verify the theoretical analysis.