Autonomous vehicle (AV) is considered a promising mode of transport that has been tested and deployed in various cities worldwide. However, research on how AVs will transform the field of transportation has been hindered by the heavy reliance on attitude measurements and the need for responses from the public who can better represent the future. This study investigates the autonomous taxi market in Huangpu District, Guangzhou, China, where paid and publicly available autonomous taxi service has been in operation for more than a year. This study analyzes 1,158 responses from pioneering and prospective users of autonomous taxi service. Latent class analysis is used to segment autonomous taxi users into classes to reveal the differences in their views on the potential uses of AVs. This study identifies three latent classes: neutral and diverse travelers, conservative and strict travelers, and open and enjoying travelers. Results show that sociodemographic characteristics, household characteristics, and current travel behavior affect the class membership in various means. In addition, users’ perceptions of the benefits and risks of autonomous driving vary across different latent classes. Findings from this study will help improve the quality of autonomous taxi service by enabling customized service based on mobility propensities. This study will also provide insights to help with future vehicle design and transportation policy making.