Autonomous vehicles (AVs) or self-driving cars have the potential to replace humanoperated cars. AVs can sense the environment and even navigate some of the roads in conditions humans find challenging. This may quickly lead to people’s overreliance on AVs and overconfidence that no failures will occur. Therefore, AVs can impact society positively and negatively. AVs are X-ware systems that consist of software, hardware, humans, and their interactions. Despite the large number of studies on AVs, there are still a large number of unsolved problems. One major challenge for AVs is communication with other vehicles on the road as well as pedestrians. Replacing some of the human-operated vehicles with AVs will require interactions between AVs and these other users of the transportation network. Most of the previous research efforts consider software failures, whereas few consider the role of humans in the current transition to a society in which self-driving cars predominate. This paper considers three points of view: I) the driver and passenger of the AV, II) pedestrians, and III) AV interaction with other users of the transportation network. We also discuss related studies on human behavior.