In the light of recent events, an epidemic - COVID-19 which took the world by surprise and continues to grow day by day. This paper describes an idea to control the spread of disease by monitoring Social Distancing. As of now from where we stand, the only way to avoid further spreading is to maintain proper social distance. Combining the advanced detection algorithms such as SSD, YOLO v4, and Faster-RCNN along with pedestrian datasets we reached the desired conclusion of calculating the distance between two detected persons in a video and identifying whether the social distancing norm is followed or not. This method can be implemented in CCTV’s, UAV’s, and on any other surveillance system. The rapid advancements in technologies led to more precise and accurate values.