Cracks in buildings are a source of concern as they may indicate structural problems. Cracks in buildings are one of the major problems with concrete structures, as they affect the appearance of the building, compromise the integrity of the masonry, jeopardize building safety, and reduce the durability of the structure. Cracks in buildings can be a cause for concern and may indicate a potential structural problem that could jeopardize the safety and stability of the building. Understanding the root causes of these cracks is crucial to determining appropriate preventive measures and repair methods. In this study, crack and slope control in buildings was performed with an image processing-based measurement system developed using CNN deep learning algorithms. A dataset of 294 photographs was used for the study. The data were subjected to image processing, preprocessing, and detection with CNN. The accuracy rate is 0.9716 for the VGG-16 architecture and 0.9513 for the Inception-V3 architecture. It was concluded that there is no significant difference between the accuracy rates of the architectures. All vertical and horizontal cracks with a thickness of 2 mm and a continuity of 4 cm were detected. Thus, crack control in buildings can be done quickly and reliably, and building safety will be ensured.