Background and Objectives: The COVID-19 pandemic has had a considerable impact on inflammatory bowel disease (IBD) patients by limiting their access to medical services due to restrictions and the reorganization of the healthcare systems, which affects their quality of life (QoL). We aimed to assess the impact of the COVID-19 pandemic on the QoL of patients with IBD. Materials and Methods: We conducted a descriptive observational study, which included 90 adult patients diagnosed with IBD. The study sample consisted of two subgroups: a retrospective-pre-pandemic group (group A) and a prospective-pandemic group (group B). Group A included 45 IBD patients who were evaluated in 2018. Group B included 45 patients with confirmed diagnosis of IBD, evaluated between June and December 2021—the period of the COVID-19 pandemic (prospective), consecutively recruited. All the patients filled in a QoL assessment questionnaire—IBDQ-32. Subsequently, the two samples were comparatively assessed. Results: The average values of the IBDQ scores were significantly lower in 2021 compared to those recorded in 2018: 145.56 vs. 128.3 (p < 0.05). We also we found significant differences between the subscores: IBDQ1 (p = 0.043), IBDQ2 (p = 0.034), IBDQ3 (p = 0.045), IBDQ4 (p = 0.025). Conclusions: IBDQ scores were significantly lower in 2021 compared to 2018 (p < 0.05), showing that during the COVID-19 pandemic, patients with IBD had a more influenced QoL.