Pancreatic cancer is one of the leading causes of cancer mortality worldwide due to the lack of reliable tools for early diagnosis of this cancer. In this study, we evaluated the feasibility of micro-optical coherence tomography (μOCT) as an imaging tool for the diagnosis of pancreatic cancers. Specifically, we constructed a μOCT device that achieves a resolution of 1.67 ± 0.01 μm and 1.79 ± 0.01 μm in axial and lateral directions, respectively, and acquired three-dimensional μOCT images of mouse, rat, and human pancreatic specimens ex vivo. We compared the results of μOCT with those of the corresponding histology. In μOCT images of normal pancreatic specimens, the detailed cellular and subcellular-level pancreatic microstructures, e.g., the islet of Langerhans (IL), IL cell nuclei, blood vessels, and serous acini, could be clearly resolved in different cases. To the best of our knowledge, this study is the first to demonstrate that the cellular and subcellular structures of pancreatic tissues were identified using OCT. More importantly, we showed that these normal cellular-level structures were lost in μOCT images of cancerous specimens, demonstrating the feasibility of differentiating malignant lesions from normal tissues using μOCT. Moving forward, the development of an intraoperative imaging device may realize optical biopsies in vivo or real-time cellular-resolution examination of specimens from needle aspiration biopsies.