In the U.S., those who lack broadband internet have limited ability to connect to care providers over a telemedicine video visit (VV). During the coronavirus disease pandemic, VVs have become increasingly common, but are not equitably accessible, which may exacerbate existing health disparities. Widening health disparities are of particular concern in the rural U.S. where broadband is lacking. Because public libraries are trusted sources of health information and typically offer free use of broadband internet to patrons, they can help bridge the digital health divide and assist patrons with VVs. However, no guidelines currently exist for care providers and libraries to implement this potentially complex undertaking. In this paper, we review concepts related to the digital health divide and its impact on telemedicine inequities, and propose a research framework for evaluating public libraries as potential hubs for residents living in broadband-poor communities to connect to a telemedicine VV. There is currently a paucity of research evaluating the use of libraries for telemedicine, although partnerships between libraries and health providers may be increasing. We use an established health implementation science framework to guide a research agenda to examine the reach, efficacy, adoption, implementation, and maintenance of collaborative programs between libraries and health providers intended to leverage public libraries to improve access to telemedicine VVs in broadband-poor communities. The use of public libraries as spaces from which patrons can participate in VVs with providers is promising, but research is urgently needed to guide implementation.