Abstract
Objective
Study design
Results
Conclusions
Implications
Keywords
1. Introduction
- Miech E.J.
- Rattray N.A.
- Flanagan M.E.
- Damschroder L.
- Schmid A.A.
- Damush T.M.
2. Material and methods
2.1 Theoretical framework
2.2 Study setting
United States Census Bureau. Urban and Rural 2021;. https://www.census.gov/programs-surveys/geography/guidance/geo-areas/urban-rural.html. [Accessed 15 Jan 2021]
2.3 Sample and recruitment
2.4 Data collection
Site # | #. interviewed | Approx. # patients served | Clinic location (urban, suburban, rural) | Patient location (urban, suburban, rural) | Guttmacher Institute abortion policy classification | Clinic Size (# of clinicians in practice) |
---|---|---|---|---|---|---|
Independent primary care providers (independent PCPs) | ||||||
1 | 1 | 500 | Urban | Urban, Suburban, Rural | Supportive | 1 |
2 | 1 | 380 | Rural | Urban, Suburban, Rural | Supportive | 1 |
3 | 1 | No data | No data | No data | Leans supportive | 1 |
4 | 1 | 0 | Suburban | No data | Supportive | 2-10 |
5 | 1 | 0 | Suburban | Suburban, Rural | Leans Supportive | 1 |
6 | 1 | 0 | Urban | Urban | Supportive | 2-10 |
Telemedicine only web-based healthcare clinics (online clinic) | ||||||
7 | 2 | 100 | Online | Urban Suburban Rural | Supportive | 2-10 |
8 | 1 | 3,000 | Online | No data | Multi-state (Leans Supportive, Leans Hostile) | 11-50 |
9 | 2 | 75 | Online | Rural | Leans Supportive | 1 |
Specialized family planning clinics (family planning clinics) | ||||||
10 | 1 | 136 | Urban | Urban, Suburban, Rural | Leans Supportive | 2-10 |
11 | 1 | 30 | Rural | Rural | Leans Supportive | 1 |
12 | 5 | 130 | Urban | No data | Supportive | 11-50 |
13 | 1 | 0 | No data | No data | Leans Hostile | 1 |
Primary care clinics within multispecialty health systems (health system) | ||||||
14 | 1 | 30 | Urban | Urban, Suburban | Leans Supportive | >50 |
15 | 1 | 1 | Urban | Urban | Supportive | >50 |
2.5 Analysis
SocioCultural Research Consultants, L. Dedoose - Web application for managing, analyzing, and presenting qualitative and mixed method research data 2021; http://www.dedoose.com. [Accessed 01 Feb 2021]
2.6 Ethical considerations
3. Results

3.1 Implementation factors outside the clinic site
3.1.1 Access to formal and informal inter-organizational networks
Supporting organization | Definition | Funding | Regulatory compliance | Medical protocols | Model of service | Service operations | Referrals | Community |
American Civil Liberties Union (ACLU) | Offers information about laws, regulations, and litigation related to abortion access and rights | • | ||||||
Gynuity Health Projects | Provides research and technical assistance on reproductive health technologies with on-going research on telehealth abortion care | • | ||||||
MYA Network | Supports primary care-based clinicians offer abortion care and connects patients to these services | • | • | • | ||||
National Abortion Federation (NAF) | Professional association of abortion providers which represents and supports abortion providers in delivering care | • | • | • | • | • | • | |
Plan C | Provides operational technical assistance to medication abortion providers | • | • | • | • | • | ||
Reproductive Health Access Project (RHAP) | Mobilizes, trains, and supports clinicians to make reproductive health care accessible | • | • | • | • | |||
Resources for Abortion Delivery (RAD) | Protects, supports, and improves the abortion care delivery system through funding, technical, and legal assistance | • | • |
Implementation factors | Factor definition | Practice setting | Representative quotes | |
1 | Implementation factors outside the clinic site | |||
1 | Access to formal and informal inter-organizational networks | The degree to which the clinical organization is connected with other external organizations or individuals. These include both formal and informal inter-organizational connections. Often participants receive financial or technical support from professional organizations committed to supporting service implementation. Participants also cited support from individuals at other provider sites already working though the implementation process for a similar service. In both cases, external supports offered suggestions or guidance for how to implement services. | Independent PCP and Family Planning clinic practice settings benefited more from inter-organizational supports. | Physician, Independent PCP …because we are such a small practice, things get done very much by the seat of the pants…(A mentor at a large FP clinic in another state) suggested to get our friends to start trying to make appointments and just see what doesn't work (and go from there)…she has saved me many hours, so even just simple (advice) like, this is the language you need to use with your malpractice when asking questions. It's so helpful. |
2 | External policies and protocols | External recommendations or guidelines for clinical practice and service delivery. Common supports included specific documents and protocols supported and published by reputable sources, which participants drew on and adapted for their own internal implementation and service design. | No difference between practice settings. | Physician, Health System The consensus statement that was published in Contraception early in the pandemic, with a suggested protocol, was really helpful because we were trying to do those things. And I was trying to say, ‘oh, there's evidence, it's okay.’ (Our clinical leader) is going to feel much better if something in a journal article saying to do this. Because there's nobody else in [my city] is doing this. Physician, Family Planning Clinic I think having a protocol that was published by NAF, and approved by a lot of important clinical groups, is extremely helpful.to make the case that we are providing standard of care. So, without changes to the NAF clinical guidelines to accommodate telemedicine, I'm sure we would have been a lot more hesitant. But in terms of liability, it makes a huge difference when our groups that set the standard of care are condoning the really low risk of taking on telemedicine as part of our practice. |
2 | Implementation factors from inside the clinic site | |||
1 | Leadership Engagement | Commitment, involvement, and accountability of leaders and managers, at any level of the organization with the implementation of the service. Also includes committees within a health system. Leadership support is essential for the service, even if they are not involved in the implementation itself. | Health system and Independent PCP practice settings required additional efforts such as educational sessions, regular meetings to gather support and buy-in. | Physician, Independent PCP ...my 2 bosses said everyone should be fine with (telehealth medication abortion)…We are meeting with the higher-ups of the organization, to talk about (the strategic plan of the service)… about how administration will find these services. I've been told there shouldn't be really any pushback, but we do have a meeting this week to just introduce that we're doing this. Physician, Health System We have a reproductive health committee that meets once a month. That's across all practices, and disciplines…people from social work, billing, IT, and reproductive health providers…we deal with all different things, like changes in protocol, and deciding to move to a no-touch for medication abortion…We submit the changed protocol to our administrative clinical group and they have to approve it…And then they have another clinical directors meeting and those meetings are sometimes a presentation by someone in the leadership about any particular issue, (such as this service). |
2 | Organizational readiness for implementation | The level of resources dedicated for service implementation and on-going operations. For telehealth abortion, this includes EHR, mailing capacity, and professional liability insurance. | Online clinic and health system practice settings were able to pivot quickly to address these needs, whereas practices with paper-based systems required more adapting. | Physician, Family Planning Clinic …the thing that took the longest for us was getting our paperwork online... medical history, sign consent forms and make payments online, because we are pretty low-tech clinic, we do not use electronic medical records, we have all paper charts. And so just figuring out the technology and having staff time to actually build a web form, and to get everything functioning online was really our biggest hurdle…it takes time to get all of those forms built, functional and user friendly...And so that took us around 6 weeks, start to finish. Just going through multiple iterations of having all of our legal paperwork and parental consents, and documentation for folks who have Medicaid…(Our whole team worked on) changing our paperwork to reflect telemedicine. |
3 | Clinic staff access to knowledge and information | Clinic staff's access to educational information, including colleagues, and knowledge about the service and how to incorporate it into work tasks for smooth roll-out. When timely and pertinent training is involved, a new service is more likely to be successful. | Independent PCP and online clinic practice settings often required less training, whereas larger clinics (> 10 clinicians) with multiple sites needed ongoing efforts to implement the service. | Physician, Independent PCP There's a lot of information about medication abortion and protocols...that I'm going to be training the staff on...Then it's a matter of, getting the rest of the staff comfortable with the whole no-touch part of it...I've really been starting informal conversations to talk to the other providers, like, "You don't need an ultrasound. You don't need a follow-up appointment.” … I hope to do more training like values clarification with the rest of the staff…Right now, the social workers do a lot of options counseling and we refer patients out that need abortion care...It'll be a shift in training that we can offer these services… |
3 | Characteristics of clinic site champions | |||
1 | Provider and staff self-efficacy | Providers or staff who believe in their own ability to accomplish required actions to achieve service implementation goals. Staff with high self-efficacy, or site “champions” are more likely to make a decision to embrace the changes of a new service and stay fully committed even in the face of difficult challenges and obstacles. | Nearly all sites had a champion implementor with high self-efficacy. No difference between practice settings. | Administrator, Online Clinic (When I was setting up the service) everything was, "It can't be done, it can't be done." And if I hadn't been as stubborn as I am, I don't know that I would still be where I am today…this is just my nature. I really care about the project, I feel like telehealth abortion had great potential to open up care in these (rural) areas, and I really believed in it…There's no financial resources. When you have an idea, you have to kind of prove yourself. I'm putting a ton of my money into starting this nonprofit. We're seeing a lot of patients and a lot of patients have these amazing stories about why they couldn't have gotten care without us. And it's all worth it now…I would (now) like to be that supportive person for someone else. Physician, Independent PCP … I tend to be somebody who makes decisions going, this is the right thing to do, and weighing of some of the benefits and risks, but not spending a ton of time in the minor details of the risks and benefits. |
2 | Individual identification with organizations | These family medicine providers are heavily committed to the missions of their clinical organizations, which gives them a deep willingness to engage with service implementation. This includes their commitment to provide “whole person care,” and use of their skillset to provide full spectrum care services to all patients who desire it. | Primary care practice settings, both Independent PCPs and health systems, exhibited strong ethic around ability to provide whole person care. | Physician, Independent PCP … I think it really just goes along with being a family medicine doctor, in regard to looking at the whole person, offering the full spectrum of services, from prenatal care to abortion care, and thinking of the reproductive justice lens, and giving patients the option to be parents if they want to, or not want to. I think the less we have to refer our patients to other places, the better...we take care of a lot of underinsured, undocumented and Medicaid patients, so, it can be hard getting them the services that they need. The more we can do that in-house, the better, just to provide equitable care. |
3 | Staff and provider understanding and beliefs about telehealth medication abortion service | Clinical staff and providers’ level of enthusiasm about the new service, and their attitudes and value towards it. Values towards this service included providing patients with options, closing a service gap, addressing their clinical needs, and empowering patients to make choices. | No difference between practice settings. | Physician, Independent PCP To me, abortion care…is about options and choices and having people live each day or make their choices so that they can live their life the way they want to live it. Nurse Practitioner, Independent PCP This is my fight and my passion all my life is just to make abortion accessible and to have a choice to have children or to not have children, a reality for all women to allow us to become our fullest people and live our fullest potential. It's just been a long-time passion of mine.…I'm also just a real big passionate believer that it should just be part of family practice. It really is just an extension of what we do, we treat families and all their needs, why wouldn't this be part of that?….I love putting power in women's hands...that's what this service is doing. |
4 | Other personal attributes of champions | Personal traits of telehealth abortion providers and staff that include a tolerance of ambiguity, intellectual ability, competence levels, and learning style, such as the drive to practice evidence-based medicine. They hold strong ethics to eliminate extraneous procedures (ultrasound) or requirements to be in-person that may cause hardships on the patient (generally and during COVID-19). | No difference between practice settings; shared value among participants. | Nurse Practitioner, Family Planning Clinic It's just so nice to be able to provide an easy access service to patients...We don't have to worry that a patient is waiting, we don't have to worry that a patient is having to go through all these...unnecessary steps. In some cases, it feels like the ultrasound and the lab is unnecessary, just because we're able to do it without it now…for me as a provider, knowing that we can reach more people and provide this service in less time to patients, it's huge. Administrator, Online Clinic I had known about the no touch protocols that were coming out from the study in Contraception…and being a NAF member, I knew they changed...to endorse no touch medication abortion. ...we wanted to do that as a way to really make the appointment more convenient for the patient and allow the patient to really be the center of our focus, rather than, in a traditional abortion clinic a lot of times patients are scheduled at the convenience of the doctor...really in all our implementation, we are trying to make things more patient centered. |
3.1.2 External policies and protocols
3.2 Implementation factors from inside the clinic site
3.2.1 Leadership engagement
3.2.2 Organizational readiness for implementation
3.2.3 Clinic staff access to knowledge and information
3.3 Characteristics of clinic site champions
3.3.1 Provider and staff self-efficacy
3.3.2 Individual identification with organization
3.3.3 Staff and provider understanding and beliefs about telehealth medication abortion service
3.3.4 Other personal attributes of champions
4. Discussion
- Aiken A.
- Lohr P.A.
- Lord J.
- Ghosh N.
- Starling J.
Declaration of Competing Interest
Funding
Acknowledgments
Appendix. Supplementary materials
References
- Commentary: No-test medication abortion: A sample protocol for increasing access during a pandemic and beyond.Contraception. 2020; 101: 361-366https://doi.org/10.1016/j.contraception.2020.04.005
- American College of Obstetricians and Gynecologists vs United States Food and Drug Administration in Case no 8:20-cv-1320-TDC, United States District Court For the District of Maryland.2020
- Improving medical practice: a conceptual framework.Ann Fam Med. 2007; 5: 251-256
- The answer is 17 years, what is the question: understanding time lags in translational research.J R Soc Med. 2011; 104: 510-520
- Dissemination and implementation research in health : translating science to practice.Oxford University Press, Oxford; New York2012
- Committee on Quality of Health Care in America, in Crossing the quality chasm: A new health system for the 21st century.in: National Academy of Sciences. National Academies Press, US): Washington (DC2001: 360
- The influence of context on quality improvement success in health care: a systematic review of the literature.Milbank Q. 2010; 88: 500-559https://doi.org/10.1111/j.1468-0009.2010.00611.x
- Inside help: An integrative review of champions in healthcare-related implementation.SAGE Open Med. 2018; 62050312118773261https://doi.org/10.1177/2050312118773261
- Delivery of clinical preventive services in family medicine offices.Ann Fam Med. 2005; 3: 430-435https://doi.org/10.1370/afm.345
- Initiating abortion training in residency programs: issues and obstacles.Fam Med. 2006; 38: 330-335
- A compilation of strategies for implementing clinical innovations in health and mental health.Med Care Res Rev. 2012; 69: 123-157https://doi.org/10.1177/1077558711430690
- Access delivered: a toolkit for providers offering medication abortion.University of Washington, 2020 ([cited 2021 January 29])https://www.familymedicine.uw.edu/accessdeliveredVersion: 1Date: 2020Date accessed: January 29, 2021
- Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science.Implement Sci. 2009; 4: 50https://doi.org/10.1186/1748-5908-4-50
- Demonstrating rigor using thematic analysis: a hybrid approach of inductive and deductive coding and theme development.Int J Qual Methods. 2006; 5: 80-92https://doi.org/10.1177/160940690600500107
United States Census Bureau. Urban and Rural 2021;. https://www.census.gov/programs-surveys/geography/guidance/geo-areas/urban-rural.html. [Accessed 15 Jan 2021]
- Policy analysis. State abortion policy landscape: from hostile to supportive.Guttmacher Institute, New York2019 (https://www.guttmacher.org/article/2019/08/state-abortion-policy-landscape-hostile-supportive)
- Purposeful sampling for qualitative data collection and analysis in mixed method implementation research.Adm Policy Ment Health. 2015; 42: 533-544https://doi.org/10.1007/s10488-013-0528-y
- Medication abortion provided through telemedicine in four U.S. states.Obstet Gynecol. 2019; 134: 343-350https://doi.org/10.1097/aog.0000000000003357
- Introduction of telemedicine for medication abortion: changes in service delivery patterns in two U.S. states.Contraception. 2021; 103: 151-156https://doi.org/10.1016/j.contraception.2020.12.005
- Research electronic data capture (REDCap)–a metadata-driven methodology and workflow process for providing translational research informatics support.J Biomed Inform. 2009; 42: 377-381https://doi.org/10.1016/j.jbi.2008.08.010
- Chapter 3: Designing the Study.Qualitative methods in public health : a field guide for applied research. Josey Bass, San Francisco, CA2016: 139-169
SocioCultural Research Consultants, L. Dedoose - Web application for managing, analyzing, and presenting qualitative and mixed method research data 2021; http://www.dedoose.com. [Accessed 01 Feb 2021]
- Integrating abortion training into family medicine residency programs.Fam Med. 2007; 39: 337-342
- An introduction to implementation science for the non-specialist.BMC Psychol. 2015; 3: 32https://doi.org/10.1186/s40359-015-0089-9
- TelAbortion: evaluation of a direct to patient telemedicine abortion service in the United States.Contraception. 2019; 100: 173-177https://doi.org/10.1016/j.contraception.2019.05.013
- Ensuring safe access to mifepristone during the pandemic and beyond.Ann Intern Med. 2021; 174: 105-106https://doi.org/10.7326/m20-6671
- Sixteen years of overregulation: time to unburden mifeprex.N Engl J Med. 2017; 376: 790-794https://doi.org/10.1056/NEJMsb1612526
- Effectiveness, safety and acceptability of no-test medical abortion provided via telemedicine: a national cohort study.BJOG. 2021; (In press)https://doi.org/10.1111/1471-0528.16668
- Telehealth interventions to improve obstetric and gynecologic health outcomes: a systematic review.Obstet Gynecol. 2020; 135: 371-382https://doi.org/10.1097/aog.0000000000003646