Abstract
Objective
To reduce the Quality of Contraceptive Counseling (QCC) scale to a shortened version, coined the QCC-10, for use in measuring client-reported quality of counseling across varied settings.
Study design
Secondary psychometric analysis of data collected for validating full versions of the QCC scale (QCC-Mexico, QCC-Ethiopia, QCC-India) and expert voting to reduce the original 26 QCC items to a 10-item set.
Results
Exploratory factor analysis revealed a clear one-factor solution for the QCC-10 in each country. Factor loadings were consistently >0.4 for all but two items; both were retained due to their importance to content validity. Internal consistency reliability of the QCC-10 was α=0.8 in Mexico and Ethiopia, and α=0.5 in India. QCC-10 scores were highly and positively correlated with a dichotomous overall measure of client experience and intention to initiate selected method, indicating convergent validity.
Conclusion
The QCC-10 offers an innovative, cross-cultural approach to measuring quality in contraceptive counseling. Future efforts should examine its validity and reliability for use globally, with additional exploration of how to best measure negative aspects of care, particularly in India where such items were problematic. Thoughtful, nuanced measurement of client perspectives on their counseling experiences, available via the QCC-10, is critical to monitoring and improving quality of person-centered care and the fulfilment of human rights in contraceptive services worldwide.
Implications
Cross-cultural, person-centered measures of quality in contraceptive counseling, such as the QCC-10, can help inform efforts to improve quality of family planning services and fulfillment of human rights. Future work will continue to explore the validity of this 10-item measure for use in various settings.
Keywords
1. Introduction
The provision of high-quality contraceptive services is necessary to protecting individuals’ reproductive autonomy, health, and human rights [
[1]
,[2]
]. Despite rising clinical and public health focus on quality and patient-centeredness [3
, 4
, Crossing the quality chasm: a new health system for the 21st century | The BMJ [Internet]. [Available from: https://www.bmj.com/content/323/7322/1192.1.full. Accessed November 19, 2021
5
], measurement of client experience has proved challenging given the range of both clinical and interpersonal elements required for high-quality counseling and the context-specific nature of what individuals value in clinical encounters [[6]
,[7]
]. Further, integration of human rights principles into conceptualizations of quality and related measures is relatively recent [“Measuring quality of care: A review of previously used methodologies a” by Katherine Tumlinson [Internet]. Available from: https://knowledgecommons.popcouncil.org/departments_sbsr-rh/679/. Accessed August19, 2021
[8]
].The Quality of Contraceptive Counseling (QCC) scale addresses these gaps by examining the extent to which contraception clients perceive services as delivered according to their informational and interpersonal needs and in accordance with their human rights. QCC scale domains include client report of decisional support around method options (information exchange); interpersonal relationship with the provider, including protection of privacy and time for decision-making (interpersonal relations); and fulfilment of human rights, including respect for client autonomy (disrespect and abuse). The QCC scale was originally developed in Mexico [
[9]
] and then adapted and validated for use in Ethiopia and India [[10]
]. Extensive formative research was conducted in these countries to ensure items were grounded in women's preferences for counseling [11
, 12
, 13
].Understanding quality of contraceptive services from women's perspectives in Gujarat, India: a focus group study | BMJ Open [Internet]. Available from: https://bmjopen.bmj.com/content/11/10/e049260.abstract. Accessed November 19, 2021
The three validated QCC scale versions (QCC-Mexico, QCC-Ethiopia, QCC-India) have 22 to 26 items, depending on the context [
[9]
,[10]
]. These original versions of the scale are useful tools for research that aims to explore nuances in quality of contraceptive counseling. At the same time, a shorter version of the scale is needed for wider use, especially for integration with data collection mechanisms that are unlikely to accommodate the full scale. A shortened version of the QCC scale may prove particularly beneficial for use within routine data systems in health facilities as part of continuous quality improvement processes and for efforts to compare counseling experiences across different geographies.This paper describes the process used to reduce the QCC scale to a shortened version, coined the QCC-10, for application in contraception programs that seek to assess and monitor client-reported quality of counseling.
2. Material and methods
2.1 Data source
We conducted psychometric analysis of client survey data collected previously for purposes of validating the original QCC scales (QCC-Mexico, QCC-Ethiopia, QCC-India) and triangulated findings across countries to reduce the QCC scale to 10 items. The study in Mexico (N = 499) was conducted in public clinics and hospitals in two states (San Luis Potosí and Mexico City), including 129 different providers, and was approved by the Harvard T.H. Chan School of Public Health Institutional Review Board (IRB) [
[9]
]. The study in Ethiopia (N = 599) was conducted in Addis Ababa in public health centers and franchise clinics of a large non-governmental organization providing reproductive health services (number of providers included was not documented) and was approved by the University of California, San Francisco (UCSF) and St. Paul's Hospital Millennium Medical College IRBs [[10]
]. The study in India (N = 313) was conducted in government public health centers in Gujarat state (number of providers included was not documented) and was approved by the Centre for Operations Research and Training (CORT) IRB and deemed exempt by the UCSF IRB due to the lack of identifying information provided to UCSF researchers from the CORT team [[10]
]. All surveys were administered to clients by study staff.Eligibility criteria included being female and having spoken with a provider about starting, changing, or discontinuing contraception either on the day of recruitment (Ethiopia and Mexico) or within the past 2 weeks (India). Recognizing that client report of counseling quality is likely clustered by provider, we recruited from a convenience sample within multiple health care settings in each country to encourage variability in client experiences. Demographics of study participants are available in the original validation study manuscripts [
[9]
,[10]
]. In summary, participants across all settings were on average in their late 20s and dedicating themselves primarily to household work or childcare. In Mexico and Ethiopia only, the majority had finished secondary school.2.2 QCC scale overview
The QCC scale was developed in Spanish in Mexico [
[9]
] and later adapted for Ethiopia (Amharic language) and India (Gujarati language) [[10]
], drawing on qualitative research on women's experiences with and preferences for contraceptive counseling conducted in each setting [11
, 12
, 13
]. The country-specific number of QCC scale items ranged from 22 to 26 (Table 1). Most items were consistent across settings (n = 18); four were unique to India and Ethiopia, four unique to Mexico and Ethiopia, and one unique to India. Items mapped to one of three QCC constructs, including (1) information exchange, or assessment of client needs and provision of information essential for decision-making; (2) interpersonal relations, or relationship-building aspects of counseling (e.g., privacy, confidentiality, trust); or (3) disrespect and abuse, defined as coercion, pressure, or mistreatment by providers. This dimensionality held across all three settings.Understanding quality of contraceptive services from women's perspectives in Gujarat, India: a focus group study | BMJ Open [Internet]. Available from: https://bmjopen.bmj.com/content/11/10/e049260.abstract. Accessed November 19, 2021
Table 1Comparison of the 26 QCC-Mexico, QCC-Ethiopia, and QCC-India scale items under consideration for QCC-10 scale, by QCC scale construct
| Item abbrev-iation | Item | Item consistent across countries (Y/N) | # votes (max = 5) | Factor loading: QCC-Mexico (22 items total) | Factor loading: QCC-Ethiopia (26 items total) | Factor loading: QCC-India (23 items total) | Key reason selected or not selected for QCC-10 | |
|---|---|---|---|---|---|---|---|---|
| QCC Construct: Information Exchange | ||||||||
| 1 | opinion | During the contraception consultation, I was able to give my opinion about what I needed. | Y | 4 | 0.4-0.6 | 0.51 | 0.72 | Selected: High number of votes |
| 2 | personal | The provider asked me questions in order to provide counseling that fit my personal experience. | N d This item was added to the QCC Scale for Ethiopia and India based on formative research suggesting this is an important element of quality related to Information Exchange; this item was not fielded in Mexico. In India the wording was modified for clarity, based on cognitive interviews, to read “The provider asked me personal questions …”. | 3 | N/A | 0.63 | 0.63 | Selected: Concept of personalized counseling key component of QCC construct |
| 3 | info | I received complete information about my options for contraceptive methods. | Y | 2 | 0.6–0.7 | 0.51 | 0.42 | Selected: Concept of information receipt key component of QCC construct |
| 4 | explain | The provider knew how to explain contraception clearly. | N | 0 | 0.6–0.8 | 0.64 | N/A | Not selected: Performed poorly in India, no votes |
| 5 | opportunity | I had the opportunity to participate in the selection of a method. | Y | 2 | 0.4–0.6 | 0.56 | 0.18 | Not selected: Performed poorly in India |
| 6 | sti_info | I received information about how to protect myself from sexually transmitted infections. | Y | 2 | 0.5 | 0.49 | 0.62 | Not selected: STI information receipt not central to QCC construct |
| 7 | method_fail | I received information about what to do if a method fails (e.g., broken condom, forget a pill, forgot injection appointment, feel an IUD is poorly placed) | Y | 3 | 0.6–0.7 | 0.73 | 0.60 | Not selected: item less relevant for clients who do not select a method |
| 8 | body_react | I could understand how my body might react to using contraception. | Y | 2 | 0.7–0.8 | 0.76 | 0.60 | Selected: Concept of side effect understanding central to QCC construct |
| 9 | method_use | I could understand how to use the method(s) we talked about during the consultation. | Y | 2 | 0.6–0.8 | 0.74 | 0.49 | Selected: Concept of understanding method use central to QCC construct |
| 10 | method_react | The provider explained to me what to do if I had a reaction to a method (e.g., allergies, nausea, pains, menstrual changes). | Y | 3 | 0.7 | 0.74 | 0.65 | Not selected: item less relevant for clients who do not select a method |
| 11 | method_stop | I received information about what to do if I wanted to stop using a method. | Y | 1 | 0.6–0.7 | 0.74 | 0.47 | Not selected: item less relevant for clients who do not select a method |
| QCC Construct: Interpersonal Relations | ||||||||
| 12 | info_private | I felt the information I shared with the provider was going to stay between us. | Y | 3 | 0.6–0.7 | 0.56 | 0.14 | Not selected: Performed poorly in India |
| 13 | enough_time | The provider gave me the time I needed to consider the contraceptive options we discussed. | Y | 3 | 0.5–0.8 | 0.68 | 0.58 | Selected: Concept of informed decision-making central to QCC construct |
| 14 | prov_friendly | The provider was friendly during the contraception consultation. | N | 2 | 0.8 | 0.65 | N/A | Not selected: Performed poorly in India |
| 15 | prov_knows | I felt the health care provider had sufficient knowledge about contraceptive methods. | N | 0 | 0.8 | 0.70 | N/A | Not selected: Performed poorly in India, no votes |
| 16 | prov_health | The provider showed interest in my health while we talked about contraception. | Y | 1 | 0.8 | 0.66 | 0.56 | Not selected: items 1 and 18 are similar and received more votes |
| 17 | prov_opinion | The provider was interested in my opinions. | Y | 1 | 0.8 | 0.73 | 0.62 | Not selected: items 1 and 18 are similar and received more votes |
| 18 | express_self | I felt encouraged to ask questions and express my concerns. | N | 4 | N/A | 0.75 | 0.68 | Selected: High number of votes |
| 19 | prov_listens | I felt listened to by the provider. | Y | 1 | 0.7–0.8 | 0.70 | 0.59 | Not selected: items 1 and 18 are similar and received more votes |
| 20 | no_interrupt | The provider made efforts to ensure there were no interruptions during our session. | N | 1 | N/A | 0.50 | 0.64 | Selected: Concept of privacy is central to the QCC construct |
| QCC Construct: Disrespect and Abuse | ||||||||
| 21 | prov_insist | The health care provider pressured me to use the method they wanted me to use. | Y | 5 | 0.6 | 0.02 | 0.14 | Selected: high number of votes; despite low loadings in Ethiopia and India, absence of coercion is central to QCC construct |
| 22 | prov_judge | I felt the provider treated me poorly because they tend to judge people. (Clothing, age, living condition, marital status, etc.) | Y | 0 | 0.7–0.8 | 0.46 | 0.43 | Not selected: No votes |
| 23 | scold_age (or scold_use, in India) | I felt scolded because of my age. | N g In India, this item was replaced with “I felt scolded because of the way I was using contraception” based on formative research suggesting the importance of social norms around what contraceptives are acceptable to be used depending on the number of children someone has and the greater salience of this potential dimension of discrimination compared to age discrimination | 0 | 0.5 | 0.60 | 0.54 | Not selected: No votes |
| 24 | prov_sexlife | The provider made me feel uncomfortable because of my sex life (e.g., when I started having sex, my sexual preferences, the number of partners I have, the number of children I have). | Y | 2 | 0.7–1.0 | 0.61 | 0.96 | Not selected: item deemed too long and less central to QCC construct than item 26 which is also focused on discrimination |
| 25 | prov_touched | The provider touched me or looked at me in a way that made me feel uncomfortable. | Y | 1 | 0.3–0.8 | 0.58 | 0.86 | Not selected: this item received lower votes than other Disrespect and Abuse subscale items |
| 26 | scold_marital | I felt scolded because of my marital status. | N | 2 | N/A | 0.72 | 0.93 | Selected: discrimination is a central component of QCC construct |
QCC, quality of contraceptive counseling
a While English versions are presented in this Table, note that items were fielded in Mexico in Spanish, in Ethiopia in Amharic, and in India in Gujarati (Table 2).
b Co-Investigators were asked to choose top 10; 5 people voted
c In the original validation study, EFA was run on Mexico City data and CFA on San Luis Potosi data; the range of loadings from both analyses is displayed here
d This item was added to the QCC Scale for Ethiopia and India based on formative research suggesting this is an important element of quality related to Information Exchange; this item was not fielded in Mexico. In India the wording was modified for clarity, based on cognitive interviews, to read “The provider asked me personal questions …”.
e Removed due to low factor loadings in CFA in India
f This item was added to the QCC Scale for Ethiopia and India based on formative research suggesting this is an important element of quality related to Interpersonal Relationships; this item was not fielded in Mexico
g In India, this item was replaced with “I felt scolded because of the way I was using contraception” based on formative research suggesting the importance of social norms around what contraceptives are acceptable to be used depending on the number of children someone has and the greater salience of this potential dimension of discrimination compared to age discrimination
h This item was added to the QCC Scale for Ethiopia and India based on formative research suggesting marital status as an important dimension of potential discrimination; this item was not fielded in Mexico
The scale was administered with a four-point response scale with response categories for positively worded items ranging from completely agree to completely disagree, and for negatively worded items “yes,” “yes with doubts,” “no with doubts,” and “no.” Composite scores and subs-scale scores were calculated using a mean of all item responses. The study team chose mean scoring given the clinical utility of the QCC scale and the need to prioritize ease of calculation of scores in quality improvement contexts.
2.3 Item reduction process
Our item reduction process consisted of triangulating quantitative psychometric findings with qualitative consideration of item interpretability (as assessed by expert opinions of study team members representing the three countries) and coverage of the full QCC measurement construct [
[6]
]. Our first step was to tally votes among the five co-investigators from the three QCC teams in Mexico, Ethiopia, and India (XQ, IZ, BU, KL, EG) who were asked to vote for 10 priority items from the perspective of item interpretability and content validity, drawing on their knowledge of cultural contexts, participant understanding during piloting and data collection, and alignment with the measurement framework. We then added items in order of number of votes received into a spreadsheet, along with information on factor loadings from prior studies and labels for domain of the QCC construct (information exchange, interpersonal relationship, or disrespect and abuse) covered.We decided a priori to select a total of no more than 10 items for the short scale to ensure scale length could feasibility be integrated with larger surveys and existing data collection tools, and to retain at least two items for each of the three domains of the QCC construct to ensure coverage of the entire construct. Our second step was to generate an initial list of potential items to retain, including those that either had four or five votes from the five co-investigators or high (>0.4) factor loadings from prior studies, and excluding those with zero co-Investigator votes. Given our desire to develop a scale that could measure clients' counseling experiences regardless of whether an individual decides to use a method, we also excluded items that focus exclusively on information about discontinuation and switching as those are less relevant for people who have not initiated method use. In our final step, we sought to remove additional items that were similar in content to other retained items or in order to reach our target number of 10 items.
2.4 Descriptive and psychometric analysis of reduced scale
We examined scale and item properties of the QCC-10 by country to examine validity and reliability across settings. We calculated mean item and scale scores to describe score distributions. We conducted exploratory factor analysis (EFA) to identify the factor structure of the reduced scale, identifying factors with an adjusted eigenvalue of at least one through parallel analysis. We assessed factor loadings once factor structure was determined. We calculated item-rest correlations to examine each item's association with the score of the other items, and Cronbach's alpha to examine internal consistency reliability of the scale. Because four of the items selected for the final scale were not fielded in Mexico, our ability to examine psychometric properties of the scale in Mexico is limited; nonetheless we report on findings using the six available items from the QCC-10 that were fielded in Mexico. All analyses were conducted by country and using Stata version 15.
2.5 Convergent validity assessment
We assessed convergent validity (i.e., the degree to which QCC-10 scores correlate with other, similar measures, as expected) using an overall measure of client experience with the provider (dichotomized to highest rating vs all else) and a measure of whether the client planned to use or continue using the selected contraceptive method, among women who reported selecting or already using contraception on the day of interview. Analyses were conducted using bivariate logistic regression models, accounting for clustering (by provider in Mexico and site in India and Ethiopia where provider identifiers were unavailable) with robust standard errors.
3. Results
3.1 Item reduction
Table 1 displays all 26 QCC items, with investigator votes, factor loadings from prior validation studies, and descriptions of the rationale for selecting or excluding each item for the QCC-10 final item set. Items received between 0 and 5 votes (mean = 1.9, standard deviation = 1.3); only one item received five votes (prov_insist: “The health care provider pressured me to use the method they wanted me to use”).
Eighteen items were considered for retention either because they had four or five votes from the five co-investigators (n = 3) or high (>0.4) factor loadings from prior studies in combination with at least one vote from a co-investigator (n = 15). We excluded three items from the latter category that focus exclusively on information for individuals who select a method during counseling (method_fail, method_react, and method_stop). From the 15 remaining items, we excluded five deemed not essential for coverage of the QCC construct (STI_info because of the focus on STIs; prov_health, prov_opinion, and prov_listens due to their similarity to other items; and prov_sexlife due to its length). The final 10 QCC-10 items are presented in Table 2.
Table 2Final Quality of Contraceptive Counseling short scale (QCC-10)
 |
 |
a In India, where clients were surveyed within 2 weeks of their visit, this was phrased “the most recent interaction.”
3.2 Descriptive and psychometric analysis of reduced scale
Table 3 presents item and scale properties of the QCC-10. As previously reported, item means ranged from 3.3-3.9 (out of 4) in Mexico, 2.4 to 4.0 in Ethiopia, and 3.0 to 3.9 in India. Overall QCC-10 scores ranged from 3.1 in Ethiopia to 3.5 in Mexico (six items only). Cronbach's alpha was 0.8 in Mexico and Ethiopia, indicating high reliability for a short scale [
[14]
], while the alpha was only 0.5 in India. Missing data ranged from 10 per item in Mexico to 21 in Ethiopia; no data were missing in India.Table 3Properties of the unidimensional Quality of Contraceptive Counseling short scale (QCC-10) across Mexico, Ethiopia, and India
| Item abbreviation | Mean/standard deviation (SD) | Exploratory factor analysis (EFA) factor loading | Item-rest correlations | |||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Mexico (N = 499) | Ethiopia (N = 599) | India (N = 313) | Mexico | Ethiopia | India | Mexico | Ethiopia | India | ||
| 1 | opinion | 3.5 (0.6) | 3.3 (0.6) | 3.4 (0.5) | 0.5 | 0.6 | 0.8 | 0.4 | 0.5 | 0.6 |
| 2 | personal | N/A | 3.1 (0.6) | 3.3 (0.6) | N/A | 0.6 | 0.6 | N/A | 0.6 | 0.5 |
| 3 | info | 3.5 (0.7) | 2.4 (0.8) | 3.4 (0.5) | 0.7 | 0.5 | 0.4 | 0.7 | 0.4 | 0.3 |
| 4 | body_react | 3.3 (0.8) | 2.9 (0.7) | 3.2 (0.6) | 0.7 | 0.7 | 0.6 | 0.6 | 0.6 | 0.5 |
| 5 | method_use | 3.4 (0.7) | 3.0 (0.6) | 3.3 (0.5) | 0.7 | 0.7 | 0.5 | 0.6 | 0.6 | 0.3 |
| 6 | enough_time | 3.5 (0.6) | 3.0 (0.6) | 3.3 (0.5) | 0.7 | 0.7 | 0.6 | 0.6 | 0.6 | 0.4 |
| 7 | express_self | N/A | 2.9 (0.7) | 3.0 (0.7) | N/A | 0.6 | 0.6 | N/A | 0.6 | 0.4 |
| 8 | no_interrupt | N/A | 3.0 (0.7) | 3.2 (0.7) | N/A | 0.5 | 0.6 | N/A | 0.4 | 0.3 |
| 9 | prov_insist | 3.9 (0.6) | 3.6 (0.4) | 3.0 (1.3) | 0.2 | 0.1 | 0.4 | 0.2 | 0.1 | -0.4 |
| 10 | scold_marital | N/A | 4.0 (0.2) | 3.9 (0.4) | N/A | 0.3 | 0.1 | N/A | 0.2 | <0.1 |
| Overall scale | 3.5 (0.5) | 3.1 (0.4) | 3.3 (0.3) | |||||||
| Cronbach's alpha b A sensitivity analysis examining scale properties without the scold_marital item revealed no change in alpha or factor loadings for other items in India or Ethiopia. Removing both scold_marital and prov_insist did not change item or scale properties in Ethiopia, but improved the alpha in India to be comparable to Ethiopia and Mexico (0.8) and increased the info factor loading in India to 0.5. | 0.8 | 0.8 | 0.5 | |||||||
a Missing data ranged from 10 in Mexico to 21 in Ethiopia in psychometric analyses; no data were missing in India
b A sensitivity analysis examining scale properties without the scold_marital item revealed no change in alpha or factor loadings for other items in India or Ethiopia. Removing both scold_marital and prov_insist did not change item or scale properties in Ethiopia, but improved the alpha in India to be comparable to Ethiopia and Mexico (0.8) and increased the info factor loading in India to 0.5.
EFA revealed a clear one-factor solution in each country, as only one factor in each country had an adjusted eigenvalue greater than one in parallel analysis (Appendix). Factor loadings were consistently above 0.4 for all but two items: prov_insist and scold_marital. The prov_insist item, examining provider pressure to use a specific method, loaded 0.2 in Mexico, 0.1 in Ethiopia, and met the 0.4 threshold in India. Similarly, the scold_marital item, reflecting biased counseling against client's pursuit of contraceptive methods based on their marital status, loaded 0.3 in Ethiopia and 0.1 in India; the item was not fielded in Mexico. Item-rest correlations were also low (<0.4) for these two items. Because these two items capture key dimensions of negative counseling experiences, we retained them to preserve content validity of the scale in line with the original measurement framework [
[6]
]. However, due to the low alpha in India, we conducted a sensitivity analysis removing both scold_marital and prov_insist; this improved the alpha in India to be comparable to Ethiopia and Mexico (0.8) and increased the info factor loading to 0.5. We also conducted a sensitivity analysis to evaluate if item and scale properties would improve if just scold_marital was removed; results indicated that item loadings and Cronbach's alpha did not substantially change (Table 3).3.3 Convergent validity
Table 4 displays results from convergent validity analyses. QCC-10 scores were highly correlated with a dichotomous overall measure of client experience in all countries (Mexico: OR = 10.6, 95% CI = 5.7−19.6; Ethiopia: OR = 45.5, 95% CI = 23.6−87.7; India: OR = 4.4, 95% CI = 1.8−11.0). Note that the confidence intervals for these analyses are large likely due to clustering of standard errors, particularly in Ethiopia and India where data were collected at the site rather than provider level. We conducted a sensitivity analysis to examine the relationship of an 8-item version of the scale, removing the two negatively worded items that capture disrespect and abuse (prov_insist and scold_marital) and that were less commonly endorsed among participants, and found scores remained highly correlated with the client experience measure (Mexico: OR = 7.0, 95% CI = 4.2–11.8; Ethiopia: OR = 30.7, 95%CI = 15.4–60.9; India: OR = 3.2, 95% CI = 1.5–6.7).
Table 4Convergent validity results from logistic regression predicting the odds of related variables based on continuous Quality of Contraceptive Counseling short scale (QCC-10) scale scores across Mexico (N = 499), Ethiopia (N = 599), and India (N = 313)
| N (%) | OR (95% CI) | |||||
|---|---|---|---|---|---|---|
| Mexico | Ethiopia | India | Mexico | Ethiopia | India | |
| Highest overall rating of experience with provider b Missing data ranged from 1 in Ethiopia to 3 in Mexico; no data were missing in India. We conducted a sensitivity analysis to examine the relationship of an 8-item version of the scale, removing the two negatively worded items that capture disrespect and abuse (prov_insist and scold_marital) and that were less commonly endorsed among participants, and found scores remained highly correlated with the client experience measure (Mexico: OR = 7.0, 95% CI = 4.2–11.8; Ethiopia: OR = 30.7, 95%CI = 15.4–60.9; India: OR = 3.2, 95% CI = 1.5–6.7).3 We did not examine this outcome in India because participants were interviewed within two weeks of their visit, with those initiating method use prioritized for recruitment. Missing data ranged from 104 in Mexico to 122 in Ethiopia due to some women not having selected a method during their visit in Mexico and Ethiopia. A sensitivity analysis removing prov_insist and scold_marital did not meaningfully change the finding (Mexico: OR = 2.4, 95% CI = 1.3–4.2; Ethiopia: OR=2.3, 95% CI = 1.6–3.2). | 250(50.4%) | 163(27.3%) | 152(48.6%) | 10.6(5.7-19.6) | 45.5(23.6–87.7) | 4.4(1.8–11.0) |
| Intention to use method selected at baseline3 | 361(91.4%) | 314(65.3%) | N/A | 3.3(1.7-6.4) | 3.5(2.5–4.9) | N/A |
a Models accounted for clustering by provider in Mexico and site in India and Ethiopia (provider identifiers not available in latter settings)
b Missing data ranged from 1 in Ethiopia to 3 in Mexico; no data were missing in India. We conducted a sensitivity analysis to examine the relationship of an 8-item version of the scale, removing the two negatively worded items that capture disrespect and abuse (prov_insist and scold_marital) and that were less commonly endorsed among participants, and found scores remained highly correlated with the client experience measure (Mexico: OR = 7.0, 95% CI = 4.2–11.8; Ethiopia: OR = 30.7, 95%CI = 15.4–60.9; India: OR = 3.2, 95% CI = 1.5–6.7).3 We did not examine this outcome in India because participants were interviewed within two weeks of their visit, with those initiating method use prioritized for recruitment. Missing data ranged from 104 in Mexico to 122 in Ethiopia due to some women not having selected a method during their visit in Mexico and Ethiopia. A sensitivity analysis removing prov_insist and scold_marital did not meaningfully change the finding (Mexico: OR = 2.4, 95% CI = 1.3–4.2; Ethiopia: OR=2.3, 95% CI = 1.6–3.2).
Among participants who selected a method after their contraceptive counseling visit, there was also correlation between QCC-10 scores and clients’ reported intention to initiate the method (Mexico: OR = 3.3, 95% CI = 1.7–6.4; Ethiopia: OR = 3.5, 95% CI = 2.5–4.9). A sensitivity analysis removing prov_insist and scold_marital did not meaningfully change the finding (Mexico: OR = 2.4, 95% CI = 1.3–4.2; Ethiopia: OR = 2.3, 95% CI = 1.6–3.2). We did not conduct this analysis for India, as participants initiated a method by the interview given our recruitment approach, conducting interviews within 2 weeks after the consultation.
4. Discussion
This study describes the process used to reduce 26 items of the multidimensional Quality of Contraceptive Counseling (QCC) scale, measuring client experience of contraceptive counseling, to a unidimensional 10-item scale using data from contraception clients in Mexico, Ethiopia, and India. The QCC-10 offers a new approach to measuring client experience and fulfilment of human rights in contraceptive counseling that is appropriate for multiple cultural contexts, including geographies in Latin America, South Asia, and sub-Saharan Africa. The scale's strength lies in the robust formative research conducted to develop the original items [
11
, 12
, 13
] and the three-continent survey data leveraged for the scale reduction. The original QCC-Mexico, QCC-Ethiopia, and QCC-India scales are multidimensional, comprising three subscales: information exchange, interpersonal relationship, and disrespect and abuse. The QCC-10 is a shorter, unidimensional scale that retains items from these three subscales (five, three, and two items for each subscale, respectively) and includes content coverage of the original measurement framework [Understanding quality of contraceptive services from women's perspectives in Gujarat, India: a focus group study | BMJ Open [Internet]. Available from: https://bmjopen.bmj.com/content/11/10/e049260.abstract. Accessed November 19, 2021
[6]
].The QCC-10 retained the high internal consistency reliability observed in the QCC-Mexico and QCC-Ethiopia validation studies, even with the lack of data for four items in Mexico. However, Cronbach's alpha was notably lower among women in India (alpha = 0.5, not typically considered acceptable) [
[14]
]. Despite clear evidence from EFA that the QCC-10 in India was unidimensional, this low alpha likely indicates heterogeneity in what individual scale items measure. The two items reflecting disrespect and abuse (prov_insist and scold_marital) had the lowest factor loadings in India. We hypothesize these items are responsible for the lower alpha, possibly because they capture a different aspect of quality—focused on understudied, negative experiences—relative to the positively-worded items in the information exchange and interpersonal relationship domains, which loaded 0.4 or higher. Indeed, the removal of the two items in India increased the scale reliability (alpha = 0.8; Table 3). The poor performance of the QCC-10 in India suggests the need for further exploration of its suitability in this context. We recommend that future work examine the performance of the prov_insist and scold_marital items in a larger, more diverse sample from India. Given the importance of the provider bias and discrimination items from a content validity perspective, including positive and negative dimensions of care in measures such as the QCC-10 is central to comprehensive assessment of high-quality contraceptive services.Convergent validity findings offer promising evidence for the QCC-10’s construct validity with higher scale scores correlating with anticipated client outcomes (e.g., overall measure of client experience and intention to use/continue method use) across settings. Future research should examine the transferability and psychometric properties of the QCC-10 in other low-and middle-income countries to examine the validity and reliability of the QCC-10 in other contexts and assess if our observed measurement challenges are unique to the Indian study context or exist across geographies. We also recommend future validation studies include nonresponse analyses to examine the minimum number of items required to retain psychometric properties. Further, researchers may choose to explore other ways to score the QCC-10 in their work. Mean scoring was chosen by the QCC project team for the original long-form validation studies and for this reduction study, given the prioritization of facilitating QCC-10 score calculations in clinical contexts. In contexts where more complex score calculation is possible, however, other approaches may be valuable to explore.
The QCC-10 complements other recently developed measures of quality in contraceptive counseling, including the Interpersonal Quality in Family Planning (IQFP) scale (developed and validated in the United States and validated for use in India [
[15]
,[16]
]) and its reduced version, the Person-Centered Contraceptive Counseling (PCCC) scale [[17]
]; and the Method Information Index (MII) and MII-Plus, developed from existing survey items used for decades as part of the Demographic Health Surveys [[18]
]. The IQFP is an 11-item scale similar in length to the QCC-10, focuses on person-centeredness in contraceptive counseling, yet, the QCC-10 is distinct in the scope of the construct measured; specifically the QCC-10 comprises domains of privacy, confidentiality, and non-discrimination not covered in the IQFP and includes items probing for negative experiences, such as pressure to use contraception. While the PCCC and MII are both shorter measures that can be easily integrated into surveys, compared to the IQFP and QCC-10, they also offer less nuance in measuring quality of counseling. Similarly, with simple yes/no response options and a focus on counseling content, not experience, MII/MII-Plus data result in less response variation than other available measures, which utilize Likert scales for responses; such homogeneity has proven challenging from a research perspective. An important and foundational benefit of the QCC-10 relative to these other measures is the robust, formative research and cognitive testing that was conducted in the three settings during the item refinement phase; such efforts were critical to ensuring content validity in each new setting before quantitatively testing the items [9
, 10
, 11
, 12
, 13
].Understanding quality of contraceptive services from women's perspectives in Gujarat, India: a focus group study | BMJ Open [Internet]. Available from: https://bmjopen.bmj.com/content/11/10/e049260.abstract. Accessed November 19, 2021
This study was limited by the narrow geographic scopes included in each of the original QCC validation studies (two states in Mexico, the capital city of Ethiopia, and one state in India). Despite this, the QCC-10 is unique in that it was developed with data from three diverse settings. Additionally, as part of the reduction process, we prioritized information exchange items relevant to selection of a method and excluded several items that focus exclusively on information about discontinuation and switching among contraceptive method users, given our desire to develop a scale that could measure clients' counseling experiences regardless of whether they decide to use a method. Thus, the resulting QCC-10, compared to the longer, country-specific QCC scales, covers a limited scope of the entire information exchange component of the original measurement framework [
[6]
]. Finally, the data sources used for Ethiopia and India do not include provider identifiers and, thus, we are unable to account for clustering of women's experiences by provider in our Ethiopia and India analyses.The QCC-10 offers an innovative, cross-cultural approach to measuring quality in contraceptive counseling. Future efforts should examine its validity and reliability for use globally, with additional exploration of how to best measure negative aspects of care in India where the QCC-10 Disrespect and Abuse items were problematic. Thoughtful, nuanced measurement of client perspectives on the counseling they receive, available via the QCC-10, is critical to monitoring and improving quality of care and the fulfilment of human rights in contraceptive services worldwide.
Appendix. Supplementary materials
References
- Framework for ensuring human rights in the provision of contraceptive information and services. 2014; (Accessed 2 November 2022)
- Fundamental elements of the quality of care: a simple framework.Stud Fam Plann. 1990; 21: 61-91
- Accelerate progress—sexual and reproductive health and rights for all: report of the Guttmacher–Lancet.Commission. Lancet. 2018; 391: 2642-2692
Crossing the quality chasm: a new health system for the 21st century | The BMJ [Internet]. [Available from: https://www.bmj.com/content/323/7322/1192.1.full. Accessed November 19, 2021
- High-quality health systems in the Sustainable Development Goals era: time for a revolution.Lancet Glob Health. 2018; 6: e1196-e1252
- Defining quality in contraceptive counseling to improve measurement of individuals’ experiences and enable service delivery improvement.Contraception. 2017; 96: 133-137
“Measuring quality of care: A review of previously used methodologies a” by Katherine Tumlinson [Internet]. Available from: https://knowledgecommons.popcouncil.org/departments_sbsr-rh/679/. Accessed August19, 2021
- Revising the FP Quality of Care Framework in the context of rights-based family planning.Stud Fam Plann. 2018; 49: 171-179
- Development and validation of the client-reported quality of contraceptive counseling scale to measure quality and fulfillment of rights in family planning programs.Stud Fam Plann. 2019; 50: 137-158
Holt K, Gebrehanna E, Sarnaik S, Lakhwani K, Reed R, Yesuf A, et al. Adaptation and validation of the quality of contraceptive counseling (QCC) scale for use in Ethiopia and India. Rev PlosOne.
- Women's preferences for contraceptive counseling in Mexico: Results from a focus group study.Reprod Health. 2018; 15: 128
Gebrehanna E, Langer A, Holt K. Women's experiences with and preferences for contraceptive counseling in Addis Ababa, Ethiopia: Results from a qualitative study. Rev Plos One.
Understanding quality of contraceptive services from women's perspectives in Gujarat, India: a focus group study | BMJ Open [Internet]. Available from: https://bmjopen.bmj.com/content/11/10/e049260.abstract. Accessed November 19, 2021
- Scale development: Theory and applications. 26. Sage publications, Thousand Oaks, California2016
- Development of a patient-reported measure of the interpersonal quality of family planning care.Contraception. 2018; 97: 34-40
- Validation of the interpersonal quality of family planning scale in a rural indian setting. 2. Contracept X, 2020100035
- Development of the person-centered contraceptive counseling scale (pccc), a short form of the interpersonal quality of family planning care scale.Contraception. 2021; 103: 310-315
- Examining progress and equity in information received by women using a modern method in 25 developing countries.Int Perspect Sex Reprod Health. 2016; 42: 131-140
Article info
Publication history
Published online: October 12, 2022
Accepted:
September 23,
2022
Received in revised form:
August 22,
2022
Received:
December 17,
2021
Footnotes
☆Data availability: Data will be available on Dryad.
☆☆Declaration of Competing Interest: The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
☆☆☆Funding disclosures: This work was supported by the David and Lucile Packard Foundation [Grant number: #2018-67680].
Identification
Copyright
© 2022 The Author(s). Published by Elsevier Inc.
User license
Creative Commons Attribution (CC BY 4.0) | How you can reuse 
Elsevier's open access license policy
Creative Commons Attribution (CC BY 4.0)
Permitted
- Read, print & download
- Redistribute or republish the final article
- Text & data mine
- Translate the article
- Reuse portions or extracts from the article in other works
- Sell or re-use for commercial purposes
Elsevier's open access license policy
