PLoS ONE
Home The effect of a digital targeted client communication intervention on pregnant women’s worries and satisfaction with antenatal care in Palestine–A cluster randomized controlled trial
The effect of a digital targeted client communication intervention on pregnant women’s worries and satisfaction with antenatal care in Palestine–A cluster randomized controlled trial
The effect of a digital targeted client communication intervention on pregnant women’s worries and satisfaction with antenatal care in Palestine–A cluster randomized controlled trial

Competing Interests: The authors have declared that no competing interests exist.

Article Type: Research Article Article History
Abstract

Background

The eRegCom cluster randomized controlled trial assesses the effectiveness of targeted client communication (TCC) via short message service (SMS) to pregnant women, from a digital maternal and child health registry (eRegistry) in Palestine, on improving attendance and quality of care. In this paper, we assess whether this TCC intervention could also have unintended consequences on pregnant women’s worries, and their satisfaction with antenatal care (ANC).

Methods

We interviewed a sub-sample of Arabic-speaking women attending ANC at public primary healthcare clinics, randomized to either the TCC intervention or no TCC (control) in the eRegCom trial, who were in 38 weeks of gestation and had a phone number registered in the eRegistry. Trained female data collectors interviewed women by phone from 67 intervention and 64 control clusters, after securing informed oral consent. The Arabic interview guide, pilot-tested prior to the data collection, included close-ended questions to capture the woman’s socio-demographic status, agreement questions about their satisfaction with ANC services, and the 13-item Cambridge Worry Scale (CWS). We employed a non-inferiority study design and an intention-to-treat analysis approach.

Results

A total of 454 women, 239 from the TCC intervention and 215 from the control arm participated in this sub-study. The mean and standard deviation of the CWS were 1.8 (1.9) for the intervention and 2.0 (1.9) for the control arm. The difference in mean between the intervention and control arms was -0.16 (95% CI: -0.31 to -0.01) after adjusting for clustering, which was below the predefined non-inferiority margin of 0.3. Women in both groups were equally satisfied with the ANC services they received.

Conclusion

The TCC intervention via SMS did not increase pregnancy-related worries among recipients. There was no difference in women’s satisfaction with the ANC services between intervention and control arms.

Bogale,Mørkrid,Abbas,Abu Ward,Anaya,Ghanem,Hijaz,Isbeih,Issawi,A. S. Nazzal,E. Qaddomi,Frøen,and Zoorob: The effect of a digital targeted client communication intervention on pregnant women’s worries and satisfaction with antenatal care in Palestine–A cluster randomized controlled trial

Introduction

Targeted client communication (TCC) using Short Message Service (SMS), is among the most common digital health interventions [1]. The most effective digital TCC interventions are co-designed with users, underpinned by behavior change theories, tested, and iteratively improved [13]. Pure appointment reminders have shown moderate effectiveness in improving attendance to maternity services [1,4,5]. However, digital health communication interventions tailored to the individual recipient are more likely to lead to behavior change compared with generic communication [6,7]. Health education and promotion messages via SMS can empower women to make informed health choices, which may contribute to a positive pregnancy experience [1,2,4,8,9]. While tailoring based on individual-level risk factors has advantages, it may also result in potential unintended consequences, such as, the triggering of worries among the message recipients. Documenting and preventing potential unintended consequences have generally been given little attention in the field of health education and promotion interventions [10].

TCC intervention studies often report the effectiveness as a main outcome, and seldom include a robust study design to assess its potential negative effects, such as adverse psychological outcomes and clients’ satisfaction [1,11]. In their guidelines for digital interventions for health system strengthening, the World Health Organization (WHO) highlights the importance of assessing any unintended consequences of, and client’s satisfaction with digital health interventions, in addition to the effectiveness among others [12,13].

Pregnancy is a period when women are more vulnerable to worries and anxiety, which are often highest in early and late stages of pregnancy [14,15]. The variabilities in the definition and the psychometric measurement tools used across studies, hamper the understanding of worries and anxiety in pregnancy [1517]. Nevertheless, the psycho-social environment, and previous and current obstetric and medical status were among the risk-factors causing worries in pregnancy [14]. Generic antenatal health education and promotion utilizing digital health technology can reduce pregnancy-related concerns and worries [1820], but there is limited information on the potential adverse effects [21].

In a client-centered maternity care model, women’s satisfaction is an integral part of the quality of services [22,23]. Well-informed pregnant women are more likely to make informed health choices, and they are often satisfied with the antenatal care (ANC) services they receive. A well-designed TCC intervention using SMS, in addition to the routine antenatal education program, may improve women’s satisfaction [20].

We have previously reported low effective coverage of essential interventions of ANC in Palestine, mainly attributed to untimely attendance in public primary healthcare center (PHC) [24]. An electronic registry that includes systematic, uniform, and longitudinal client information entered at the point-of-care, such as the Maternal and Child Health (MCH) eRegistry in Palestine, provides a unique opportunity for tailored TCC via SMS to each woman to improve attendance [2527]. We have developed a theory-based, co-designed, and user tested TCC intervention to pregnant women automated from the MCH eRegistry [25]. The aim of the TCC intervention was to increase the awareness of individual-level susceptibility to, and severity of, prioritized pregnancy-related high-risk conditions, specifically, anemia, hypertension, diabetes, and growth restriction, and thus improve timely attendances for screening and management of the high-risk conditions. This digital health intervention is under assessment for its effectiveness in a four-armed cluster randomized trial (eRegCom: Trial registration number: ISRCTN10520687).

Efforts to minimize potential worries were made during the design of the TCC intervention; however, we cannot exclude the potential increase in pregnancy-related worries. This might be particularly relevant for pregnant women receiving text messages with tailored information about their risk factors, such as high body mass index, high or low age, and a history of pregnancy complications; and the link to one of the prioritized pregnancy-related high risk conditions [25].

The objective of this sub-study of the eRegCom trial was to assess whether this TCC intervention via SMS, automated from the Palestinian MCH eRegistry, could affect pregnant women’s worries and satisfaction with ANC services.

Methods

Trial design and participants

This was a non-inferiority two-armed parallel cluster randomized trial, sub-sampled from the four-armed eRegCom trial (Trial registration number: ISRCTN10520687), following the Consolidating Standards of Reporting Trials (CONSORT) criteria for cluster randomized trials [28] described in detail elsewhere [29]. In short, the four arms include one arm with Quality Improvement Dashboards (QID) for healthcare providers; one with TCC via SMS to women; one with both QID and TCC via SMS; and one control arm. The 138 clusters (one closed after randomization) in the eRegCom trial are public PHC offering both antenatal and postnatal care services, active users of the MCH eRegistry, and served 45 to 3000 new pregnancies in 2016.

For this sub-study, the TCC intervention arm (69 clusters) includes both arms with TCC intervention in the eRegCom trial, and the control arm (68 clusters) includes both arms without it. Additional inclusion criteria for this sub-study were that the women had registered a phone number in the eRegistry, were in the 38th week of gestation, and spoke Arabic.

Intervention

The development process and content of the TCC intervention are described elsewhere [25]. In short, the TCC intervention in the eRegCom trial includes training of healthcare providers on how to enroll women in the TCC program, which sends a series of individualized and automated text messages. Routine clinical data captured by the healthcare provider at the point-of-care are applied in algorithms that identify the correct text message to each individual woman. The woman’s name, the date of her next appointment and the name of the PHC are automatically inserted into one of the 56 unique predesigned text message templates stored in the library. The text messages that include information about one or two of the prioritized pregnancy-related high-risk conditions, are sent at the time these conditions are screened for, namely at the 16, 18–22, 24–28, 32- or 36-weeks’ gestation routine ANC visits. Women receive a welcome text message to the mobile number registered during the first ANC visit (booking) or any visit where they assent to take part in the text message program; one week, three days, and 24 hours before a scheduled appointment; 24 hours after a missed appointment; and 24 hours prior to an appropriate time window without any timely scheduled routine visit in the future.

Data collection

We used the 13-item Cambridge Worry Scale (CWS) [30] which utilizes a six-point Likert-type scale ranging from 0 (not a worry) to 5 (extremely worried). In addition to the CWS, the interview guide included close-ended questions to capture the women’s socio-demographic status, and agreement scale questions (0 = strongly disagree to 5 = strongly agree) about satisfaction with ANC services. Two researchers, fluent in English and Arabic, translated the English version to Arabic, which was back translated by a third individual prior to a pilot test in January 2019.

Four trained and experienced female data collectors conducted the phone interviews while being blinded to the allocation and primary outcome, fluent in the Arabic language and familiar with the local context, including ANC terminologies. The data collectors received a password-protected document with a list of eligible women and their registered phone numbers on a weekly basis. The lists were deleted after one week. A data manager oversaw the preparation and distribution of lists, including the safe storage of the allocation key. The data collectors entered the response in a pre-designed Google Form while interviewing, and the data quality and completeness were monitored daily. The data collectors tried to reach each woman on a maximum of three different occasions.

Outcomes

The primary outcome of this sub-study was the difference in mean total CWS score between the intervention and control arms with the one-sided confidence interval (CI) considering the non-inferiority margin. The mean and standard deviation (SD) of the total 13-items CWS score were calculated for each study arm. A higher mean score suggests higher levels of worries. We categorized the 13-items into the four predefined components, namely socio-medical, socio-economic, health, and relationship [3036].

We also measured pregnant women’s satisfaction with ANC services, computed as the mean difference of each question on an agreement scale.

Sample size

The power of the study was estimated using PASS software for sample size calculation for a non-inferiority cluster randomized trial design [37]. We hypothesized that there was no statistically significantly increased difference in the mean total CWS score between women in the intervention and control arms with a given non-inferiority margin. We were more than 90% powered to detect a non-inferiority margin of a one-point increase of every third questions on the CWS (corresponding to an increase of 0.3 in the CWS mean score), with standard deviation (SD) of 1.1, assumed intra-cluster correlation coefficient (ICC) of 0.01, a one-sided significance level of 2.5% for 137 clusters with equal cluster size of four. The SD and a pooled mean score of 1.5 [95% CI: 1.09–1.92] were computed from a meta-analysis of relevant literature and a pilot study (n = 41) conducted in the same study site in January 2019.

Randomization

An independent statistician performed the randomization for the eRegCom trial [29], where PHCs were randomized to the TCC; QID; TCC and QID; or control arm with equal allocation. The randomization was stratified by the national implementation phase of the eRegistry, and constrained on laboratory availability, ultrasound availability and the size of the PHCs.

Statistical methods

We applied an intention-to-treat analysis and used R software with the lme4 package for the Mixed Effect Linear Regression Model to consider the cluster effect for the computation of the difference in the mean total CWS score between the intervention and control arms. We used an unstructured covariance model to impose the fewest assumptions. In exploratory analyses, we found that this resulted in the best fitting model. We performed an exploratory analysis to assess any imbalances across the groups in potential confounders for the CWS like women’s educational status, previous adverse pregnancy outcomes, age, and parity. We also used a previously established four factor structure for the CWS to analyze the unadjusted difference in mean scores. The ICC for the difference in mean CWS score and Cronbach’s Alpha to see the internal consistency of the measurement were calculated. A statistician blinded for the allocation performed the final analysis.

Ethics approval

The data collectors read out the information sheet and secured oral informed consent from all participants before conducting the phone interview. We obtained ethical clearance from the Helsinki Committee for Ethical Approval in Palestine (ref. no.: PHRC/HC/670/19) and an exemption from ethical review from the Regional Committee for Health Research Ethics (REK)—Section South East B, from Norway (ref.: REK sør-øst 139204) as health systems research falls outside of the mandate for ethical review in Norway.

Results

We interviewed 239 women from 67 TCC intervention clusters, and 215 women from 64 control clusters in February and March 2020 (Fig 1). This was in total 83% of the calculated sample size. The data collection did not continue to the full sample size (estimated four women per cluster) as the TCC intervention was discontinued in March 2020 due to the COVID-19 situation in Palestine, and women in the intervention arm would no longer have received the full intervention after this point.

Participant flow chart (CONSORT diagram).
Fig 1

Participant flow chart (CONSORT diagram).

There were no statistically significant imbalances in background characteristics between the intervention and control arms. The majority of women were between 25–29 years of age (Table 1). About half of the women had a college or university level education, and only one woman reported no formal education. In control arm PHCs, 35% were primiparous and 74% of the women had their first ANC visit in the first trimester. About 80% attended regular ANC and 90% ultrasound services in private/Non-Governmental Organization/United Nations clinics, in addition to the public PHC they were registered to. More than 85% in each arm had their own mobile phone.

Table 1
Background characteristics of the study participants in intervention and control arms.
Background characteristicsIntervention arm (clusters = 67, n = 239)Control arm (clusters = 64, n = 215)
n (%)n (%)
Women’s age
    <20 21 (9)16 (8)
    20–24 57 (24)59 (28)
    25–29 84 (35)74 (35)
    30–34 49 (21)56 (26)
    35–39 22 (9)6 (3)
    ≥ 40 5 (2)3 (1)
Educational status
    Primary3 (1)1 (1)
    Secondary114 (48)113 (53)
    College or University117 (49)96 (45)
    After college or University5 (2)4 (2)
    No formal education0 (0)1 (1)
Work status
    Work outside the home 26 (11)33 (16)
    No work outside the home211 (89)180 (85)
Parity
    Primipara69 (29)74 (35)
    Multipara169 (71)140 (65)
Gestational age at booking
    < 4 months160 (70)160 (74)
    4–6 months67 (28)46 (21)
    > 6 months12 (5)8 (4)
Referral to high-risk clinics
    Yes35 (15)31 (14)
    No204 (85)184 (86)
Attended ANC in another clinic
    Yes 203 (85)170 (79)
    No 36 (15)45 (21)
Attended for ultrasound in another clinic
    Yes211 (90)189 (88)
    No 23 (10)26 (12)

n: Number of women.

Worries in pregnancy

Generally, women in the intervention clusters scored lower on the CWS than their counterparts in the control clusters, but the difference was not statistically significant. Items directly related to the pregnancy (giving birth, going to hospital, and internal examinations), along with items related to the baby had the highest scores of worries in both arms. Fig 2 presents a crude mean value per intervention and control arms without adjusting for clustering effect.

Ranking of women’s mean worry score with 95% confidence interval for intervention and control arms.
Fig 2

Ranking of women’s mean worry score with 95% confidence interval for intervention and control arms.

There was no item in the CWS that none of the women in our sample were not worried about, although the most frequent response was “no worry at all”. The unadjusted total mean CWS score and SD were 1.8(1.9), and 2.0(1.9) in intervention and control arms respectively (Table 2). The previously established socio-medical and health factor structures comprised the highest worries in both arms. The reliability of the CWS was satisfactory (Cronbach’s Alpha = 0.74).

Table 2
Unadjusted summaries of the Cambridge Worry Scale for the total sample, and across study arms.
Cambridge Worry Scale itemsFreq(n)Level of worry (%)eIntervention (clusters = 67 n = 239)Control (clusters = 64 n = 215)Difference in Mean score (95% CI)
012345Mean (SD)Mean (SD)
Your housing 4495326110650.9 (1.3)1.2 (1.6)-0.4 (-0.7, -0.1)
Money problems 45138212191281.6 (1.7)1.8 (1.8)-0.2 (-0.5, 0.1)
Your relationship with your husband/partner 448622716210.6 (1.0)0.7 (1.1)-0.1 (-0.3, 0.1)
Your relationship with your family and friends 449642804220.5 (1.1)0.6 (1.0)-0.0 (-0.2, 0.2)
Your own health 44641192151581.6 (1.8)1.8 (1.8)-0.2 (-0.5, 0.2)
The health of someone close to you 4494525181471.4 (1.7)1.5 (1.8)-0.2 (-0.5, 0.2)
Employment problems 451552517750.9 (1.4)1.2 (1.6)-0.3 (-0.6, 0.0)
The possibility of something being wrong with the baby 447261421427172.5 (2.0)2.6 (1.9)-0.1 (-0.5, 0.3)
The possibility of stillbirth 447281621321192.4 (2.0)2.4 (1.9)0.0 (-0.4, 0.3)
Going to hospital 44816911030343.4 (1.8)3.3 (1.8)0.1 (-0.3, 0.4)
Internal examinations 451211321324262.7 (2.0)3.1 (1.8)-0.4 (-0.7, 0.0)
Giving birth 4497431229453.8 (1.5)4.0 (1.4)-0.2 (-0.5, 0.1)
Coping with the new baby 45136226161381.7 (1.7)1.8 (1.7)-0.1 (-0.4, 0.2)
Total CWS (13-items) 1.8 (1.9)2.0 (1.9)-0.2 (-0.3, -0.1)
Socio-medical a2.9 (1.9)3.0 (1.9)-0.2 (-0.3, 0.0)
Socio-economic b1.1(1.5)1.4 (1.7)-0.3 (-0.5, -0.1)
Health c2.0 (1.9)2.1(1.9)-0.1 (-0.3, 0.1)
Relationship d0.6 (1.0)0.6 (1.1)-0.1 (-0.2, 0.1)

a(Worry of giving birth, internal examinations, going to hospital, coping with the new baby),

b(money problems, housing problems, employment problems),

c(possibility of stillbirth, something wrong with the baby, own health, others’ health,

d(relationship with the family, relationship with partner); Level of worry (0 = not a worry, 5 = extremely worried) n: Number of women.

After adjusting for the clustering effect, the difference in mean score was -0.16 (95%CI: -0.31 to -0.01), where the upper limit of the confidence interval was -0.01 (taking 2.5% confidence level on each end), which was lower than the predefined non-inferiority margin of 0.3 for the hypothesis testing. The ICC for the difference in mean CWS score was 0.01.

Satisfaction with ANC services

In both groups, three of four women moderately or strongly agreed to the statement “I am satisfied with the antenatal care services I have received”, and an equal majority responded that they would come back to the same PHC, if become pregnant again, and would recommend it to others. Most of the pregnant women were moderately or strongly satisfied with the information and communication from their care providers, and there was no difference between the groups (Table 3).

Table 3
Women’s satisfaction with ANC services among TCC intervention and control arms in Palestine.
Trial armTotalLevel of agreement (%)aMean (SD)Mean Difference (95% CI) b
012345
I am satisfied with the antenatal care service I have receivedControl2143231833414.0 (1.2)0.1(-0.1, 0.3)
Intervention2373031633464.1 (1.1)
I would recommend the services to a friendControl214351642444.1 (1.2)0.1 (-0.1, 0.3)
Intervention235230743454.2 (1.0)
I would come back if I become pregnant againControl212331535534.2 (1.2)0.1 (-0.1, 0.3)
Intervention237231538524.3 (1.0)
I am always confident of when my next antenatal care visit isControl214311627644.4 (1.0)0.0 (-0.2, 0.1)
Intervention237230331604.4 (1.0)
The health staff take my questions and concerns seriouslyControl210221937494.2 (1.0)0.1 (-0.1, 0.3)
Intervention236280634564.4 (1.0)
I am well informed about the purpose of the tests the health staff runControl213385638403.9 (1.4)0.1 (-0.1, 0.4)
Intervention235383436464.0 (1.3)
I am well informed of when (gestational age) to do the testsControl213564539423.9 (1.4)0.1 (-0.2, 0.3)
Intervention235383540434.0 (1.3)

SD: Standard Deviation; CI: Confidence Interval;

a Level of agreement (0 = strongly disagree, 1 = moderately disagree, 2 = slightly disagree, 3 = slightly agree, 4 = moderately agree, 5 = strongly agree);

b unadjusted for the cluster effect.

Discussion

We have demonstrated that pregnant women receiving digital tailored text messages with health content during pregnancy, were not more worried compared to women in the control clusters, measured by the CWS. Even though not statistically significant, both the total and single item mean CWS scores were consistently lower for women in the TCC intervention arm compared to their counterparts in the control arm. Women in both arms were equally and generally satisfied with the ANC services they received from their public PHCs.

Most effectiveness trials of digital health interventions fail to report potential unintended consequences of the interventions [1,4,5]. This research gap is highlighted by WHO in its first digital health guideline [13]. The majority of health messaging interventions using mobile technologies, have up until now, included generic health promotion content [4]. Such content is generally acceptable and have most likely been considered as safe, which might explain the low attention towards unintended consequences of public health intervention in general [38], and health promotion in particular [10]. Precautions in composing individually tailored messages, which are increasing, are warranted to avoid harmful consequences. Furthermore, the communication of individualized risk factors to pregnant women needs special attention [39]. Co-designing theory-based interventions in an iterative process with users is recommended to secure the safety and effectiveness of messages [15]. We have followed these recommendations, and findings from a systematic review recommending identifying the sender, using a positively framed tone, and including content with solutions in a structured and focused manner [40].

Maternal age, previous adverse pregnancy outcomes, education, and employment status are known predictors of worries in pregnancy [14]. These can also affect the acceptance and understanding of the TCC intervention, hence be potential confounders to the main outcome of the study. However, we did not identify any statistically significant imbalances of these variables between intervention and control arms, and they were therefore not included in the final model. We took the cluster effect into account, but it did not markedly change the point estimate or the confidence interval of the estimate.

The mean CWS score for pregnant women in Palestine did not differ from other studies reported using the CWS [3035]. The items, such as, giving birth, hospital visits, internal examinations, something might be wrong with the baby, and the possibility of stillbirth, were in line with other studies, recoded with the highest mean scores [32]. Similarly, pregnant women in both the intervention and control arms were more worried about the socio-medical and health components compared to the socio-economic and relationship components of the CWS. We did not aim to validate the CWS (has not been validated in Arabic language); however, the good internal consistency score (Cronbach’s alpha = 0.74) might indicate that the CWS can be used for pregnant women in Palestine. Since this study is a non-inferiority trial, it does not intend to measure any benefit of the TCC intervention in terms of reducing pregnancy-related worries.

Due to the closure of PHCs and disruption of the TCC intervention in response to the COVID-19 pandemic, we ended the data collection period earlier than planned to ensure that we only included women who had been eligible for the full intervention. This resulted in the loss of six clusters and we only reached 83% of the planned sample size. However, we have no reason to believe that this has affected the main findings, nor that the emerging epidemic of COVID-19 in Palestine unequally affected the worries among women across arms. Our ethical clearance did not cover merging the sub-sample data with the data in the eRegistry. We have therefore no information about the number of timely scheduled ANC visits, the number of text messages, nor which text messages each woman in the sub-sample have received. Two in three women attended their first ANC visit in their first trimester and would be eligible to receive the full sequence of messages, a service that started in June 2019.

We interviewed women towards the end of their pregnancy and prior to delivery to ensure that they had been eligible for the full intervention and avoid any recall bias. Women who delivered or had an abortion prior to 38 weeks of gestation were not included. Our trained data collectors were not affiliated with the primary healthcare services to reduce the social desirability bias. The data collectors were blinded for the allocation to reduce the potential selection bias. The main strength of this sub-study was the study methodology including the design, the use of the validated CWS, and that we conducted a pilot test of the entire study tool.

Conclusion

Our TCC intervention via SMS to improve attendance to ANC did not have any unintended consequences in increasing pregnancy-related worries among recipients. There was no difference in women’s satisfaction with the ANC services between intervention and control arms.

Abbreviations

ANCAntenatal Care
CIConfidence Intervals
CWSCambridge Worry Scale
ICCIntra-cluster Correlation Coefficient
MCHMaternal and Child Health
PHCPrimary Healthcare Center
PNIPHPalestinian National Institute of Public Health
QIDQuality Improvement Dashboard
SDStandard deviation
SMSShort Message Service
TCCTargeted Client Communication

References

MSMarcolino, JAQOliveira, MD’Agostino, ALRibeiro, MBMAlkmim, DNovillo-Ortiz: The Impact of mHealth Interventions: Systematic Review of Systematic Reviews. JMIR mHealth and uHealth 2018, 6(1):e23. 10.2196/mhealth.8873

SHLee, UBNurmatov, BINwaru, MMukherjee, LGrant, CPagliari: Effectiveness of mHealth interventions for maternal, newborn and child health in low- and middle-income countries: Systematic review and meta-analysis. J Glob Health 2016, 6(1):010401010401. 10.7189/jogh.06.010401

YMCho, SLee, SMSIslam, SYKim: Theories Applied to m-Health Interventions for Behavior Change in Low- and Middle-Income Countries: A Systematic Review. Telemedicine journal and e-health: the official journal of the American Telemedicine Association 2018, 24(10):727741. 10.1089/tmj.2017.0249

SFSondaal, JLBrowne, MAmoakoh-Coleman, ABorgstein, ASMiltenburg, MVerwijs, et al: Assessing the Effect of mHealth Interventions in Improving Maternal and Neonatal Care in Low- and Middle-Income Countries: A Systematic Review. PLoS One 2016, 11(5):e0154664. 10.1371/journal.pone.0154664

AFeroz, SPerveen, WAftab: Role of mHealth applications for improving antenatal and postnatal care in low and middle income countries: a systematic review. BMC health services research 2017, 17(1):704. 10.1186/s12913-017-2664-7

VVodopivec-Jamsek, Tde Jongh, IGurol-Urganci, RAtun, JCar: Mobile phone messaging for preventive health care. The Cochrane database of systematic reviews 2012, 12:Cd007457. 10.1002/14651858.CD007457.pub2

FMuench, ABaumel: More Than a Text Message: Dismantling Digital Triggers to Curate Behavior Change in Patient-Centered Health Interventions. Journal of medical Internet research 2017, 19(5):e147e147. 10.2196/jmir.7463

BSFjeldsoe, ALMarshall, YDMiller: Behavior change interventions delivered by mobile telephone short-message service. American journal of preventive medicine 2009, 36(2):165173. 10.1016/j.amepre.2008.09.040

World Health Organization: WHO recommendations on antenatal care for a positive pregnancy experience. 2016. Geneva, Switzerland Accessed from: https://www.who.int/publications/i/item/9789241549912.

10 

LGugglberger: Can health promotion also do harm? Health Promotion International 2018, 33(4):557560. 10.1093/heapro/day060

11 

LMbuagbaw, SMursleen, LLytvyn, MSmieja, LDolovich, LThabane: Mobile phone text messaging interventions for HIV and other chronic diseases: an overview of systematic reviews and framework for evidence transfer. BMC health services research 2015, 15:3333. 10.1186/s12913-014-0654-6

12 

World Health Organization: WHO guideline: Recommendations on digital interventions for health system strengthening. Research considerations. Geneva: World Health Organization; 2019. (WHO/RHR/19.9) Licence: CC BY-NC-SA 3.0 IGO. In.

13 

World Health Organization: WHO guideline: recommendations on digital interventions for health system strengthening. Geneva: World Health Organization; 2019. Licence: CC BY-NC-SA 3.0 IGO. In.

14 

ABiaggi, SConroy, SPawlby, CMPariante: Identifying the women at risk of antenatal anxiety and depression: A systematic review. Journal of affective disorders 2016, 191:6277. 10.1016/j.jad.2015.11.014

15 

CLDennis, KFalah-Hassani, RShiri: Prevalence of antenatal and postnatal anxiety: systematic review and meta-analysis. Br J Psychiatry 2017, 210(5):315323. 10.1192/bjp.bp.116.187179

16 

ASinesi, MMaxwell, RO’Carroll, HCheyne: Anxiety scales used in pregnancy: systematic review. BJPsych open 2019, 5(1):e5e5. 10.1192/bjo.2018.75

17 

FAbdi, FNavidpour, MDolatian: A Literature Review of Pregnancy Worries and Stress Scales. Iran J Psychiatry Behav Sci 2018, 12(3):e14581.

18 

JFMvan den Heuvel, TKGroenhof, JHWVeerbeek, WWvan Solinge, ATLely, AFranx, et al: eHealth as the Next-Generation Perinatal Care: An Overview of the Literature. Journal of medical Internet research 2018, 20(6):e202. 10.2196/jmir.9262

19 

ALRathbone, JPrescott: The Use of Mobile Apps and SMS Messaging as Physical and Mental Health Interventions: Systematic Review. Journal of medical Internet research 2017, 19(8):e295. 10.2196/jmir.7740

20 

RJareethum, VTitapant, TChantra, VSommai, PChuenwattana, CJirawan: Satisfaction of healthy pregnant women receiving short message service via mobile phone for prenatal support: A randomized controlled trial. J Med Assoc Thai 2008, 91(4):458463.

21 

WJMStevens, Rvan der Sande, LJBeijer, MGMGerritsen, WJJAssendelft: eHealth Apps Replacing or Complementing Health Care Contacts: Scoping Review on Adverse Effects. J Med Internet Res 2019, 21(3):e10736. 10.2196/10736

22 

MADauletyarova, YMSemenova, GKaylubaeva, GKManabaeva, BToktabayeva, MSZhelpakova, et al: Are Kazakhstani Women Satisfied with Antenatal Care? Implementing the WHO Tool to Assess the Quality of Antenatal Services. International Journal of Environmental Research and Public Health 2018, 15(2):325. 10.3390/ijerph15020325

23 

Cde Labrusse, A-SRamelet, THumphrey, SJMaclennan: Patient-centered Care in Maternity Services: A Critical Appraisal and Synthesis of the Literature. Women’s Health Issues 2016, 26(1):100109. 10.1016/j.whi.2015.09.003

24 

MVenkateswaran, BBogale, KAbu Khader, TAwwad, IKFriberg, BGhanem, et al: Effective coverage of essential antenatal care interventions: A cross-sectional study of public primary healthcare clinics in the West Bank. PLOS ONE 2019, 14(2):e0212635. 10.1371/journal.pone.0212635

25 

BBogale, KMørkrid, BO’Donnell, BGhanem, IAbu Ward, KAbu Khader, et al: Development of a targeted client communication intervention to women using an electronic maternal and child health registry: a qualitative study. BMC Medical Informatics and Decision Making 2020, 20(1):1. 10.1186/s12911-019-1002-x

26 

JFFroen, SLMyhre, MJFrost, DChou, GMehl, LSay, et al: eRegistries: Electronic registries for maternal and child health. BMC Pregnancy Childbirth 2016, 16:11. 10.1186/s12884-016-0801-7

27 

MVenkateswaran, KMorkrid, BGhanem, EAbbas, IAbuward, MBaniode, et al: eRegQual-an electronic health registry with interactive checklists and clinical decision support for improving quality of antenatal care: study protocol for a cluster randomized trial. Trials 2018, 19(1):54. 10.1186/s13063-017-2386-5

28 

MKCampbell, GPiaggio, DRElbourne, DGAltman: Consort 2010 statement: extension to cluster randomised trials. BMJ: British Medical Journal 2012, 345:e5661. 10.1136/bmj.e5661

29 

K.Mørkrid, B.Bogale, E.Abbas et al. eRegCom—Quality Improvement Dashboard for healthcare providers and Targeted Client Communication to pregnant women using data from an electronic health registry to improve attendance and quality of antenatal care: study protocol for a multi-arm cluster randomized trial. Trials 22, 47 (2021). 10.1186/s13063-020-04980-1

30 

JMGreen, KKafetsios, HEStatham, CMSnowdon: Factor structure, validity and reliability of the Cambridge Worry Scale in a pregnant population. J Health Psychol 2003, 8(6):753764. 10.1177/13591053030086008

31 

FJCarmona Monge, CPeñacoba-Puente, DMarín Morales, ICarretero Abellán: Factor structure, validity and reliability of the Spanish version of the Cambridge Worry Scale. Midwifery 2012, 28(1):112119. 10.1016/j.midw.2010.11.006

32 

EYigit Gunay, AGul: Reliability and validity of the Cambridge Worry Scale in pregnant Turkish women. Midwifery 2015, 31(3):359364. 10.1016/j.midw.2014.10.003

33 

KGourounti, KLykeridou, CTaskou, KKafetsios, JSandall: A survey of worries of pregnant women: Reliability and validity of the Greek version of the Cambridge Worry Scale. Midwifery 2012, 28(6):746753. 10.1016/j.midw.2011.09.004

34 

JJPetersen, MAPaulitsch, CGuethlin, JGensichen, AJahn: A survey on worries of pregnant women—testing the German version of the Cambridge Worry Scale. BMC Public Health 2009, 9(1):490. 10.1186/1471-2458-9-490

35 

SGOhman, CGrunewald, UWaldenstrom: Women’s worries during pregnancy: testing the Cambridge Worry Scale on 200 Swedish women. Scand J Caring Sci 2003, 17(2):148152. 10.1046/j.1471-6712.2003.00095.x

36 

FMortazavi, AAkaberi: Worries of Pregnant Women: Testing the Farsi Cambridge Worry Scale. Scientifica 2016, 2016:10. 10.1155/2016/5791560

37 

PASS 2019 Power Analysis and Sample Size Software (2019). NCSS, LLC. Kaysville, Utah, USA, ncss.com/software/pass.

38 

LKAllen-Scott, JMHatfield, LMcIntyre: A scoping review of unintended harm associated with public health interventions: towards a typology and an understanding of underlying factors. International journal of public health 2014, 59(1):314. 10.1007/s00038-013-0526-6

39 

RRaine, MCartwright, YRichens, ZMahamed, DSmith: A Qualitative Study of Women’s Experiences of Communication in Antenatal Care: Identifying Areas for Action. Maternal and Child Health Journal 2010, 14(4):590599. 10.1007/s10995-009-0489-7

40 

HMRAmes, CGlenton, SLewin, TTamrat, EAkama, NLeon: Clients’ perceptions and experiences of targeted digital communication accessible via mobile devices for reproductive, maternal, newborn, child, and adolescent health: a qualitative evidence synthesis. Cochrane Database of Systematic Reviews 2019(10).