Skip to main content

Development and testing of mobile phone text messages for improving maternal and newborn care practice in Jimma Zone, Ethiopia: a user-centered design approach

Abstract

Background

Mobile phone-based messaging for maternal education has indicated promising outcomes in promoting maternal and newborn care practices. However, most mobile phone-based messaging interventions are not tested before their implementation, and the evidence on the message content development process and methods is limited and underreported. The aim of this study was to develop and test text messages for interventions designed to improve maternal services utilization and newborn care practices.

Methods

The development process has 4 phases: engaging pregnant mothers and experts in selected districts of the Jimma Zone, Ethiopia. During phase 1, the draft messages were developed based on the message framing concept, and the number of messages was reduced after review. In phase 2, 12 mothers participated in card sorting and the messages were refined. In phase 3, 8 experts evaluated the messages using 10 items with a 5-point Likert scale. In phase 4, a pilot study (n = 30) was conducted to evaluate the messages and their delivery when they were sent to individuals’ mobile telephones. In this phase, a system usability scale was also used to assess the usability of the planned intervention.

Results

An initial bank of 120 messages was developed, 42 of which were discarded during the development process. Of these, 32 were discarded by the research team at phase 1, and 10 were discarded during the card sorting at phase 2. Based on the experts’ evaluations, 14 messages were reworded and refined in phase 3. During the pilot testing phase, the majority (80%) of the participants mentioned that the time they had been receiving the message was early, and 66.7% of the participants preferred the time to receive text messages about health. The mean SUS score was 72.26, which is acceptable for the usability of the mobile phone-based messaging intervention.

Conclusion

A final bank of 78 (39 for each framing type) messages was obtained after refinement according to feedback from participants. The SUS showed an acceptable score for the planned intervention. This message development process confirms that the messages are acceptable, and important for improving maternal and newborn health care practices.

Trial registration

PACTR202201753436676.

Key messages

• What uncertainties existed regarding the feasibility?

Although it is recommended to document the development process of mobile phone messaging-based intervention, this part of interventions is limited and underreported in literature. In addition to this, from published mobile phone messaging-based intervention that described about development process, some lack detail information and other focused only on software development process.

• What are the key feasibility findings?

In this message development process, end users (pregnant mothers) and experts were involved for their perspective on the draft messages and a total of 78 final messages were obtained through refinement based on their feedback. The usability test finding has confirmed acceptability of the intervention. End-users’ preference such as frequency, timing and language for receiving text messages were identified.

• What are the implications of the feasibility findings for the design of the main study?

End-user and expert involvement in this development process believed to facilitate the feasibility, acceptability, and engagement in the future intervention. Finding at in each phase of the development process has helped modifying messages content and messaging system used for the main intervention. Finding on end-user time and frequency preferences to receive text messages has also informed the revision of the message scheduling of main intervention.

Peer Review reports

Background

Every day, an estimated 800 women die due to preventable causes related to pregnancy and childbirth, and 6500 newborns die mainly due to complication of premature birth, birth asphyxia and infections. Additionally, 94% of all maternal and neonatal deaths occur in low- and middle-income countries [1,2,3]. Maternal and newborn deaths occur mainly from preventable causes, such as infectious diseases and complications during pregnancy, labor, childbirth, and the postpartum period [4]. Despite the government’s commitment to improving maternal and newborn health [5], Ethiopia’s maternal mortality ratio is 267 deaths per 100,000 live births and its neonatal mortality rate is 27 deaths per 1000 live births [2, 6]. These figures put Ethiopia among the top countries in terms of maternal and neonatal mortality rates [3]. Providing education to mothers during the antenatal and postnatal periods has effectively improved maternal and neonatal health service utilization and newborn care practices [7] and reduced overall neonatal mortality [8].

Introducing new strategies such as mHealth is accepted as a suitable means for reducing high maternal and child death rates in low-income nations [9, 10]. From mHealth technology, short message service (SMS) is an acceptable and widely used tool for educating mothers to promote antenatal delivery, newborn care, and postnatal care utilization [11, 12]. SMS-based intervention has been successfully implemented and has indicated promising outcomes in promoting maternal and child health care services [13,14,15,16] due to its greater readership and greater engagement advantage over other means of communication [17], providing short, timely information for behavior change [18]. Text message-based interventions should incorporate how the message is developed on its theoretical basis, cultural adaptation to the end user, and context before it is implemented [19, 20] for utility [21, 22].

Although it is recommended to start documenting the development of any mHealth-based intervention planned to promote behavior changes during the early stages of the protocol [23], evidence of the content development process and testing methods are limited and underreported in the literature [20, 24]. Among the published text messaging interventions that describe development and testing processes, some lack detailed information about the process [20, 25], and others focus on the messaging system development process, ignoring the message content [26].

For a successful SMS-based intervention, the target audience should provide feedback on the message content and learn the language preferences, timing, and number of text messages they receive [13, 27]. End-user involvement in the mHealth intervention development process facilitates the feasibility, acceptability, and engagement of the intervention [28]. In addition, health workers’ expectations and readiness to implement the suggested interventions when developing digital interventions are needed [29]. The perspectives of these end users and implementers can be addressed by applying a user-centered design approach [30]. User-centered design is a multidisciplinary and iterative design approach based on the active involvement of users in each phase of the design process to improve the understanding of users and requirements [31]. This approach uses methods such as focus group discussion, survey, interview, usability testing, card sorting, and participatory design. However, there is inconsistency in the utilization of these methods; for example, some researchers have used card sorting with end users [30, 32, 33], others have used expert evaluation [24, 30, 34,35,36], while focus group discussion [24, 36, 37] and pilot with members of the end user [30, 38, 39] have been used by some of the researchers. Moreover, to our knowledge, none of the mHealth interventions conducted in Ethiopia reported the development and testing of message content tailored to the local context.

Considering the variation in the methods used and the limited literature on the design and development of mobile phone-based messaging interventions for improving maternal and newborn health in rural areas of Ethiopia, this study presents the development and testing process by integrating different methods previously used. The message content was drafted based on the concept of framing. Framing is the way information is presented to individuals by emphasizing the benefits of taking action (i.e., a gain-framed) or the costs of failing to take action (i.e., a loss-framed message) to influence subsequent decisions of individuals [40]. However, to the best of our knowledge, mHealth interventions that are implemented in Ethiopia has not used and evaluated the effect of message framing approach on promote maternal and newborn health. Hence, the current development process was carried out by integrating user-centered design approach methods: card sorting, interviews, pilot testing, system usability testing and expert review. In addition to adding the mobile phone-based messaging intervention development process to the body of knowledge, this study provides recommendations and lessons learned from the process for similar interventions targeting pregnant mothers.

Method

Overview

This text message development and testing is part of a cluster randomized control trial (the trial identifier is PACTR202201753436676). This trial examines the effectiveness of a mobile phone messaging-based message framing intervention designed for improving maternal and newborn health in the Jimma Zone, Oromia, Ethiopia. This paper explains the development process of text messages targeting pregnant mothers for improving maternal and newborn health outcomes. The development of the messages involved four phases: research team feedback, user center design techniques (card sorting, interviews, and survey), expert review, and pilot testing(Fig. 1).

Fig. 1
figure 1

Phases and methods of the message development process for Mobile phone messaging-based intervention for improving maternal and newborn health in Jimma Zone, Ethiopia

Phase I: message drafting

The initial messages concerning different issues were drafted based on what pregnant women should be counseled during pregnancy and childbirth and after according to the Ethiopian Ministry of Health guidelines for antenatal care [41] and the World Health Organization (WHO) antenatal and postnatal care guidelines [42]. These messages were developed based on the concept of message framing, where half of them developed in the form of a gain frame—emphasizing the benefit of maternal and newborn health care practices—and the other half developed as a loss frame—emphasizing loss as a result of not utilizing maternal health services and practicing newborn care. Since the maximum number of characters allowed for text messages is limited to 160, including spaces, the content of the messages was developed within that character count. The draft messages were reviewed by other research teams, and the number of messages was reduced. Once a decision was made on the number and which messages should be included in the next phase, the messages were translated from English into the local language Afan Oromoo by maternal and child health experts and back-translated to English by a language expert who is fluent both in English and Afan Oromoo.

Phase II: end-user content testing

In this phase, a closed-card sorting activity was carried out to determine the level at which the pregnant mothers understood each message. The card sorting activity was conducted with pregnant mothers who had been residents of the study area for at least 6 months and who could speak and read the Afan Oromoo. Twelve (6 for each message type) pregnant mothers who were selected using a convenient sampling technique participated in this activity. Participants were provided with cards that had Afan Oromoo version messages selected in phase one and then asked to sort the messages into predefined piles named with different topic areas related to maternal and newborn health. The participants were also provided with a blank card if they had any suggestions to add more messages.

The card sorting data were entered into an adapted Excel spreadsheet template that was developed for analyzing the cards [43]. The analysis was performed to evaluate the card-level agreement of the original thematic area. The messages on the cards were considered for the next phase if ≥ 50% of participants had sorted the card into the intended thematic area.

Phase III: expert evaluation

Health communication experts and health workers who are providing maternal and newborn health services evaluated the message content for clarity, ease, tone, believability, benefit, receiving attention, appropriate language and offensiveness. A total of 8 (4 for each message form) experts who were working in the study area for at least 6 months before this evaluation and who could speak and read the Afan Oromoo were purposively selected and took part in this evaluation. The evaluation was performed online using a Google form link shared with the participants through their email. The participants were provided with all the messages selected in phase II and asked to rate each message using 10 five-point Likert scale items that were developed based on the criteria for reviewing health communication messages [38]. The response of each expert to the messages was entered into SPSS 25. A total sum score was created for each message by combining scores for all 10 questions, ranging from 10 to 50. Messages with an average sum score ≥ 33.3 and suggested to be selected with original content or modification were considered in the next phase. Messages with an average sum score lower than 33.3 were considered for discarding with the option for revisions based on participant feedback. Following this rating, the experts were asked for their recommendation on whether to use, discard, or modify the message and why they recommend removing it or modifying it. Then, they were asked to suggest how to improve the message that was recommended to be removed or modified. The messages evaluated in this phase were refined and incorporated into the developed message dispatching platform for the next phase of testing.

Phase IV: pilot testing

In this phase, the messages and their delivery were evaluated when the messages were sent to individual mobile telephone devices. The messages were dispatched using software that was locally developed by software programmers based on input from the research team. This software works in combination with the internet, a computer, and a phone to send messages to multiple phone numbers. A domain and short code were purchased from Ethiotelcom Company, and the short code was named “Ulfa Mijuu”. The software program has an interface to enter the participant’s name, gestational week, mobile phone number, message type (loss or gain frame), message category, language option, report generation and feedback options. Before carrying out the pilot study, the software underwent unit testing in eight key dimensions: message functionality, contact management, security, user interface, connectivity, performance, integration, and compatibility. The testing confirmed the software's reliability, effectiveness, versatility, and dependable messaging capabilities under various network conditions. However, multiple mobile management, language, report generation, and feedback options were incorporated following the testing.

Thirty pregnant mothers who voluntarily provided their mobile phone numbers to take part and give feedback in the pilot test were selected. Fifteen participants were randomly assigned to the gain frame messages, and the other 15 were assigned to the loss frame messages. Twenty messages were sent sequentially in the morning every day during the weekday for a month. The research team had been calling the participants every other day to ask them what they were experiencing with receiving messages, give feedback on the message content, and encourage them to engage and minimize dropout during the pilot testing. At the end of the pilot test, all of the participants were interviewed using a questionnaire that addressed the timing, preferred language and timing of receiving messages; clarity, and understandability; and length of the message. Participants were also asked to rate the usability of the planned mobile phone-based messaging intervention using the adapted System Usability Scale (SUS). The SUS tool consists of 10 statements that are scored on a 5-point Likert scale (1 = strongly disagree and 5 = strongly agree) [44]. SPSS 25 was used for entering, and descriptive analyses, such as frequency, mean, standard deviation, and percent analysis, were performed. The participants’ scores for each statement of the SUS were added together and then multiplied by 2 to convert the original scores from 5–50 to 10–100. Scores for the SUS range from 10 to 100.

Results

Phase I: message drafting

HG and GB wrote the initial 120 messages to provide one-way information about maternal and newborn care during pregnancy to the postnatal period based on the topic area that pregnant women should be counseled according to the Ethiopian Ministry of Health guidelines for antenatal care [41] and World Health Organization (WHO) antenatal and postnatal care guidelines [42]. The messages were developed under 10 thematic areas, namely, nutrition, lifestyle modification, danger signs, birth preparedness and complication readiness, breastfeeding practice, labor, newborn care, immunization, and antenatal and postnatal care utilization. Following the initial development, the research team reviewed the messages, discussed the negative effect of dispatching 120 messages during the pregnancy period and reduced the number of messages to 88 (44 for each message type) by removing a minimum of one message from each thematic area and merging the content of some messages. Example draft messages under each thematic area are presented in Table 1.

Table 1 Example draft messages from each category for gain and loss framed messages

Phase II: end-user content testing

Based on the predetermined criteria for card sorting activity, 39/44 (88.6%) of the cards of gain-framed messages had ≥ 50% placement in the corresponding category. Of these cards, except for card number 44 (content is about nutrition during postnatal care), which was placed in the breastfeeding category, all of them were placed in the originally set corresponding thematic area. Card numbers 6, 11, 15, 21, and 32 were not categorized by the majority of participants and were placed in many categories. Hence, those 39 messages with ≥ 50% card-level agreement with the original category were considered in the next phase (Table 2).

Table 2 Average placement agreement and category per card for card sorting activity for gain-framed messages by pregnant mothers in the Jimma Zone, Ethiopia

In addition, 39/44 (88.6%) of the cards in the loss-framed messages had ≥ 50% placement in the original corresponding category. Except for cards numbers 7 and 9, which were placed under nutrition while supposed to be placed under the lifestyle modification category, all of these cards were placed in the original corresponding category. Similarly, in the gain-framed message type, card numbers 6, 11, 15, 21, and 32 of the loss-framed messages were not categorized in any preset categories by the majority of participants. Hence, those 39 loss-framed messages with a card-level agreement ≥ 50% in the corresponding category were considered to be in the next phase for expert review (Table 3).

Table 3 Average placement agreement and category per card for card sorting activity for loss-framed messages by pregnant mothers in the Jimma Zone, Ethiopia

Phase III: expert evaluation

According to our expert review, 39 (100%) gain-framed messages received an average sum score > 33.3. None of the participants suggested discarding these messages, and only one message about personal hygiene was suggested to be modified; 38/39 messages were suggested to be used with the original content by all of the participants. Regarding the loss-framed message type, 37/39 (94.8%) of the messages received an average sum score > 33.3. Messages about coffee consumption and extra meals during pregnancy had average summed scores of 27.4 and 29.4, respectively. From all loss-framed messages, it was suggested that three messages be discarded by only one participant, while 11 of them were suggested for modification. All of the loss-framed messages were suggested to be used with original content by at least 50% of the participants, while 26/39 (66.6%) of the messages were suggested to be used with the original concept by four of the participants. Comparing the evaluations of the experts among the message types, gain-framed messages have a higher average sum than loss-framed messages with equivalent meanings. One-third of the loss-framed messages were suggested to be modified, three were suggested for discarding, one was suggested for modification, and no message was suggested for discarding from the gain-framed message type. An additional file shows the findings of expert reviews in more detail [see Additional file 1].

For messages that were suggested for modification, the experts were asked to recommend what should be changed and how it should be improved. The main recommendations they provided for improving these messages were to shorten the length of the messages (for which the translated version of the message is a little bit longer than the English version) and rewrite the messages using the dialects of the local community to make them more accepted. Considering the economic situation of the community while providing information about nutrition was also suggested. For instance, it was suggested that personal hygiene messages from both message types be modified by adding a phrase about what to use for hand washing when there is no soap in the household. One of the experts also suggested not using loss frame messages because they indicate bad outcomes that may annoy the mothers. Some terms that can be difficult for mothers to understand were also suggested to be replaced by other words with the same meaning. For instance, the Afan Oromoo version of the word “complication” was suggested to be replaced with another word because a mother cannot understand its meaning, and it was modified based on the given suggestion. All (13 loss-framed and 1 gain-framed) messages that were suggested for modification were modified and refined based on the experts’ recommendations. Based on the preset criteria, all 78 messages (39 from each message type) were refined and considered for the next phase of development, which was pilot testing. Although they had a lower average sum score, messages about coffee consumption and extra meals during pregnancy from the loss frame type were also considered for the next phase after modification based on the participants’ suggestions.

Phase IV: pilot testing

The findings of the pilot test are presented in Table 4. The mean age of the participants was 25.4 years, and their average gestational age was 24.3 weeks. All of the participants had never previously taken part in any mobile phone-based messaging intervention. A majority (80%) of the participants mentioned that the time they had been receiving the message was early, and 66.7% of the participants preferred the afternoon to receive text messages about health. For 46.7% of the participants, 2 messages per week was the preferred frequency of receiving the messages, and the Afan Oromoo was the preferred language for 29 (96.7%) of them. On average, 17 out of the 20 messages were read by the participants. A majority (60%) of the participants stated that the message they received was of the right length. Fourteen (46.7%) of the participants said the message they received was very clear, while only one of them said it was unclear. A large number (86.7%) of the participants stated that the content and meaning of the messages were easy to understand. The mean SUS score was 72.26, with a SD of 7.2 and a range of 58–88; this mean score was above 68 for 27/30 (90%) of the participants. In the pilot test, all 20 text messages were automatically dispatched from the application software to the participants.

Table 4 Descriptive results for pilot testing of messages developed for improving maternal and newborn care practices in the Jimma Zone, Ethiopia (n = 30)

Discussion

Message development, testing and refinement process in this study involved card sorting, interviews, expert review, pilot testing, and system usability testing. Previous studies that presented text message development for health intervention have also used methods such as applying behavior change theory [24, 45], card sorting with end users [32, 33], expert evaluation, focus group discussion [24, 36, 37] and pilot study with the end user [30, 38, 39]. However, the current development process integrates different methods. Using the system usability scale during the pilot phase also helped to identify the acceptability of the message content and the messaging software program. Integrating various methods in the message development process is achievable and leads to important feedback that improves the usability of messages.

In phase 1, the research team discussed and reduced the draft 120 messages to 88 (44 for each message type), considering the negative effect of sending too many messages that may lead to burdensome, boring, and tiresome [39]. Based on the card sorting activity in phase 2, 78/88 (88.6%) were considered the next phase. Except one card from nutrition category but placed in the breastfeeding category, all of gain-framed messages were placed in the preset thematic category. The difference observed with this specific message might be due to the presence of the phrase “breastfeeding” in the content of this message, which elaborates on the importance of extra meals during breastfeeding. Two cards with loss-framed messages were misplaced under nutrition category while they were supposed to be under the lifestyle modification category. The content of the message on these cards includes information about food preparation and eating raw meat, and we beilive this misled the participants to place it under nutrition category. Ten messages were removed because they had low average placement scores and were not placed in any preset category. Although the analysis took a long time, the card-sorting activity technique was quick and produced clear and consistent findings. Thus, card sorting is an important technique when engaging end users and providing feedback for the text message development process are needed.

All the experts who participated in the message evaluation in phase 3 provided positive feedback on both types of messages. All the messages used at this phase were considered for next phase after refining the message that experts suggested for modification.. Although previous studies used expert review, some used only 3 questions to address clarity, usefulness, and relevance [34, 35], while others evaluated the quality of the message using only 1 question [30]. Using 10 items that are recommended for evaluating health messages [46] for expert evaluation has helped to obtain persuasive text messages in the current message development process. We have learned engaging experts who know the local context is crucial to identifying potential issues with message content. Considering experts suggestions and inputs are also important for quick refinement of the messages.

Based on findings from pilot testing in phase 4, the developed message is acceptable to pregnant mothers. The findings from the SUS score indicated a mean score of 72.26, which was above the minimal acceptable score. This finding is also comparable with a previous study that revealed a mean SUS score of 71.06 for health information [47]. Taking time in the pilot testing of the development process helps individuals understand and modify messages and messaging system based on end-user preferences (such as timing, frequency, and language) for better adherence. Incorporating SUS measurements in the pilot testing phase of the message development process is important because it is quick and helps to identify the usability of the messaging system and the acceptability of the developed text messages.

As a limitation, the current study included a small sample for card sorting activity. Although the total sample was sufficient for the activity, it was too small when it was shared for each message type. Pilot-testing participants were asked how many messages they had read, but they were not asked which message they read. Furthermore, the effects of message framing on improving maternal health utilization and newborn care practices were not assessed in the pilot phase of this study.

Conclusion

A final bank of 78 (39 for each gain and loss-framed) messages was obtained through refinement based on participants’feedback at each phase of the development process. The messages were developed using national and international guidelines, theory, expert reviews, card sorting activities, interviews, the SUS and pilot testing. Although future studies are needed to test the effectiveness of loss- and gain-framed text messages, the message development process of the current study confirms that the messages are acceptable, evidence, and useful. The next step is to examine the effects of framed messages on improving maternal health service utilization and newborn care practice in a cluster randomized control trial using the final message content, information on end-user preference, and the developed software in the current study.

Data availability

The datasets generated from the current study are available from the corresponding author upon reasonable request.

Abbreviations

SMS:

Short message service

SPSS:

Statistical Package for the Social Sciences

SUS:

System usability scale

WHO:

World Health Organization

References

  1. WHO, UNICEF, UNFPA, And WBG, Division. Trends in Maternal Mortality 2000 to 2017. Vol. 390, The Lancet. 2017. S29 p.

  2. UNICEF. UNICEF. 2020. Neonatal mortality - UNICEF DATA. Available from: https://data.unicef.org/topic/child-survival/neonatal-mortality/

  3. World Health Organization. Newborns: improving survival and well-being. Available from: https://www.who.int/news-room/fact-sheets/detail/newborns-reducing-mortality

  4. Mahmood MA, Mufidah I, Scroggs S, Siddiqui AR, Raheel H, Wibdarminto K, et al. Root-Cause Analysis of Persistently High Maternal Mortality in a Rural District of Indonesia : Role of Clinical Care Quality and Health Services Organizational Factors. 2018;2018.

  5. Mullan Z. Transforming health care in Ethiopia. Lancet Glob Heal. 2016;4(1):e1.

    Article  Google Scholar 

  6. UNICEF. Maternal mortality rates and statistics - UNICEF DATA. 2020. Available from: https://data.unicef.org/topic/maternal-health/maternal-mortality/

  7. Yadav AK, Sahni B, Jena PK. Education, employment, economic status and empowerment: Implications for maternal health care services utilization in India. J Public Aff. 2021;21(3):1–11.

  8. Lassi ZS, Kedzior SGE, Bhutta ZA. Community-based maternal and newborn educational care packages for improving neonatal health and survival in low- and middle-income countries. Cochrane Database Syst Rev. 2019;2019(11):138–41.

  9. Atnafu A, Bisrat A, Kifle M, Taye B, Debebe T. Mobile health (mHealth) intervention in maternal and child health care: Evidence from resource-constrained settings: A review. Ethiop J Heal Dev. 2015;29(3):140–53.

    Google Scholar 

  10. Lee SH, Nurmatov UB, Nwaru BI, Mukherjee M, Grant L, Pagliari C. Effectiveness of mHealth interventions for maternal, newborn and child health in low–and middle–income countries: Systematic review and meta–analysis. J Glob Health. 2016;6(1):1–17.

    Google Scholar 

  11. Mccool J, Dobson R, Whittaker R, Paton C. Mobile Health ( mHealth ) in Low- and Middle-Income Countries. Annu Rev Public Health. 2022;43:525–39.

    Article  PubMed  Google Scholar 

  12. Huang S, Li M. Piloting a mHealth intervention to improve newborn care awareness among rural Cambodian mothers: A feasibility study. BMC Pregnancy Childbirth. 2017;17(1):1–7.

    Article  Google Scholar 

  13. Zhou Z, Su Y, Heitner J, Si Y, Wang D, Zhou Z, et al. The effects on inappropriate weight for gestational age of an SMS based educational intervention for pregnant women in Xi’an China: A quasi- randomized controlled trial. Int J Environ Res Public Health. 2020;17(5):1–11.

  14. Tobe RG, Haque SE, Ikegami K, Mori R. Mobile-health tool to improve maternal and neonatal health care in Bangladesh: A cluster randomized controlled trial. BMC Pregnancy Childbirth. 2018;18(1):1–8.

    Article  Google Scholar 

  15. Poorman E, Gazmararian J, Parker RM, Yang B, Elon L. Use of text messaging for maternal and infant health: a systematic review of the literature. Matern Child Health J. 2015;19(5):969–89.

    Article  PubMed  Google Scholar 

  16. Lau YK, Cassidy T, Hacking D, Brittain K, Haricharan HJ, Heap M. Antenatal health promotion via short message service at a Midwife Obstetrics Unit in South Africa: A mixed methods study. BMC Pregnancy Childbirth. 2014;14(1):1–8.

    Article  Google Scholar 

  17. Free C, Phillips G, Galli L, Watson L, Felix L, Edwards P, et al. The Effectiveness of Mobile-Health Technology-Based Health Behaviour Change or Disease Management Interventions for Health Care Consumers: A Systematic Review. PLoS Med. 2013;10(1):1–45.

  18. Douglas N, Free C. “Someone batting in my corner”: Experiences of smoking-cessation support via text message. Br J Gen Pract. 2013;63(616):768–76.

    Article  Google Scholar 

  19. Githinji S, Jones C, Malinga J, Snow RW, Talisuna A. Development of a text ‑ messaging intervention to improve treatment adherence and post ‑ treatment review of children with uncomplicated malaria in western Kenya. Malar J. 2015;1–9.

  20. Willoughby JF, Furberg R. Underdeveloped or Underreported ? Coverage of Pretesting Practices and Recommendations for Design of Text Message – Based Health Behavior Change Interventions. 2015;472–8.

  21. Ricci-cabello I, Bobrow K, Mohammed S, Islam S, Chow CK, Maddison R, et al. Examining Development Processes for Text Messaging Interventions to Prevent Cardiovascular Disease : Systematic Literature Review Corresponding Author. JMIR mHealth uHealth. 2019;7(2):1–13.

    Google Scholar 

  22. U.S. Department of Health and Human Services. Health Resources and Services Administration. Using Health Text Messages to Improve Consumer Health Knowledge, Behaviors, and Outcomes: An Environmental Scan. U.S. Department of Health and Human Services. Maryland; 2014.

  23. Ybarra ML, Holtrop JS, Bosi ATB, Emri S. Design considerations in developing a text messaging program aimed at smoking cessation. J Med Internet Res. 2012;14(4):1–10.

  24. Diez-Canseco F, Alfredo Zavala-Loayza J, Beratarrechea A, Kanter R, Ramirez-Zea M, Rubinstein A, et al. Design and Multi-Country Validation of Text Messages for an mHealth Intervention for Primary Prevention of Progression to Hypertension in Latin America. JMIR mHealth uHealth. 2015;3(1):1–11.

  25. Flax VL, Negerie M, Ibrahim AU, Leatherman S, Daza EJ, Bentley ME. Integrating Group Counseling, Cell Phone Messaging, and Participant-Generated Songs and Dramas into a Microcredit Program Increases Nigerian Women Õ s Adherence to International Breastfeeding Recommendations 1–3. J Nutr. 2014;144:1120–4.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  26. Mekonnen ZA, Hussien FN, Tilahun B, Gelaye KA, Mamuye A. Development of automated text-message reminder system to improve uptake of child vaccination in Ethiopia. Online J Public Health Inform. 2019;11(2):1–17.

    Article  Google Scholar 

  27. Owens C, Farrand P, Darvill R, Emmens T, Hewis E, Aitken P. Involving service users in intervention design: A participatory approach to developing a text-messaging intervention to reduce repetition of self-harm. Heal Expect. 2011;14(3):285–95.

    Article  Google Scholar 

  28. O’Cathain A, Croot L, Duncan E, Rousseau N, Sworn K, Turner KM, et al. Guidance on how to develop complex interventions to improve health and healthcare. BMJ Open. 2019;9(8):1–9.

    Google Scholar 

  29. Murray E, Burns J, May C, Finch T, O’Donnell C, Wallace P, et al. Why is it difficult to implement e-health initiatives? A qualitative study Implement Sci. 2011;6(1):1–11.

    Google Scholar 

  30. Pathak LE, Aguilera A, Williams JJ, Lyles CR, Hernandez-Ramos R, Miramontes J, et al. Developing messaging content for a physical activity smartphone app tailored to low-income patients: User-centered design and crowdsourcing approach. JMIR mHealth uHealth. 2021;9(5):1–12.

  31. Mao JY, Vredenburg K, Smith PW, Carey T. The state of user-centered design practice. Commun ACM. 2005;48(3):105–9.

    Article  Google Scholar 

  32. De JNB, Kip H, Kelders SM. Evaluation of the Perceived Persuasiveness Questionnaire: User-Centered Card-Sort Study. J Med Internet Res. 2020;22(10):1–14.

    Google Scholar 

  33. Yuhas M, Porter KJ, Brock DJP, Loyd A, McCormick BA, Zoellner JM. Development and pilot testing of text messages to help reduce sugar-sweetened beverage intake among rural caregivers and adolescents: Mixed methods study. JMIR mHealth uHealth. 2019;7(7):1–15.

  34. MacPherson M, Cranston K, Johnston C, Locke S, Jung ME. Evaluation and Refinement of a Bank of SMS text messages to promote behavior change adherence following a diabetes prevention program: Survey Study. JMIR Form Res. 2021;5(8):1–13.

    Article  Google Scholar 

  35. Chai LK, May C, Collins CE, Burrows TL. Development of text messages targeting healthy eating for children in the context of parenting partnerships. Nutr Diet. 2019;76(5):515–20.

    Article  PubMed  Google Scholar 

  36. Parra S, Ortega A, Kanter R, Kain J. Process of developing text messages on healthy eating and physical activity for Chilean mothers with overweight or obese preschool children to be delivered via WhatsApp. http://www.editorialmanager.com/cogentsocsci. 2018 Jan 1;4(1):1–11.

  37. Jones RM, Kimenju G, Subbiah S, Styles A, Pearson N, Rajasekharan S. A Short Message Service ( SMS ) increases postpartum care-seeking behavior and uptake of family planning of mothers in peri- urban public facilities in Kenya. PLoS ONE. 2020;15(9):1–13.

    Article  Google Scholar 

  38. Redfern J, Thiagalingam A, Jan S, Whittaker R, Hackett ML, Mooney J, et al. Development of a set of mobile phone text messages designed for prevention of recurrent cardiovascular events. Eur J Prev Cardiol. 2014;21(4):492–9.

    Article  PubMed  CAS  Google Scholar 

  39. Shaw RJ, Bosworth HB, Hess JC, Silva SG, Lipkus IM, Davis LL, et al. Development of a theoretically driven mhealth text messaging application for sustaining recent weight loss. JMIR mHealth uHealth. 2013;1(1):1–14.

  40. Weber E. Doing the right thing willingly: Using the insights of behavioral decision research for better environmental decisions. Shafir E, editor. The behavioral Foundation of Public Policy. Princeton: Princeton University Press; 2012. 380–397 p.

  41. Federal Democratic Republic Of Ethiopia Ministry Of Health. National Antenatal Care Guideline. 2021.

  42. World Health Organization (WHO). WHO recommendations on antenatal care for a positive pregnancy experience. 2016. p. 172.

  43. Lamantia J. Analyzing Card Sort Results with a Spreadsheet Template [Internet]. 2003. Available from: https://boxesandarrows.com/analyzing-card-sort-results-with-a-spreadsheet-template/

  44. Lewis JR. The System Usability Scale: Past, Present, and Future. Int J Hum Comput Interact. 2018;34(7):577–90.

    Article  Google Scholar 

  45. Woolford SJ, Clark SJ, Strecher VJ, Resnicow K. Tailored mobile phone text messages as an adjunct to obesity treatment for adolescents. J Telemed Telecare. 2010;16(8):458–61.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Public Health Ontario; Dalla Lana School of Public Health. Health Communication Message Review Criteria. 2nd ed. Toronto, ON: Queen’s Printer for Ontario; 2012. 1–7 p.

  47. Hyzy M, Bond R, Mulvenna M, Bai L, Dix A, Leigh S, et al. System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis. JMIR mHealth uHealth. 2022;10(8):1–11.

    Article  Google Scholar 

Download references

Acknowledgements

The study team extends heartfelt gratitude to participants who took part in their participation and valuable contribution and feedback in this message development and testing process.

Funding

This work was carried out with grants from Jimma University.

Author information

Authors and Affiliations

Authors

Contributions

The study was conceived by HG and GB. A review of draft messages was performed by ZB, DA and JN, while implementation was carried out by HG, GB, ZB, DA and JN. HG conducted the data analysis and created the initial draft, and all the authors approved the final draft.

Corresponding author

Correspondence to Hordofa Gutema Abdissa.

Ethics declarations

Ethics approval and consent to participate

The research method described in this study was approved by Jimma University Institute of Health, Institutional Review Board (Ref No.: JUIH/IRB/358/23).

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

40814_2025_1632_MOESM1_ESM.docx

Additional file 1: Total sum score and suggestion of expert on gain and loss framed messages content in Jimma Zone, Ethiopia.

Additional file 2: Checklist for reporting intervention development studies.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Abdissa, H., Duguma, G.B., Noll, J. et al. Development and testing of mobile phone text messages for improving maternal and newborn care practice in Jimma Zone, Ethiopia: a user-centered design approach. Pilot Feasibility Stud 11, 46 (2025). https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s40814-025-01632-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s40814-025-01632-6

Keywords