PLoS ONE
Home Implementation outcomes of HIV self-testing in low- and middle- income countries: A scoping review
Implementation outcomes of HIV self-testing in low- and middle- income countries: A scoping review
Implementation outcomes of HIV self-testing in low- and middle- income countries: A scoping review

Competing Interests: The authors have declared that no competing interests exist.

Article Type: Research Article Article History
Abstract

Introduction

HIV self-testing (HIV-ST) is an effective means of improving HIV testing rates. Low- and middle-income countries (LMIC) are taking steps to include HIV-ST into their national HIV/AIDS programs but very few reviews have focused on implementation in LMIC. We performed a scoping review to describe and synthesize existing literature on implementation outcomes of HIV-ST in LMIC.

Methods

We conducted a systematic search of Medline, Embase, Global Health, Web of Science, and Scopus, supplemented by searches in HIVST.org and other grey literature databases (done 23 September 2020) and included articles if they reported at least one of the following eight implementation outcomes: acceptability, appropriateness, adoption, feasibility, fidelity, cost, penetration, or sustainability. Both quantitative and qualitative results were extracted and synthesized in a narrative manner.

Results and discussion

Most (75%) of the 206 included articles focused on implementation in Africa. HIV-ST was found to be acceptable and appropriate, perceived to be convenient and better at maintaining confidentiality than standard testing. The lack of counselling and linkage to care, however, was concerning to stakeholders. Peer and online distribution were found to be effective in improving adoption. The high occurrence of user errors was a common feasibility issue reported by studies, although, diagnostic accuracy remained high. HIV-ST was associated with higher program costs but can still be cost-effective if kit prices remain low and HIV detection improves. Implementation fidelity was not always reported and there were very few studies on, penetration, and sustainability.

Conclusions

Evidence supports the acceptability, appropriateness, and feasibility of HIV-ST in the LMIC context. Costs and user error rates are threats to successful implementation. Future research should address equity through measuring penetration and potential barriers to sustainability including distribution, cost, scale-up, and safety.

Rivera,Hernandez,Mag-usara,Sy,Ulitin,O’Dwyer,McHugh,Jordan,Hirschhorn,and Quaife: Implementation outcomes of HIV self-testing in low- and middle- income countries: A scoping review

Introduction

Human immunodeficiency virus self-testing (HIV-ST) is an effective means of improving HIV testing rates and can serve as an alternative to facility-based HIV testing [1, 2]. It is recognized as a key tool to help achieve the global 90-90-90 targets, specifically, ensuring that 90% of people with HIV are aware of their status [3, 4]. Many countries are in the process of integrating HIV-ST into their national HIV/AIDS programs [5]. This process can easily become complicated and poor implementation can lead to countries not gaining any benefits (e.g., address the HIV testing gap) from the new technology. Fortunately, implementation science has emerged in response to this problem of introducing new technology to health systems and health organizations have recognized that implementation itself requires a scientific approach and reviews of the current evidence are valuable in this approach.

One approach to organizing this review is according to implementation outcomes. Using Proctor et al.’s framework [6], implementation outcomes are different from the usual outcomes studied in clinical or health services research. Usually, outcomes in health research are patient outcomes (e.g., satisfaction or improvement in health and function) or quality of care outcomes (e.g., efficiency, safety, and timeliness) which are end products of an intervention. Meanwhile, implementation outcomes are indicators of success that are “the effects of deliberate and purposive actions to implement new treatments, practices, and services.” Further, Proctor et al. proposes that only programs with successful implementation outcomes will achieve maximal effectiveness and quality. These eight outcomes are acceptability, adoption, appropriateness, costs, feasibility, fidelity, penetration, and sustainability. By identifying the relevant conditions necessary to achieve HIV-ST implementation outcomes, we can better understand how best to implement this technology for a given setting.

Another important factor in implementation is the context (i.e., where HIV-ST will be implemented). For example, the design of the national health system puts constraints on how HIV ST can be delivered to the end-user. The dominant modes of HIV transmission in the country are contextual factors that influences what populations will be prioritized by countries. Finally, the level of stigma faced by at-risk populations affects how they would react to HIV-ST. While there have been several reviews on HIV-ST implementation outcomes, these reviews primarily included studies conducted in high-income countries [711] with a couple of reviews focused on implementation in Africa [12, 13]. We agree that the reviews are very much useful. They found evidence that HIV-ST was acceptable to a wide variety of patients and providers and warn about issues that may hinder successful implementation like the high cost of the kit, inadequate linkage to care, and the complexity of packet instructions. But there is a huge diversity of low- and middle-income countries (LMIC) contexts, findings and lessons for upper-income countries or from Africa may not always be applicable to other LMIC settings. Our review is important to guide individual country efforts in planning implementation research and programs of HIV-ST in their local settings.

In this paper, we aimed to describe the implementation outcomes of HIV-ST in LMIC using a scoping review methodology [14]. We then produced a synthesis of the existing literature to inform the design and implementation of HIV-ST programs. We also identified gaps in the literature to help the development of the research agenda for HIV-ST implementation. We hope this review serves as a resource for both researchers and practitioners as they study, or design programs aimed at effectively implementing HIV-ST in LMIC settings.

Methods

Protocol and search strategy

We conducted literature searches in Pubmed MEDLINE, Embase, Global Health, Web of Science, and Scopus. The final search strategy used combinations of the words “self-testing,” “HIV,” and “low- and middle-income country”. The final strategy was informed by search strategies of previous reviews and a preliminary search (See S1 File for Sample Search Strategy). We also performed 1) hand search of references of reviews on self-testing and included articles, and 2) additional searches in potential gray literature repositories such as the WHO Library Database (WHOLIS), United States Agency for International Development data clearing house, Latin American & Caribbean Health Sciences Literature (LILACS), OpenGrey, and the study registry hosted by HIVST.org. We employed no language restrictions during the search and screened any article published from database inception to search date (25 January 2019). A protocol including the search strategy, inclusion criteria, and preliminary analyses plan was devised before performing the search (Version 1 at: https://doi.org/10.21985/n2-d8te-ey62). As with most scoping reviews, we iteratively revised the extraction and analysis plan as we reviewed the literature. The first extraction and analysis cycle was completed in April 2020. We performed an updated search on 23 September 2020 to cover new literature published since the end of the first analysis.

Outcomes

We followed Proctor et al.’s definition of implementation outcomes [6] for this study with some modifications to facilitate categorization of studies (See S2 File for notes on definitions). During extraction, we recognized how of safety and linkage to care are intricately linked to successful implementation of HIV-ST, so we opted to include them in our review as additional outcomes. We did not expand the search for these two outcomes, rather, we focused on extracting only data on safety and linkage if a paper also reports one of the eight implementation outcomes.

One pair of outcomes that needed to be delineated operationally are feasibility and fidelity. Both outcomes relate to how well actual implementation aligns with the ideal implementation. We differentiate the two by separating the technology (HIV-ST) from the implementation program (i.e., how HIV-ST is reaching the end-user). We then treat feasibility as those related to successful use of HIV-ST as a piece of technology by the end-user. As such we included error rates and real-world diagnostic performance under feasibility. For fidelity, we focused on compliance of stakeholders to implementation strategies or described standard procedures employed within the HIV-ST program. Examples of these would be the procedure of giving two kits to each potential user or performing a follow-up call after self-testing.

Another pair that we had to differentiate was adoption from penetration. Both are related to the degree of uptake of technology in a population and both can be measured by determining how many among the eligible are using HIV-ST but occurs at different phases of implementation. Implementation can be viewed as a process with pre-implementation, early, middle, and late phases which can be described roughly as exploration, pilot testing, early roll out, and full institutionalization of new technologies [15]. We then interpret adoption studies to measure uptake in the early to middle phases as well as investigate if specific strategies lead to increased uptake by the target population. Meanwhile, we viewed penetration as a late-stage measure that requires the technology to be available for a longer period than in adoption and is quantified both service access and spread. Proctor’s definition also has an added dimension of how well implementation strategies or processes have become part of usual care. Using this heuristic, we considered studies that looked at how many people have used HIV-ST before or during early implementation programs as under adoption and studies that measured uptake at later phases under penetration.

Inclusion and exclusion criteria

We included any study on HIV-ST that reported at least one implementation outcome (acceptability, appropriateness, adoption, feasibility, fidelity, implementation costs, penetration, and sustainability) as defined by Proctor et al. [6] and was conducted in a World Bank classified LMIC. There were no restrictions on population or study design. We excluded (1) editorials, commentaries, or reviews, (2) articles written in a language other than English, (3) diagnostic accuracy studies that did not use results as read by the lay user in assessment, and (4) conference abstracts.

Study selection and data extraction

We first screened articles based on their title and abstract and then performed a full-text assessment using Rayyan [16] and an Excel form. We extracted the following information from the included articles: first author’s last name, publication year, study design, study population, data collection period, sample size, type of fluid for self-testing, and degree of supervision for self-testing. We extracted quantitative and qualitative findings for the different implementation outcomes using an Excel form that was iteratively revised. For qualitative findings, we focused on summary themes or statements. At least two authors were involved in each step of the selection and extraction. Conflicts were resolved by consensus formation.

Analysis

We used descriptive statistics and exploratory data analysis to assess common design features across studies (ran in R 4.0). For each implementation outcome, we used narrative synthesis techniques [17] such as grouping (e.g., report quantitative results according to study design) and thematic analysis of reported qualitative themes to identify any similarities and differences in study results. We pooled diagnostic accuracy (sensitivity and specificity) results using bivariate modeling that was implemented through the mada package [18]. Sensitivity or specificity was extracted from the text or calculated from two-by-two tables. For calculations, we excluded indeterminate test results.

Results

Overview of results

The initial search yield was 1,131 unique (i.e., deduplicated) articles from the databases and 240 from other sources. From this, 196 remained after the title and abstract screen, and 107 remained after the full-text review. Two included articles [19, 20] had very similar results and were treated as a single article. The published version of one article could not be found so the thesis version [21] was used instead. In the updated search, we found 100 additional articles leading to a total of 206 articles published between 2006 to September 2020 that were included in the synthesis. (Fig 1, See S2 File for List of Excluded Studies during Full-Text Screen).

Flowchart of search.
Fig 1

Flowchart of search.

Notes: HIV-ST–HIV self-testing, LMIC–low- and middle-income country.

The most studied outcomes were acceptability (59% of articles), adoption (50%), and appropriateness (27%). There were several studies on feasibility (12%), fidelity (11%), and cost (8%) but only two for penetration and one for sustainability. Safety (19%) and linkage to care (29%), the two additional outcomes, were also commonly discussed (Table 1).

Table 1
Summary characteristics of included studies.
Overall

(n = 206)
Africa

(n = 155)
Americas

(n = 11)
Asia

(n = 40)
p-value
Key Population (%)
MSM56 (27.2)11 (7.1)10 (90.9)35 (87.5)<0.001
FSW25 (12.1)21 (13.5)0 (0.0)4 (10.0)0.371
HCW23 (11.2)20 (12.9)1 (9.1)2 (5.0)0.358
Pregnant women19 (9.2)18 (11.6)0 (0.0)1 (2.5)0.115
Transgender women9 (4.4)0 (0.0)2 (18.2)7 (17.5)<0.001
Teenagers46 (22.3)38 (24.5)0 (0.0)8 (20.0)0.156
Type of Specimen (%)<0.001
Blood21 (10.2)9 (5.8)1 (9.1)11 (27.5)
Oral99 (48.1)88 (56.8)5 (45.5)6 (15.0)
Both27 (13.1)15 (9.7)2 (18.2)10 (25.0)
Not Specified59 (28.6)43 (27.7)3 (27.3)13 (32.5)
Type of Supervision (%)0.012
Unsupervised84 (40.8)68 (43.9)4 (36.4)12 (30.0)
Supervised14 (6.8)6 (3.9)0 (0.0)8 (20.0)
Not Specified83 (40.3)60 (38.7)6 (54.5)17 (42.5)
Both supervision types25 (12.1)21 (13.5)1 (9.1)3 (7.5)
Type of Methods (%)0.155
Mixed methods23 (11.2)21 (13.5)0 (0.0)2 (5.0)
Qualitative only54 (26.2)44 (28.4)2 (18.2)8 (20.0)
Quantitative only129 (62.6)90 (58.1)9 (81.8)30 (75.0)
Study Design (%)0.546
Modelling3 (1.5)3 (1.9)0 (0.0)0 (0.0)
Observational149 (72.3)114 (73.5)9 (81.8)26 (65.0)
Interventional54 (26.2)38 (24.5)2 (18.2)14 (35.0)
    a) Quasi-experimental32 (20.3)18 (16.2)2 (18.2)12 (33.3)
    b) Randomized trial22 (13.9)20 (18.0)0 (0.0)2 (5.6)
Implementation Outcome (%)
Acceptability122 (59.2)93 (60.0)10 (90.9)19 (47.5)0.032
Adoption103 (50.0)73 (47.1)4 (36.4)26 (65.0)0.085
Appropriateness56 (27.2)46 (29.7)1 (9.1)9 (22.5)0.253
Cost16 (7.8)15 (9.7)0 (0.0)1 (2.5)0.195
Feasibility24 (11.7)20 (12.9)1 (9.1)3 (7.5)0.614
Fidelity23 (11.2)17 (11.0)1 (9.1)5 (12.5)0.939
Penetration2 (1.0)2 (1.3)0 (0.0)0 (0.0)0.717
Sustainment1 (0.5)1 (0.6)0 (0.0)0 (0.0)0.848
Linkage to Care59 (28.6)38 (24.5)4 (36.4)17 (42.5)0.068
Safety40 (19.4)32 (20.6)1 (9.1)7 (17.5)0.609

Notes: MSM–men who have sex with men, FSW–female sex worker, HCW–healthcare worker.

The majority of studies were observational in design (72%), used quantitative methods only (63%), and were recently published (2019: 23%, 2020: 27%). Oral fluid-based (48%) and unsupervised (41%) self-testing were more commonly studied, although several studies failed to explicitly state these details. Most of the studies were on implementation in African contexts (70%) and were situated in four countries: Kenya (33, 16%), South Africa (33, 16%), Malawi (28, 14%), and China (27, 13%) (Fig 2). Nearly all papers studying implementation in Asia and the Americas involved men who have sex with men (MSM) while there was more variety in study populations among those in Africa. Most randomized trials were done in African contexts. (Table 1) (See S2 File for Detailed Study Descriptions and Extraction).

Frequency distribution of included studies according to country.
Fig 2

Frequency distribution of included studies according to country.

Notes: HIC–high income country. Made with Natural Earth. Free vector and raster map data @ naturalearthdata.com.

Acceptability

122 articles studied acceptability. “Willingness to use” was the most common way of measuring acceptability and other measures included ease of use, preference over standard tests, and willingness to pay. Sixty-six (66) used a quantitative design [2287], 37 were qualitative [43, 88123], and 19 were mixed or multi-method studies [20, 124141]. Only the quantitative results are presented in this section; qualitative results are discussed with findings on appropriateness due to similarities in themes and results.

Willingness to use and ease of use

Most studies found that high proportions of (>70%) to their study population were willing to use HIV-ST but there was some variation across key populations. For example, willingness was consistently high among female sex workers (FSW) ranging from 72% [142] to 95% [30]. In contrast, rates in MSM were more varied, ranging from 51 [73] to 99% [77] (Fig 3). We noted that the two studies (conducted in Kenya [129] and in Brazil [73]) that reported low willingness to use rates included individuals who have never tested for HIV (self-test or usual testing). This inclusion may have led to the lower measure of overall willingness. One study in South Africa [48] found that the odds of being willing to use HIV-ST was two times higher among ever testers compared to never testers. Although, we also found a study in Tanzania [86] that did not find significant differences in the willingness to use rates of ever and never testers.

Acceptability results.
Fig 3

Acceptability results.

Nearly all studies concluded that HIV-ST was perceived easy to use [23, 28, 3032, 35, 38, 40, 42, 44, 46, 47, 49, 57, 61, 63, 68, 70, 74, 77, 80, 82, 83, 85, 127, 130134, 141]. Most studies also found that HIV-ST was preferred over standard testing (i.e. facility-based performed by a trained health care worker (HCW)) [22, 32, 39, 43, 46, 52, 6163, 72, 80, 127, 130, 132, 136, 140].

Willingness to pay

Willingness to pay varied widely ranging from 21% [30] to 96.5% [133]. Most studies showed willingness greater than 50% across key populations. Some of the low rates are from populations with limited income such as students in Tanzania and Central African Republic [30, 75] and FSW primarily working in poor neighborhoods in Central African Republic [30]. The remaining study with low WTP [79] is on MSM in China where free HIV testing is available. Their sample also included a lot of people who have never tested which may affect WTP and the way they asked the WTP question (“Willing to purchase an oral self-test kit (in the next 6 months)?”) seemed to capture both willingness to try and pay (Fig 3).

Adoption

There were 103 studies on adoption included 18 randomized trials [25, 28, 47, 67, 143156], 28 post-test only quasi-experiments [38, 43, 44, 49, 58, 61, 66, 68, 74, 79, 84, 85, 87, 127, 140, 141, 157168], 30 observational quantitative studies [21, 29, 31, 32, 35, 37, 49, 59, 65, 77, 78, 81, 82, 148, 169182], 21 qualitative studies [9498, 100102, 107, 113, 114, 119, 121, 183190] and six observational mixed method studies [126, 129, 136, 138, 191, 192]. While adoption is distinct from appropriateness, we found that qualitative results for adoption overlapped with results for appropriateness and we opted to report them together (with acceptability) in the next section. We briefly go over observational studies in the next subsection and the rest is focused on quantitative results from interventional studies.

Observational studies measuring uptake

Observational studies showed that with just market availability and no widespread program by the State or national scale actors, HIV-ST diffused among key populations. These surveys measured prevalent use of HIV-ST among HCW from Ethiopia [138], Kenya [21], and South Africa [31], among MSM in China [59, 170, 176, 178, 192], and the general population in Malawi and Zimbabwe [37]. Studies measured uptake either by asking about current use or reported uptake rates after offering the test kit for use during data collection. In the latter type, we found that those who adopt after being offered seem to represent a certain segment of the target population. For example, MSM in China who use gay apps were found to be more likely to use HIV-ST [193]. Women in community trial sites in Malawi [172] and Zambia [171] were more likely to participate and use HIV-ST. These two studies also showed significant differences in age and sexual behavior of HIV-ST users vs non-users. For example, in the Malawi trial, they found men, but not women, who recently practiced condom-less sex were significantly more likely to perform HIV-ST than those who did not.

Overview of interventional studies

Interventional studies have focused on evaluating the impact of implementation strategies on HIV-ST uptake or on overall HIV testing rates. The most commonly studied strategy was distribution of self-testing kits through community members, volunteers or peers [44, 61, 67, 74, 78, 85, 124, 125, 140, 146, 151, 159, 162, 194] or intimate partners (usually female) [28, 47, 49, 68, 144, 147, 152, 156, 161, 165, 166]. All except Tun et al. [74] used direct distribution of kits to users. Tun et al. [74], instead, asked peers in Nigeria to invite target users to visit a center to claim and use an HIV-ST kit. The other approaches for increasing uptake were distribution via online platforms [58, 66, 84, 87, 149, 157, 158, 160, 167], HIV-ST information or promotion campaigns [38, 67, 79, 150, 153, 155, 168], and offering HIV-ST after contact with health services (e.g., PreP, pharmacy visits, HIV testing) [25, 127, 141, 143, 145, 147, 154, 159, 164]. Many studies did not have controls that allowed for proper assessment of impact on HIV testing rates (Fig 4).

Harvest map of interventional studies on HIV-ST adoption.
Fig 4

Harvest map of interventional studies on HIV-ST adoption.

Distribution using peers, partners or community members

The utilization of peers, intimate partners, or community members was mostly successful in increasing uptake. In quasi-experimental studies, there was high uptake (≥80%) after direct distribution by peers [43, 78, 146, 151] or partners [28, 144, 152]. Nearly all randomized trials [28, 47, 124, 144, 146, 147, 156], except for one study in Zimbabwe [67], showed significant positive effects on overall HIV testing rates in the interventions arms. Also, Choko et al. [152] noted that in Malawi, distribution via partners with financial incentives can improve actual clinic follow-up by male partners.

The non-significant results in the Zimbabwe study [67] might be due to the comparison group. The Zimbabwe study had three factors in the intervention (price of kit, type of kit distributor, and promotional messaging). They found that needing to pay even just $0.50 significantly reduced uptake. In rural sites, they compared community health workers to retail stores as distributors and did not find any significant difference in uptake. They also found that type of messaging did not significantly affect uptake.

Distribution via online platforms

Online platforms were a promising approach to educate about and/or distribute HIV-ST, but only one of nine studies included control groups that enabled some form of evaluation on testing rates. Tang et al. [149] demonstrated through a stepped wedge trial in China that a crowd-sourced online distribution coupled with a social media campaign can significantly increase the rate of HIV self-testing. Seven papers [66, 84, 87, 157, 158, 160, 167] showed that online distribution is feasible and led to the recruitment of HIV-ST users but no evaluation was done to assess performance compared to other distribution strategies.

A pertinent issue in online distribution is that HIV-ST users recruited online might not complete the counseling and testing process. One study in Thailand [58] demonstrated that a purely online approach to counseling and testing with HIV-ST had HIV testing completion rates comparable to the conventional in-person model. Another study in Brazil [87] also showed high rates of getting counseling among online users who tested positive.

Other distribution strategies using education or promotion

Seven papers that used education or promotion campaigns through means other than peers or partners had mixed results. SMS announcements from HIV clinics in Kenya regarding HIV-ST availability significantly increased HIV testing among FSW [153] but not among truck drivers [155]. In China, inclusion in an SMS group that pushes HIV-related messages also increased HIV-ST uptake and overall HIV testing rates [150]. However, one study in Zimbabwe [67] found that merely adding promotional messages to voucher distribution did not improve HIV-ST uptake. Another study also found that a hospital-based information campaign among HCW in Kenya [38] led to high uptake among information session HCW attendees but not among non-attendees. Finally, two studies focused on comparing types of recruitment. One study in China [79] showed that online recruitment’s impact on HIV-ST uptake was comparable to peer recruitment. Another China-based study [168] showed that social media key opinion leaders may be more effective than community-based organizations in recruiting HIV-ST users especially if they approach first-time HIV-ST users.

Some studies tested offering HIV-ST during contact with health services (e.g., routine visit, circumcision, pharmacy visits) and these had mixed results as well. Offering HIV-ST during a visit to an HIV testing facility seemed to increase HIV testing coverage. In Kenya, truckers who were randomized to the arm that can choose HIV-ST had 1.5x higher odds of accepting HIV testing compared to those randomized to just standard HIV tests [154]. Similarly, two other randomized trials in Malawi and South Africa [25, 147] that offered HIV-ST during facility visits or community events showed significantly higher HIV testing rates. A quasi-experimental study in Eswatini [164] showed an increase in HIV-ST uptake. Another quasi-experimental study done in Malawi, Zambia, and Zimbabwe [159] demonstrated the feasibility of distribution even in male circumcision sites, but they had no comparators for proper assessment. Integrating HIV-ST with pre-exposure prophylaxis (PreP) services also seemed helpful. In a sub-study of an open-label trial in Kenya [127], majority (93.2%) of recruited PreP users reported using HIV-ST at least once during the study. Offering HIV-ST during regular pharmacy visits in Kenya [141], however, did not have a high yield (only 35% of invited agreed to participate). Finally, in a community trial in Zambia [145], residents in communities that had access to HIV-ST (through community health workers) had higher odds of knowing their HIV status on follow-up than residents in control communities.

Appropriateness and qualitative results

Appropriateness is defined as “the perceived fit, relevance, or compatibility of the innovation or evidence-based practice for a given practice setting, provider, or consumer; and/or perceived fit of the innovation to address a particular issue or problem” [6]. We found that all studies that touched on appropriateness used a qualitative design. While Proctor’s framework differentiates between appropriateness, acceptability, and adoption, we found that qualitative themes for these outcomes relating to these three outcomes overlapped so we opted to present them together in this section.

Positive perceptions on HIV-ST

Qualitative studies echoed findings of surveys described previously, HIV-ST was perceived to be easy and convenient, often in comparison to standard testing [57, 78, 88, 9193, 95, 97, 99, 100, 102, 103, 105, 107, 108, 111114, 120, 122, 124, 127, 131, 133, 137140, 183, 184, 191, 195197]. HIV-ST allows them save time and money as they would not need to wait in a line at a testing facility, skip work, or spend on transportation [20, 57, 88, 9294, 99, 100, 102, 107, 111, 113, 114, 116, 119, 122, 126, 131, 137, 140, 183, 184, 191, 196].

HIV-ST also had potential to reduce stigma and anxiety associated with testing [9, 20, 45, 91, 95, 98, 99, 103, 104, 107, 112, 114, 118120, 122, 126, 127, 131, 138, 184, 198]. Compared to standard facility-based testing, HIV-ST was perceived to be better in protecting confidentiality [20, 57, 88, 91, 95, 98, 100, 103, 104, 108, 112116, 118120, 122, 124, 126, 127, 129, 131, 137140, 183, 184, 195197, 199] especially in settings where people doubt the ability of HCW to protect confidentiality [20, 57, 99, 100, 104, 113, 124, 126, 137]. It was a common belief that HIV-ST would be useful for increasing HIV testing rates in certain populations, such as men or young people [45, 48, 78, 90, 91, 95, 98100, 102, 106, 116, 118, 120, 137, 139, 184, 190, 191, 196, 199].

Relatedly, HIV-ST was believed to empower users and promote autonomy [20, 91, 92, 95100, 102, 104, 105, 118, 122, 124, 137139, 184, 189, 190, 200, 201] since HIV-ST allowed the user to retain full control of their own health information. The self-test option may also address the feeling of coercion associated with standard testing since some patients felt that they could not refuse if asked to undergo HIV testing because they perceived nurses to be in a position of power [20, 91].

Considerations for designing HIV-ST programs

Studies showed several considerations for the design and implementation of HIV-ST programs in LMIC settings to improve acceptability and appropriateness. Proper kit design for the target population was often mentioned. Design considerations included the instructional materials [90, 98, 100, 103, 107, 114, 120, 124, 131133, 187, 190, 201203] and the type of fluid (blood or oral fluid) [90, 92, 100, 102, 104, 106, 108, 110, 114, 116, 119, 124, 127, 131, 132, 137, 139, 184, 191, 196]. Instructions needed to be clear and easy to understand. Some papers suggest making sure that there are clear instructions on how to link to care or seek support and include a number that users can easily call. Other studies showed that videos or mobile apps can serve as supplemental forms of education materials. Cognitive interviews was shown to be very useful in helping identify issues with instruction materials and optimize prior to roll-out [203]. In terms of specimen type, blood might be more trusted than oral fluid-based tests in some settings or by some subgroups. However, users might also have more difficulty with performing blood-based tests, particularly in using the lancet.

Counselling, especially post-test counselling, was deemed necessary in HIV-ST programs [9, 20, 45, 78, 8992, 98, 100, 101, 103, 106, 108, 109, 111, 113, 114, 116, 119, 120, 127, 129, 132, 137, 139, 140, 184, 190, 196, 201]. Relatedly, two commonly reported negative features of the HIV-ST: the lack of access to immediate counselling [45, 57, 91, 92, 98101, 103, 104, 106109, 113, 114, 116, 118122, 124, 126, 127, 132, 135, 138140, 184, 186, 190, 195, 197] and the lack of linkage to care (e.g., confirmatory testing, anti-retroviral therapy) [45, 8991, 98100, 103, 104, 106, 108, 109, 113, 116, 121, 128, 129, 140, 186, 190, 196]. These two issues were voiced more often in the context of positive HIV-ST results. A commonly reported belief was that individuals who test positive would be more likely to resort to self-harm in the absence of counselling or post-test support [45, 88, 89, 91, 93, 98101, 106, 107, 109, 113, 114, 116, 120122, 129, 131, 132, 139, 140, 186, 190, 195, 196]. Some studies, however, suggested that there was no need to use traditional face-to-face facility-based counselling; telephone or online counselling could be sufficient [20, 57, 90, 91, 98, 106, 108, 111, 112, 119121, 132, 184, 190, 201].

Selecting the appropriate mode of kit distribution was important to ensure accessibility and adoption [57, 78, 90, 92, 99, 104, 105, 108, 110, 112, 119, 122, 137, 139, 141, 163, 184, 189, 190, 202, 204]. Modes of distribution described include: (1) direct delivery by community health workers, peers, partners, and sex workers, (2) Home delivery, and (3) Pick up at health facilities or community-based organizations or other sites (e.g., health clubs, markets, private pharmacies, vending machines). Regardless of the mode, the venue for distribution needs to be accessible and convenient. Venues need to ensure that the user privacy is protected, and the discretion is maintained. Peer or community distributors need to be perceived as trustworthy individuals, preferably coming from the potential user’s own network. Users also need to be informed about storage strategies, especially if their homes have limited spaces for private testing.

Issues related to partner distribution

Partner distribution is an often-used strategy for distributing HIV-ST kits. Several papers explored issues of acceptability and appropriateness [94, 95, 99102, 105, 107, 114, 118, 119, 121, 122, 127, 183, 184, 186, 189, 191, 196] and all except one [121] were done in African countries. Female partners find this strategy acceptable because it allows them to engage their partners in matters of sexual health and see it as a good way to encourage HIV testing and even couple testing (testing at the same time). Trust and relationship quality play important roles in the perceived acceptability or success of this strategy. Some females feel that it can improve their relationship and trust in their partners, but some fear that it can have the opposite effect. Males might view even view the request to use HIV-ST as a test of their fidelity.

Relatedly, the safety of female distributors is an important consideration in program design. Female distributors were believed to be at risk of physical violence, abandonment, and relationship dissolution. A qualitative study in Malawi [95] found that “women feared being branded as unfaithful and a possible domestic violence” if they bring up doing HIVST together. A similar study in Uganda also documented that women fear their partner’s reaction the test although, in this study, none of the participants reported serious adverse events after offering the kit to male partners except for angry reactions among those who lied about the purpose of the test [102]. Results of quantitative studies on safety and social herms are reported in the safety section below.

Studies seem to agree that to mitigate these risks (e.g., negotiation skills training) must be included in the HIV-ST program if partner distribution is adopted as a strategy. A few papers [114, 183, 184, 186, 191] outlined strategies used by female distributors on how to engage their partners. Examples are: (1) selecting the appropriate time and place for introducing self- or couple testing, (2) developing a distraction free environment for the discussion and testing, (3) mentioning positive experiences and/or benefits of HIV-ST, and (4) reassuring partners that it is a couple’s activity and not meant to test their commitment.

Policies and other issues

Modification of the policy environment to facilitate acceptance and adoption of HIV-ST seemed to be necessary for proper HIV-ST implementation. Policy issues included regulation or policies related to HIV-ST [45, 89, 97100, 103, 108, 120, 123, 186, 190, 196, 200], pricing and financing [90, 98, 99, 103105, 108, 118, 119, 123, 128, 131, 132, 137, 139, 187, 196, 202], and experience of frontline healthcare workers [141, 205]. There were calls for strict access to kits and putting in place protection against fake tests. One paper found that policy-makers from three African countries thought that policy should be “in line with WHO guidance and adapted to local conditions” [190]. Nearly all studies reported preference for free or heavily subsidized kits to ensure acceptability and adoption.

Relatedly, widespread availability of HIV-ST can also lead to coercive testing in the home and workplace and, in turn, threatens appropriateness. For example, parents can force their children to undergo an HIV-ST or a boss could require HIV testing of employees in the workplace or a spouse can coerce their partner during couples testing [94, 97, 100, 101, 116, 184, 190, 192].

Other reported considerations when designing HIV-ST programs included (1) adequate follow-up [100, 113, 118, 120, 127, 135], (2) establishment of peer support networks [78, 104, 107, 122, 140, 199] and, (3) proper education on HIV-ST use [93, 98100, 102, 106, 108110, 112, 116, 120, 122, 127, 131, 133, 139, 140, 190, 196, 201, 206]. Education, both at the individual and community level, ensures proper technique and addresses any concerns on test accuracy. Supervised testing may be more appropriate, especially for new users since they can provide additional education opportunities and emotional support. Despite overwhelming positive attitudes towards HIV-ST, a few studies [45, 100, 120] pointed out that HIV-ST will not improve testing coverage if unfavorable values towards HIV testing are not changed. Education to modify perceptions on HIV testing in general would then be needed. Education may also address potential problems like improper waste disposal [99, 119, 132, 190, 202], safety concerns (e.g., use of lancet as a weapon) [99, 137], psychological results of inaccurate tests [93, 190], sexual disinhibition due to negative results [100], and misconceptions regarding HIV or HIV-ST [90, 107, 110, 114, 116, 122, 132] (e.g., How can they trust oral testing if HIV cannot be transmitted via saliva?).

Feasibility

As stated in the methods, for feasibility, we considered metrics that relate to the successful use of HIV-ST rather than compliance to program procedures or implementation strategies which we classified under fidelity. Metrics under this section include error rate, assistance rate, readability, and diagnostic performance.

User errors and readability

Errors in performing HIV-ST were common. Studies reported error rates in different ways: some report the number of people with at least one error, others calculate an average or useability index, and some report error per step. Error rates of 10% or higher were commonly reported in studies that used unsupervised HIV-ST [24, 30, 40, 42, 46, 53, 57, 63, 77, 131, 132, 136, 142, 194] although error rates ranged widely from 1.6% to 93%. In these unsupervised HIV-ST studies, participants were observed but no guidance was provided outside of the education materials that were part of the kit simulating an unsupervised test. Meanwhile, supervised HIV-ST [23, 133, 173, 207] had lower error rates ranging from 0% to 19.5% (Fig 5). Gaining experience with HIV-ST did not lower error rates as seen in studies in South Africa, Brazil and Peru that compared error rates on the initial introduction and after months of unsupervised use [42, 77].

Feasibility results.
Fig 5

Feasibility results.

Requests for assistance was also reported [23, 30, 61, 127, 130, 133, 136, 142, 153, 155, 173, 208]. Studies on supervised HIV-ST reported higher assistance requests with rates ranging at 18.1% [130] and 41.5% [23] while studies on unsupervised ST ranged from 10% [136] to 23.6% [23] (Fig 5).

Seventeen studies performed readability assessments in which they asked participants to read one or more HIV-ST kit results but not necessarily their own [30, 32, 46, 53, 57, 70, 77, 80, 83, 133, 134, 136, 142, 173, 177, 194, 209]. Most studies reported >90% correct reader rate but this seemed to be dependent on the type of result (Fig 5). Inconclusive and weakly positive results commonly led to incorrect reading by the users.

Test performance

Despite issues of performance and test result interpretation, HIV-ST, as used and read by study participants, was found to have good (albeit variable) diagnostic accuracy. To better summarize the results, we pooled results using meta-analysis methods for diagnostic studies. In 17 studies [23, 24, 32, 40, 57, 79, 85, 125, 133, 134, 136, 142, 174, 175, 177, 207, 210], sensitivity ranged from 66.7% to 100%, while specificity ranged from 81.3% to 100%. Pooled results from testing unsupervised oral HIV-ST and found that it is specific (98.7%, 95%CI: 97.6% to 99.3%) and fairly sensitive (90.6%, 95%CI: 84.9% to 94.3%) (Fig 6). User-readings usually agree with standard tests. Eight of ten studies with data [32, 132, 134, 136, 142, 175, 194, 207] reported high (≥90%) concordance between results as read by users compared to reference testing (e.g., done by a healthcare worker or using standard test). Similarly, seven of nine studies with kappa statistics showed high agreement between user readings and standard results [24, 30, 70, 133, 142, 175, 207, 209].

Diagnostic accuracy of HIV-ST.
Fig 6

Diagnostic accuracy of HIV-ST.

(A) Sensitivity (all studies), (B) Specificity (all studies), (C). Pooled Sensitivity and Specificity (Only studies using Unsupervised Oral HIV-ST). Notes: AUC–area under the curve, SN–sensitivity, SP–specificity, SROC–summary receiving operator characteristics, UN–unsupervised.

Finally, we found two studies that tested interventions to reduce user errors. A group in South Africa [211] developed a mobile app to aid HIV-ST users. While they reported only 8.7% user errors (at the low range compared to observational studies above), there was no control group to properly assess effectiveness. Another group performed a randomized trial involving Tanzanian youth [212] and they found that providing instructions using a graphic booklet and video was better than the graphic booklet alone. The booklet with video group had lower errors, better instruction comprehension, and higher intent to seek care.

Implementation costs

Sixteen studies reported on cost in terms of implementation or cost-effectiveness. In African countries, offering HIV-ST generally increased total program costs or cost per person tested compared to standard HIV testing [25, 145, 204, 213218] due to the higher cost of the testing kit and the added cost from strategies to promote adoption. For example, Mulubwa et al. [145] noted a 1.37x higher cost in an HIV-ST program in Zambia partially due to added costs related to door-to-door distribution of HIV-ST kits. Higher costs were also observed by George et al. [216] in Kenya. They found that the HIV-ST treatment arms have double the cost of the usual care arms. The increase in program costs were due to the higher costs of HIV-ST kits (vs usual HIV testing) and the added costs of sending out SMS reminders to HIV-ST kit recipients.

While total costs may be higher, cost efficiency (e.g., cost per tested or cost per positive found) may improve with strategies that increase cost but also increase reach or yield. For example, Choko et al. [152] observed higher program costs in Malawi when HIV-ST was distributed through intimate partners. However, they found that while adding financial incentives would further increase program costs, the improvements in yield lowered the average cost per person who follows up for care. Another example is when Zhang et al. [168] showed that using social media key opinion leaders to recruit HIV-ST users in China yield lower cost per tested than using community-based organizations.

Cost-effectiveness of HIV-ST

Despite higher program implementation costs, offering HIV-ST with standard testing can still be cost-effective (compared to standard testing alone). Maheswaran et al. [204] found that HIV-ST can be cost-effective in Malawi since it lowered societal cost by reducing patient opportunity costs. Cambiano et al. [219] found that adding HIV-ST can lead to cost-savings for the Zambian healthcare system. They also found that keeping the price of kits low ensured the cost-effectiveness of the program. Nichols et al. [218] found that aside from maintaining kit prices low, ensuring high linkage rates is also important to ensure that HIV-ST programs are cost-saving.

HIV-ST cost-effectiveness is also affected by the target population and HIV prevalence. Cambiano et al. [220] found that an HIV-ST program in sub-Saharan Africa is likely to be cost-effective for FSW and adult males but not for young people. Their results suggest that HIV-ST works best in communities where the prevalence is high and implementation costs can be maintained low. Korte et al. [156] echoes these findings in their CEA of distributing HIV-ST to males via their female partners in Uganda where they found that adding HIV-ST to existing testing programs would be best in areas in high prevalence.

The design and policies of the larger HIV program where HIV-ST is integrated also affect cost-effectiveness. For example, Maheswaran et al. [221] found that HIV-ST as a complementary service of standard testing can be cost-effective from a public provider perspective if positive individuals are managed following the 2015 WHO anti-retroviral treatment guidelines but not if the 2010 guidelines were used. Meanwhile, Johnson [222] showed that adding HIV-ST to offering a home-based HIV testing program in South Africa is cost-saving, but pairing HIV-ST with antenatal care partner testing programs is only cost-effective.

Fidelity

Twenty-three studies reported some measure of implementation or program fidelity, defined as compliance to implementation strategies or operating procedures in the HIV-ST program. Even though we found several interventional studies, not all these papers reported fidelity measures. Since there were a variety of implementation strategies used, measures of fidelity also varied per study and depended on intervention type. Studies that used peer or partner distribution measured compliance of peer distributors to instructions [85], proportion receiving intended number of coupons [146], proportion of women or peers actually distributing self-tests [44, 47, 68, 125, 140, 147, 156, 165, 169, 171], or proportion doing couple-testing [47, 140, 156, 165, 166, 169]. Other examples of measures include: (1) number of visits by patients to the electronic platform [157], (2) number who completed testing after request via online platform [87, 160], (3) successful use of the testing support application [211], (4) compliance with recommendation that was HIV-ST conducted upon opening a new pre-exposure prophylaxis bottle [127], (5) proportion of participants receiving phone call reminders [152], (6) number of SMS messages sent to participants [150], (7) reports of video issues during post-testing counselling [58], (8) adherence of counsellors to the protocol [205], and (9) using the kit after taking it home [61].

Penetration and sustainability

Penetration and sustainability are organization or setting-level constructs that refer to degree of institutionalization and maintenance of services. Both are late phase outcomes that require some implementation program to be in place prior to measurement. One measure of penetration is how many of the eligible users are using HIV-ST. Some studies that measured uptake could be considered as studies of this form of penetration [21, 37, 59, 82, 126, 170, 175, 176, 182, 192] with one study in Malawi using a more robust measure of population uptake by including questions in the national demographic health survey [37] rather than using convenience samples. We consider this as a passive type of penetration since HIV-ST uptake was not necessarily due to actual HIV-ST promotion programs and more attributable to market availability. We see in China (one of the countries where HIV-ST is widely available through e-commerce sites [223]), that the uptake rate of ever using HIV-ST can be at <20% [175] if measured outside of HIV-ST implementation programs.

There were also interventional studies that may affect penetration. We see from a cluster randomized trial of HIV-ST distribution by community health workers in Malawi [78] that community uptake takes some time but can reach high or maximal levels as long as the intervention is sustained. Further analysis of this trial’s data [172] demonstrated, however, that high community uptake might be driven by people already reached by conventional and cheaper HIV testing services. The authors point out the need for demand creation activities so underserved groups would also be reached. Relatedly, a trial in Zambia [171] showed that secondary distribution with household distribution may be useful for targeting men and those older than 30 years old but tracking outcomes and minimizing costs would be challenging. Finally, a cohort study in China [180] showed that initiating HIV-ST might lead to increased engagement in facility-based testing which demonstrates HIV-ST’s potential for improving the reach and long-term engagement with general HIV testing services.

We found only one study in Zimbabwe [125] that clearly described the organizational experience of routinization and scaling up of HIV-ST services and thus measures Proctor’s penetration and sustainability. Scaling up of HIV-ST services in the program occurred only after three years of formative assessment and implementation. The program involves distribution of HIV-ST kits in 7 clinics and 12 outreach sites for FSW. The report showed that sustained implementation of HIV-ST. FSW were able to use the kits for themselves or distribute to their partners and clients. They were able to use routine data to monitor HIV-ST uptake including how many take the test on-site and how many agree to do secondary distribution. They also found that with adequate support, FSW were able to use HIV-ST accurately and did not encounter issues of linkage to care for that testing positive. The program was also able to maintain activities to routinely obtain feedback from FSW and the feedback subsequently informed their next steps.

Linkage to care and safety

In addition to implementation outcomes, we found several studies that examined linkage to care rates (e.g., confirmatory testing, starting treatment) and decided to include these in the report. While studies often reported the number of people who tested positive, it was difficult to calculate linkage rates because they did not always delineate between those who tested positive with HIV-ST, those who sought confirmatory testing, and those who had confirmed positives. Linkage to care also did not seem to follow a standard definition with some treating linkage as synonymous with starting ART and others treating linkage as those who sought further assessment after getting a positive test.

Linkage to care

There was a mix of approaches to measuring confirmatory testing. Most studies verified receipt of testing by either having all HIVST users undergo confirmatory testing as part of the protocol or by looking at clinic records with only a third (12/36, 33%) relying solely on report by study participants. From the studies with available counts, we found that rates of confirmatory testing were often high [23, 24, 29, 57, 61, 66, 68, 74, 77, 81, 84, 125, 133, 140, 145, 147, 156, 160, 162, 164, 168, 174, 178, 180, 207, 224, 225]. Only two studies [81, 144] reported low rates of confirmatory testing. One [144] was a trial of HIV-ST distribution through female partners in Kenya that showed only 25% (2/8 positives) of those with positive results in the HIV-ST intervention arm sought confirmatory testing compared to 75% (2/4 positives) confirmatory testing rate in the control arm. The other was a pilot trial of distribution of HIV-ST kits to male clients of brothels in Indonesia [81] where they detected two HIV positive results among the 188 who agreed to show their results but on follow-up they did not find evidence of receiving additional testing.

Similarly, most studies that reported linkage to care of confirmed positive cases found more than 50% linkage rates [23, 29, 57, 74, 77, 78, 84, 133, 144, 151, 152, 207] with only two reporting <20% linkage rates [81, 156]. One study with low rates [81] was the pilot study in Indonesia described above. The other was a trial of HIVST distribution via female partners in Uganda that reported low linkage of males who tested positive.[156] Most studies also reported 50% or higher rates ART initiation [24, 25, 29, 61, 84, 133, 140, 151, 152, 160, 162, 207, 224226]; only two studies (in China [168] and in South Africa [174]), both of which were focused on assessing strategies to improve uptake among males, reported <30% initiation rates. Both studies had systems in place to provide counseling and follow-up to those who tested positive but still observed low rates.

Two interventional studies in Malawi and Zambia [152, 227] allowed comparing linkage rates of HIV-ST recipients to those under standard care. In both studies, linkage was lower in the HIV-ST arm confirming concerns raised previously described in the appropriateness section.

Safety and coercive testing

The occurrence of adverse events like coercive testing, self-harm after positive test results, and interpersonal violence seemed to be low across the studies that included these metrics [25, 47, 78, 85, 96, 97, 100, 125, 140, 145, 147, 150, 156, 162, 165, 169, 176, 178, 180, 181, 183, 188, 190, 192]. Some studies reported no serious adverse advents [78, 127, 144, 152]. Coercive testing was experienced by 2% to 9% of users with perpetrators being partners and healthcare workers and occurred via deception or threat of harm. While self-harm is a major concern based on qualitative studies, this does not seem to occur widely. An active community surveillance system in Malawi did not detect suicide due to HIV-ST [78] although a study in China reported that suicidal ideation and violence among positive testers was common [178]. Interpersonal violence (including sexual abuse) was an issue in distribution programs and was documented in qualitative and quantitative studies. Occurrence of this in HIV-ST distribution studies [47, 68, 78, 85, 156, 165, 169, 188] varied widely ranging from 0% to 10.5%. There were also other forms of harm reported in studies. In a pilot trial in Uganda [85], two of 19 distributors reported facing hostility from potential users. Marriage dissolution was raised by participants in a qualitative study in Malawi [95] but the report of the trial where the qualitative study was nested did not report occurrence of this event.[78] In a Zambian trial [145], there were 13 reported social harm events among 13,267 participants in the HIV-ST arm and these events included two cases of couple separation, three cases of emotional distress, and one cases of threat of suicide. In trial in Uganda [146], there were only two reported events among 632 HIV-ST users involving one case of verbal abuse and one case of emotional distress from a false positive result.

Discussion

In this scoping review, we found that the HIV-ST literature on implementation in LMIC remained largely focused on early implementation outcomes. HIV-ST was acceptable in a wide variety of LMIC and key populations. While it was perceived to be appropriate serving as a convenient alternative or add-on to standard testing since it was better at protecting confidentiality, the lack of counselling was troubling to potential users. It had high sensitivity and specificity, but the occurrence of user errors threatened diagnostic performance. Limited evidence supports the effectiveness of distribution via peers, intimate partners, community members, and online platforms in increasing adoption of HIV-ST. HIV-ST often increased program costs but may still be cost-effective if it improves HIV detection (Table 2).

Table 2
Summary of findings and gaps according to implementation outcomes.
OutcomeKey FindingsGaps
AcceptabilityTarget users were likely to be willing to use and pay for HIV-ST, especially those with prior experience.

HIV-ST was often rated easy to use.
More studies on other priority populations such as transgender women.
AppropriatenessHIV-ST was as a convenient alternative to facility testing that also promoted autonomy and protected confidentiality.

HIV-ST programs need to include strong linkage and counselling mechanisms and must ensure an enabling policy environment.

HIV-ST kits need to be designed to ensure ease of use and compatibility with local preferences (e.g., specimen type).
Most studies looked at appropriateness at the user level but have not assessed appropriateness from the perspective of program implementers or policy makers. Appropriateness in terms of integration with existing programs is also understudied.
Adoption (Uptake)HIV-ST can passively diffuse through target populations just from market availability.

Partner and peer distribution were effective means of improving adoption. Online distribution was feasible but needs to be evaluated for effectiveness.
There are very few robust evaluations of implementation strategies to promote adoption.
FeasibilityUser errors were common but might not necessarily affect diagnostic testing accuracy.

HIV-ST was highly specific but only fairly sensitive.
There is a need to identify which user errors affect sensitivity and specificity, and what are effective strategies that will lower user errors in terms of performing the test and interpreting the results.
FidelityMost studies that measured fidelity reported high compliance to implementation strategies.Fidelity needs to be reported consistently and interpreted in terms of impact on HIV-ST uptake and/or HIV-ST test diagnostic accuracy.
CostAddition of HIV-ST would increase program costs mainly due to the cost of the kit, but programs can still be cost-effective if adding HIV-ST improves detection and treatment rates of HIV positives. HIV-ST might be more cost-effective in high prevalence areas and as a targeted strategy for hard to reach populations.There is a need for more costing and cost-effectiveness studies. Guidance on how to do costing for HIV-ST programs would be beneficial to the field.
Penetration and sustainabilityWe saw one case of a sustained and scaled up program that utilized phased implementation and consistently involved target users in the process. Reaching target users can be challenging and would likely need more than one distribution strategy.There is a need for more organization or system-level studies on this outcome. Inclusion of HIV-ST use in representative samples should be considered to measure population-level penetration. Studies should pay special attention to impact of and strategies for integration of HIV-ST into existing HIV testing programs.
Linkage to care and safetyHIV-ST linkage rates were comparable to standard of care, but studies often reported low positivity rates or used strict linkage policies that would be difficult to replicate in actual practice.There is a need for long-term and large-scale studies to assess impact on linkage to care and safety.

Our key findings are aligned with findings of previous reviews that covered high income settings or have been limited to Africa [7, 1013]. Prior reviews concluded that HIV-ST is generally acceptable especially if available at a low cost and that can be used by target populations with good accuracy and low error rates. Like our review, prior reviews also found that HIV-ST was viewed as a convenient alternative to facility-testing that improves testing confidentiality, reduces stigma, and supports autonomy. These reviews also pointed out counseling and linkage as important issues that need to be tackled in implementation. The reviews generally had little information on effectiveness of adoption strategies, linkage to care, and safety and our review found several studies that tacked these issues. Notably, we found promising evidence for partner or peer-based distribution strategies. We also found quantitative studies that found issues related to linkage and safety occur but are uncommon. Despite the low rates of harm or losing to follow-up, it is important for HIV-ST programs to include features to prevent or address these issues including a surveillance and quick response system to mitigate serious events like suicide. The concept of safety should not be limited to physical harm, rather, it should include emotional or economic harm such as coercive testing, distress from positive results, couple separation, or threats of economic abandonment. Finally, while findings of our review and the prior reviews generally converge regardless of geographic region, we observed that published work was still absent in several countries. We stress the need for local research to inform each country’s policies and programs.

While there is a wealth of evidence on HIV-ST implementation outcomes, there are still some gaps that remain (Table 2). Acceptability and appropriateness studies need to expand to cover key stakeholders such as transgender women, policy makers, and frontline service providers. While we learned important program design considerations from qualitative studies, the issues of integration with existing HIV programs need to be explored more. Studying integration is important because most studies often added HIV-ST on to existing standard testing rather than a replacement to standard testing. Relatedly, papers examining the experience of healthcare workers would be important for designing workflows and allocating human resources. We also found that acceptability may differ across target populations. One finding was that first time HIV testers might be less likely to be willing to try HIV-ST compared to experienced HIV testers and, if confirmed by local research, tailored messaging and ancillary services to improve acceptability (and uptake) of first time HIV testers might be necessary.

We found a lot of interventional studies but there is a need to improve reporting of these studies to facilitate evidence assessment and future synthesis. Incomplete reporting of study details and adoption outcomes hindered our assessment of the effectiveness of distribution strategies. While papers measured error rates, there is no standard as to what errors are major and would affect diagnostic accuracy. Despite several studies with multi-component interventions, only a handful reported any fidelity or cost outcomes. In addition, most interventional studies have focused on evaluating the impact of distribution strategies on uptake or adoption. The impact of alternative counseling and linkage models (e.g., pure phone or online counselling) is understudied. There should also be more studies that investigate strategies to address user error rates.

Finally, more studies on late-phase outcomes like cost, penetration and sustainment are needed. More cost and cost-effectiveness studies are needed since costs typically determine the scope of a country’s HIV-ST program. Organization-level studies reporting on penetration and sustainment especially on how HIV-ST is transformed into a routine service that is part of the HIV testing system are also needed. As HIV-ST programs are slowly integrated into existing HIV programs, the potential impact of reduced face-to-face encounters with HCW should be considered. These encounters can serve as means to deliver health promotion messages that may not be related to HIV but are still important to health. Losing these encounters may lead to unintended health consequences that may need to be considered especially in cost-effectiveness analyses using the societal perspective. Larger studies should investigate appropriate implementation strategies that will ensure linkage and safety, especially if programs rely on peer or partner distributors. All these studies should follow best practices in performing implementation science research [228].

Our review has several limitations. We limited our review to English-language articles; this led to exclusion of several foreign-language articles, most from China. As this was a scoping review, we also did not perform quality assessment, and more focused systematic reviews will be needed to answer specific implementation questions (e.g., effectiveness of implementation strategies on adoption or diagnostic performance of HIV-ST in the field) while also doing a thorough risk of bias assessment. While we utilized several gray literature sources, there could still be valuable studies we failed to capture such as internal technical reports for government health agencies. Lastly, we altered Proctor et al.’s definitions to facilitate extraction and synthesis. Specifically, we interpreted qualitative studies on acceptability, appropriateness, and adoption together, and we categorized compliance to using the HIV-ST under feasibility while compliance to implementation strategies under fidelity.

Conclusions

The accumulation of evidence from LMICs offers a rich resource for guiding implementation of HIV-ST programs in these countries. Evidence shows that HIV-ST is perceived as an acceptable and useful tool to improve HIV testing coverage in LMIC contexts. There are important implementation issues like lack of counselling and linkage to care, the common occurrence of user errors, and the higher cost of HIV-ST programs that needs to be addressed to maximize HIV-ST uptake. While studies on early phase implementation outcomes are useful for designing HIV-ST programs, there is a need for more robust studies on adoption, cost/cost-effectiveness, fidelity, penetration, and sustainability to guide scale up and roll out.

Acknowledgements

We thank Adela Mizrachi for providing feedback on earlier versions of this manuscript. We thank the reviewers for their constructive feedback.

References

CZhang, XLi, MLBrecht, DKoniak-Griffin. Can self-testing increase HIV testing among men who have sex with men: A systematic review and meta-analysis. PLoS One. 2017;12(11):119. 10.1371/journal.pone.0188890

CCJohnson, CKennedy, VFonner, NSiegfried, CFigueroa, SDalal, et al. Examining the effects of HIV self-Testing compared to standard HIV testing services: A systematic review and meta-Analysis. J Int AIDS Soc. 2017;20(1) 10.7448/IAS.20.1.21594

World Health Organization (WHO). WHO Recommends HIV Self-Testing. Vol. 0, Policy Brief. 2016. p. 12.

CFigueroa, CJohnson, NFord, ASands, SDalal, RMeurant, et al. Reliability of HIV rapid diagnostic tests for self-testing compared with testing by health-care workers: a systematic review and meta-analysis. Lancet HIV [Internet]. 2018;5(6):e27790. Available from: 10.1016/S2352-3018(18)30044-4

HIVST.org. HIVST.org Evidence Map [Internet]. [cited 2019 Mar 15]. Available from: www.hivst.org/evidence

EProctor, HSilmere, RRaghavan, PHovmand, GAarons, ABunger, et al. Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Heal Ment Heal Serv Res. 2011;38(2):6576.

KSEstem, JCatania, JDKlausner. HIV Self-Testing: a Review of Current Implementation and Fidelity. Curr HIV/AIDS Rep. 2016;13(2):10715. 10.1007/s11904-016-0307-y

CFigueroa, CJohnson, AVerster, RBaggaley. Attitudes and Acceptability on HIV Self-testing Among Key Populations: A Literature Review. AIDS Behav. 2015;19(11):194965. 10.1007/s10461-015-1097-8

NPant Pai, JSharma, SShivkumar, SPillay, CVadnais, LJoseph, et al. Supervised and Unsupervised Self-Testing for HIV in High- and Low-Risk Populations: A Systematic Review. PLoS Med. 2013;10(4). 10.1371/journal.pmed.1001414

10 

YQin, LHan, ABabbitt, JSWalker, FLiu, HThirumurthy, et al. Experiences Using and Organizing HIV Self-Testing: A Global Qualitative Systematic Review. AIDS. 2018;32(3):37181. 10.1097/QAD.0000000000001705

11 

DRStevens, CJVrana, REDlin, JEKorte. A Global Review of HIV Self-testing: Themes and Implications. AIDS Behav. 2018;22(2):497512. 10.1007/s10461-017-1707-8

12 

CHarichund, MMoshabela. Acceptability of HIV Self-Testing in Sub-Saharan Africa: Scoping Study. AIDS Behav. 2018;22(2):5608. 10.1007/s10461-017-1848-9

13 

PPIndravudh, ATChoko, ELCorbett. Scaling up HIV self-testing in sub-Saharan Africa: A review of technology, policy and evidence. Curr Opin Infect Dis. 2018;31(1):1424. 10.1097/QCO.0000000000000426

14 

CGarritty, DMoher, AAldcroft, DLevac, LHartling, JMoriarty, et al. PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation. Ann Intern Med. 2018;169(7):467. 10.7326/M18-0850

15 

JCMoullin, KSDickson, NAStadnick, BRabin, GAAarons. Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. Implement Sci. 2019;14(1):116. 10.1186/s13012-018-0842-6

16 

MOuzzani, HHammady, ZFedorowicz, AElmagarmid. Rayyan—a web and mobile app for systematic reviews. Syst Rev. 2016;5(210). 10.1186/s13643-016-0384-4

17 

JPopay, HRoberts, ASowden, MPetticrew, LArai, MRodgers, et al. Guidance on the conduct of narrative synthesis in systematic reviews: A product from the ESRC Methods Programme. Lancaster; 2006.

18 

PDoebler, HHolling. Meta-Analysis of Diagnostic Accuracy with mada. R Packag [Internet]. 2015;1:15. Available from: https://cran.r-project.org/web/packages/mada/vignettes/mada.pdf

19 

ACvan Dyk. Self-testing as strategy to increase the uptake of HIV testing in South Africa. African J AIDS Res. 2013;12(1):418. 10.2989/16085906.2013.815413

20 

ACVan Dyk. Client-initiated, provider-initiated, or self-testing for HIV: What do South Africans prefer? J Assoc Nurses AIDS Care [Internet]. 2013;24(6):4556. Available from: 10.1016/j.jana.2012.12.005

21 

MJKennedy, H Du.Toit Exploring the Practice of HIV Self-Testing Among Health Care Workers at Nyeri Provincial Hospital in Kenya [Internet]. University of South Africa; 2012. Available from: http://www.dt.co.kr/contents.html?article_no=2012071302010531749001

22 

KAshburn, GAntelman, MKN’Goran, OJahanpour, AYemaneberhan, BN’Guessan Kouakou, et al. Willingness to use HIV self-test kits and willingness to pay among urban antenatal clients in Cote d’Ivoire and Tanzania: a cross-sectional study. Trop Med Int Heal. 2020;25(9):115565. 10.1111/tmi.13456

23 

SAsiimwe, JOloya, XSong, CCWhalen. Accuracy of Un-supervised Versus Provider-Supervised Self-administered HIV Testing in Uganda: A Randomized Implementation Trial. AIDS Behav. 2014;18(12):247784. 10.1007/s10461-014-0765-4

24 

WDevillé, HTempelman. Feasibility and robustness of an oral HIV self-test in a rural community in South-Africa: An observational diagnostic study. PLoS One. 2019;14(4):113.

25 

KDovel, FShaba, OAOfforjebe, KBalakasi, MNyirenda, KPhiri, et al. Effect of facility-based HIV self-testing on uptake of testing among outpatients in Malawi: a cluster-randomised trial. Lancet Glob Heal [Internet]. 2020;8(2):e27687. Available from: 10.1016/S2214-109X(19)30534-0

26 

TDzinamarira, CMMuvunyi, CKamanzi, TPMashamba-Thompson. HIV self-testing in Rwanda: awareness and acceptability among male clinic attendees in Kigali, Rwanda: A cross-sectional survey. Heliyon [Internet]. 2020;6(3):e03515. Available from: 10.1016/j.heliyon.2020.e03515

27 

JAFlores, BBrown, SRLeón, HSánchez, JTGalea. Individual-level characteristics associated with oral HIV test acceptability among Peruvian men who have sex with men and transgender women: A cross-sectional study. Sex Transm Infect. 2018;94(7):52833. 10.1136/sextrans-2017-053388

28 

AGichangi, JWambua, SMutwiwa, RNjogu, EBazant, JWamicwe, et al. Impact of HIV Self-Test Distribution to Male Partners of ANC Clients: Results of a Randomized Controlled Trial in Kenya. JAIDS J Acquir Immune Defic Syndr [Internet]. 2018;79(4):1. Available from: http://insights.ovid.com/crossref?an=00126334-900000000-96587 10.1097/QAI.0000000000001838

29 

KEGreen, BNVu, HTPhan, MHTran, VNgo H, SHVo, et al. From conventional to disruptive: upturning the HIV testing status quo among men who have sex with men in Vietnam. J Int AIDS Soc [Internet]. 2018;21(S5):e25127. Available from: 10.1002/jia2.25127

30 

GGrésenguet, J de DLongo, STonen-Wolyec, R-SMBouassa, LBelec. Acceptability and Usability Evaluation of Finger-Stick Whole Blood HIV Self-Test as An HIV Screening Tool Adapted to The General Public in The Central African Republic. Open AIDS J [Internet]. 2017;11(1):10118. Available from: 10.2174/1874613601711010101

31 

SDGumede, MNSibiya. Health care users’ knowledge, attitudes and perceptions of HIV self-testing at selected gateway clinics at eThekwini district, KwaZulu-Natal province, South Africa. J Soc Asp HIV/AIDS [Internet]. 2018;15(1):1039. Available from: 10.1080/17290376.2018.1517607

32 

JHector, M-ADavies, JDekker-Boersema, MMAly, CCAAbdalad, EBRLanga, et al. Acceptability and performance of a directly assisted oral HIV self-testing intervention in adolescents in rural Mozambique. PLoS One [Internet]. 2018;13(4):111. Available from: http://www.embase.com/search/results?subaction=viewrecord&from=export&id=L621571221%0A10.1371/journal.pone.0195391

33 

ZIliyasu, RBKassim, BZIliyasu, TGAmole, NSNass, SEMarryshow, et al. Acceptability and correlates of HIV self-testing among university students in northern Nigeria. Int J STD AIDS [Internet]. 2020;31(9):82031. Available from: 10.1177/0956462420920136

34 

PAylward, HEssendi, KLittle, NWilson. Demand for self-tests: Evidence from a Becker–DeGroot–Marschak mechanism field experiment. Heal Econ (United Kingdom). 2020;29(4):489507. 10.1002/hec.3998

35 

IInwani, NChhun, KAgot, CMCleland, SORao, RNduati, et al. Preferred HIV Testing Modalities Among Adolescent Girls and Young Women in Kenya. J Adolesc Heal [Internet]. 2020; Available from: 10.1016/j.jadohealth.2020.07.007

36 

BBIzizag, HSituakibanza, TMbutiwi, RIngwe, FKiazayawoko, ANkodila, et al. Factors associated with acceptability of HIV self-testing (HIVST) among university students in a Peri-Urban area of the Democratic Republic of Congo (DRC). Pan Afr Med J. 2018;31:19. 10.11604/pamj.2018.31.1.15223

37 

CJohnson, MNeuman, PMacPherson, AChoko, CQuinn, VJWong, et al. Use and awareness of and willingness to self-test for HIV: An analysis of cross-sectional population-based surveys in Malawi and Zimbabwe. BMC Public Health. 2020;20(1):113. 10.1186/s12889-019-7969-5

38 

SKalibala, WTun, PCherutich, ANganga, EOweya, POluoch. Factors associated with acceptability of HIV self-testing among health care workers in Kenya. AIDS Behav. 2014;18(SUPPL. 4). 10.1007/s10461-014-0830-z

39 

JEKorte, MStrauss, ABa, EBuregyeya, JKBMatovu, RKisa, et al. HIV testing preferences among pregnant women attending antenatal care and their male partners: a discrete choice experiment in Uganda. African J AIDS Res. 2019;18(4):33240. 10.2989/16085906.2019.1686032

40 

AEKurth, CMCleland, NChhun, JESidle, EWere, VNaanyu, et al. Accuracy and Acceptability of Oral Fluid HIV Self-Testing in a General Adult Population in Kenya. AIDS Behav. 2016;20(4):8709. 10.1007/s10461-015-1213-9

41 

SALippman, ARSPérissé, VGVeloso, PSSullivan, SBuchbinder, RCSineath, et al. Acceptability of self-conducted home-based HIV testing among men who have sex with men in Brazil: data from an on-line survey. Cad Saude Publica [Internet]. 2014;30(4):72434. Available from: http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0102-311X2014000400724&lng=en&tlng=en 10.1590/0102-311x00008913

42 

SALippman, HJGilmore, TLane, ORadebe, YHChen, NMlotshwa, et al. Ability to use oral fluid and fingerstick HIV self-testing (HIVST) among South African MSM. PLoS One. 2018;13(11):114. 10.1371/journal.pone.0206849

43 

SALippman, TLane, ORabede, HGilmore, Y-HChen, NMlotshwa, et al. High Acceptability and Increased HIV Testing Frequency Following Introduction of HIV Self-Testing and Network Distribution among South African MSM. JAIDS J Acquir Immune Defic Syndr [Internet]. 2018;77(3):1. Available from: http://insights.ovid.com/crossref?an=00126334-900000000-96795

44 

CELyons, KColy, ALBowring, BLiestman, DDiouf, VJWong, et al. Use and Acceptability of HIV Self-Testing Among First-Time Testers at Risk for HIV in Senegal. AIDS Behav [Internet]. 2019;23(s2):13041. Available from: 10.1007/s10461-019-02552-2

45 

BBrown, MOFolayan, AImosili, FDurueke, AAmuamuziam. HIV self-testing in Nigeria: Public opinions and perspectives. Glob Public Health [Internet]. 2015;10(3):35465. Available from: 10.1080/17441692.2014.947303

46 

MMajam, LMazzola, NRhagnath, STLalla-Edward, RMahomed, WDFVenter, et al. Usability assessment of seven HIV self-test devices conducted with lay-users in Johannesburg, South Africa. PLoS One [Internet]. 2020;15(1):117. Available from: 10.1371/journal.pone.0227198

47 

TMarwa, SKaranja, JOsero, AOrago. The effects of HIV self-testing kits in increasing uptake of male partner testing among pregnant women attending antenatal clinics in Kenya: A randomized controlled trial. Pan Afr Med J. 2019;33:111. 10.11604/pamj.2019.33.213.14160

48 

MMMokgatle, SMadiba. High acceptability of HIV self-testing among technical vocational education and training college students in gauteng and north west province: What are the implications for the scale up in South Africa? PLoS One. 2017;12(1):114. 10.1371/journal.pone.0169765

49 

SNapierala, EFBair, NMarcus, POchwal, SMaman, KAgot, et al. Male partner testing and sexual behaviour following provision of multiple HIV self-tests to Kenyan women at higher risk of HIV infection in a cluster randomized trial. J Int AIDS Soc. 2020;23(S2):629.

50 

UNwaozuru, JIwelunmor, JJOng, SSalah, CObiezu-Umeh, OEzechi, et al. Preferences for HIV testing services among young people in Nigeria. BMC Health Serv Res. 2019;19(1):19. 10.1186/s12913-018-3827-x

51 

CEOldenburg, KBBiello, AGPerez-brumer, DSNovak, KHMayer, MJMimiaga. HIV testing practices and the potential role of HIV self-testing among men who have sex with men in Mexico. Int J STD AIDS. 2017;28(3):2429. 10.1177/0956462416641556

52 

KFOrtblad, MMChanda, DKMusoke, TNgabirano, MMwale, ANakitende, et al. Acceptability of HIV self-testing to support pre-exposure prophylaxis among female sex workers in Uganda and Zambia: Results from two randomized controlled trials. BMC Infect Dis. 2018;18(1):18. 10.1186/s12879-017-2892-9

53 

KFOrtblad, DKibuuka Musoke, TNgabirano, ANakitende, GTaasi, LGBarresi, et al. HIV self-test performance among female sex workers in Kampala, Uganda: a cross-sectional study. BMJ Open. 2018;8(11):e022652. 10.1136/bmjopen-2018-022652

54 

SWPan, MDurvasula, JJOng, CLiu, WTang, HFu, et al. No Place Like Home? Disentangling Preferences for HIV Testing Locations and Services Among Men Who Have Sex with Men in China. AIDS Behav [Internet]. 2018;(0123456789). Available from: http://link.springer.com/10.1007/s10461-018-2366-0

55 

MAPando, CDolezal, ROMarone, VBarreda, ACarballo-Diéguez, MMAvila, et al. High acceptability of rapid HIV self-testing among a diverse sample of MSM from Buenos Aires, Argentina. PLoS One. 2017;12(7):112. 10.1371/journal.pone.0180361

56 

MJBustamante, KAKonda, DJDavey, SRLeon, GMCalvo, JSalvatierra, et al. HIV self-testing in Peru: questionable availability, high acceptability but potential low linkage to care among men who have sex with men and transgender women. Int J STD AIDS. 2017;28(2):1337. 10.1177/0956462416630674

57 

NPant Pai, TBehlim, LAbrahams, CVadnais, SShivkumar, SPillay, et al. Will an unsupervised self-testing strategy for HIV work in health care workers of South Africa? A cross sectional pilot feasibility study. PLoS One. 2013;8(11):e79772. 10.1371/journal.pone.0079772

58 

NPhanuphak, TAnand, JJantarapakde, CNitpolprasert, KHimmad, TSungsing, et al. What would you choose: Online or Offline or Mixed services? Feasibility of online HIV counselling and testing among Thai men who have sex with men and transgender women and factors associated with service uptake. J Int AIDS Soc [Internet]. 2018;21:e25118. Available from: http://doi.wiley.com/10.1002/jia2.25118

59 

XLRen, ZYWu, GDMi, JMcgoogan, KMRou, YZhao. Uptake of HIV Self-testing among Men Who have Sex with Men in Beijing, China: a Cross-sectional Study. Biomed Environ Sci [Internet]. 2017;30(6):40717. Available from: 10.3967/bes2017.054

60 

EMSchaffer, JMGonzalez, SBWheeler, DKwarisiima, GChamie, HThirumurthy. Promoting HIV Testing by Men: A Discrete Choice Experiment to Elicit Preferences and Predict Uptake of Community-based Testing in Uganda. Appl Health Econ Health Policy [Internet]. 2020;18(3):41332. Available from: 10.1007/s40258-019-00549-5

61 

AEShapiro, Avan Heerden, MKrows, KSausi, NSithole, TTSchaafsma, et al. An implementation study of oral and blood-based HIV self-testing and linkage to care among men in rural and peri-urban KwaZulu-Natal, South Africa. J Int AIDS Soc. 2020;23(S2):3542. 10.1002/jia2.25514

62 

RShrestha, JMGalka, IAzwa, SHLim, TEGuadamuz, FLAltice, et al. Willingness to Use HIV Self-Testing and Associated Factors Among Transgender Women in Malaysia. Transgender Heal. 2020;5(3):18290. 10.1089/trgh.2019.0085

63 

PSmith, MWallace, L-GBekker. Adolescents’ experience of a rapid HIV self-testing device in youth-friendly clinic settings in Cape Town South Africa: A cross-sectional community based usability study: A. J Int AIDS Soc [Internet]. 2016;19(1):21111. Available from: http://www.embase.com/search/results?subaction=viewrecord&from=export&id=L619363110 10.7448/IAS.19.1.21111

64 

MStrauss, GGeorge, ELansdell, JEMantell, KGovender, MRomo, et al. HIV testing preferences among long distance truck drivers in Kenya: a discrete choice experiment. AIDS Care—Psychol Socio-Medical Asp AIDS/HIV. 2018;30(1):7280. 10.1080/09540121.2017.1367086

65 

MStrauss, GGeorge, JEMantell, MLRomo, EMwai, ENNyaga, et al. Stated and revealed preferences for HIV testing: can oral self-testing help to increase uptake amongst truck drivers in Kenya? 2018;113. 10.1186/s12889-018-6122-1

66 

JTao, MYLi, HZQian, LJWang, ZZhang, HFDing, et al. Home-based HIV testing for men who have sex with men in China: A novel community-based partnership to complement government programs. PLoS One. 2014;9(7). 10.1371/journal.pone.0102812

67 

WChang, PMatambanadzo, ATakaruza, KHatzold, FMCowan, ESibanda, et al. Effect of Prices, Distribution Strategies, and Marketing on Demand for HIV Self-testing in Zimbabwe: A Randomized Clinical Trial. JAMA Netw open. 2019;2(8):e199818. 10.1001/jamanetworkopen.2019.9818

68 

HThirumurthy, SHMasters, SNMavedzenge, SMaman, EOmanga, KAgot. Promoting male partner testing and safer sexual decision- making through secondary distribution of HIV self-tests by HIV- uninfected female sex workers and women receiving antenatal and postpartum care in Kenya: a cohort study. Lancet HIV2. 2016;3(6):e26674.

69 

HThirumurthy, SHMasters, KAgot. Willingness to Pay for HIV Self-Tests Among Women in Kenya: Implications for Subsidy and Pricing Policies. J Acquir Immune Defic Syndr. 2018;78(2):e811. 10.1097/QAI.0000000000001659

70 

STonen-Wolyec, SBatina-Agasa, JMuwonga, FFN’kulu, R-SMBouassa, LBélec. Evaluation of the practicability and virological performance of finger-stick whole-blood HIV self-testing in French-speaking sub-Saharan Africa. PLoS One [Internet]. 2018;13(1):e0189475. Available from: NS - 10.1371/journal.pone.0189475

71 

STonen-Wolyec, FXMbopi-Kéou, SBatina-Agasa, GCMKalla, MNoubom, RSMBouassa, et al. Acceptability of hiv self-testing in african students: A cross-sectional survey in the democratic republic of congo. Pan Afr Med J. 2019;33:16. 10.11604/pamj.2019.33.83.18586

72 

STonen-Wolyec, RSMboumba Bouassa, SBatina-Agasa, ATTepungipame, CKTshilumba, LBélec. Sociodemographic characteristics of adolescents preferring home-based HIV self-testing over facility-based voluntary counseling and testing: a cross-sectional study in Kisangani, Democratic Republic of the Congo. Int J STD AIDS. 2020;31(5):4817. 10.1177/0956462419898616

73 

TSTorres, RBDe Boni, MTLDe Vasconcellos, PMLuz, BHoagland, RIMoreira, et al. Awareness of prevention strategies and willingness to use preexposure prophylaxis in brazilian men who have sex with men using apps for sexual encounters: Online cross-sectional study. J Med Internet Res. 2018;20(1):115. 10.2196/publichealth.8997

74 

WTun, LVu, ODirisu, ASekoni, EShoyemi, JNjab, et al. Uptake of HIV self-testing and linkage to treatment among men who have sex with men (MSM) in Nigeria: A pilot programme using key opinion leaders to reach MSM. J Int AIDS Soc [Internet]. 2018;21(2016):e25124. Available from: 10.1002/jia2.25124

75 

PAVara, LSBuhulula, FAMohammed, BNjau. Level of knowledge, acceptability, and willingness to use oral fluid HIV self-testing among medical students in Kilimanjaro region, Tanzania: a descriptive cross-sectional study. AIDS Res Ther [Internet]. 2020;17(1):56. Available from: 10.1186/s12981-020-00311-1

76 

CJVrana-diaz, DRStevens, ENdeche, EJeffrey. HIV Self-testing Knowledge and Attitudes at Sports-based HIV Prevention Tournaments in Nairobi, Kenya. J HIV AIDS Soc Serv. 2019;18(2):18096. 10.1080/15381501.2019.1620663

77 

JEVolk, SALippman, BGrinsztejn, JRLama, NMFernandes, PGonzales, et al. Acceptability and feasibility of HIV self-testing among men who have sex with men in Peru and Brazil. Int J STD AIDS. 2015;27(7):5316. 10.1177/0956462415586676

78 

ATChoko, PMacPherson, ELWebb, BAWilley, HFeasy, RSambakunsi, et al. Uptake, Accuracy, Safety, and Linkage into Care over Two Years of Promoting Annual Self-Testing for HIV in Blantyre, Malawi: A Community-Based Prospective Study. PLoS Med. 2015;12(9):121.

79 

XWang, ZTang, ZWu, QNong, YLi. Promoting oral HIV self-testing via the internet among men who have sex with men in China: a feasibility assessment. HIV Med. 2020;21(5):32233. 10.1111/hiv.12830

80 

VWanga, VOmollo, EABukusi, JBOdoyo, JFMorton, LKidoguchi, et al. Uptake and impact of facility-based HIV self-testing on PrEP delivery: a pilot study among young women in Kisumu, Kenya. J Int AIDS Soc. 2020;23(8):148. 10.1002/jia2.25561

81 

LPLWulandari, JKaldor, RGuy. Uptake and acceptability of assisted and unassisted HIV self-testing among men who purchase sex in brothels in Indonesia: A pilot intervention study. BMC Public Health. 2020;20(1):114. 10.1186/s12889-019-7969-5

82 

HYan, HYang, HFRaymond, JLi, L enShi, XHuan, et al. Experiences and Correlates of HIV Self-Testing Among Men Who Have Sex with Men in Jiangsu Province, China. AIDS Behav. 2015;19(3):48591. 10.1007/s10461-014-0968-8

83 

AZanolini, JChipungu, MJVinikoor, SBosomprah, MMafwenko, CBHolmes, et al. HIV Self-Testing in Lusaka Province, Zambia: Acceptability, Comprehension of Testing Instructions, and Individual Preferences for Self-Test Kit Distribution in a Population-Based Sample of Adolescents and Adults. AIDS Res Hum Retroviruses [Internet]. 2017;34(3):aid.2017.0156. Available from: http://online.liebertpub.com/doi/10.1089/aid.2017.0156

84 

FZhong, WTang, WCheng, PLin, QWu, YCai, et al. Acceptability and feasibility of a social entrepreneurship testing model to promote HIV self-testing and linkage to care among men who have sex with men. HIV Med. 2017;18(5):37682. 10.1111/hiv.12437

85 

ATChoko, MNanfuka, JBirungi, GTaasi, PKisembo, SHelleringer. A pilot trial of the peer-based distribution of HIV self-test kits among fishermen in. PLoS One. 2018;13(11):e0208191. 10.1371/journal.pone.0208191

86 

DFConserve, CBay, MNKilonzo, NEMakyao, LKajula, SMaman. Sexual and Social Network Correlates of Willingness to Self-Test for HIV Among Ever-Tested and Never-Tested Men: Implications for the Tanzania STEP Project. AIDS Care [Internet]. 2019;31(2):16976. Available from: https://www.tandfonline.com/doi/full/10.1080/09540121.2018.1537466

87 

RBDe Boni, VGVeloso, NMFernandes, FLessa, RGCorrêa, RDe Souza Lima, et al. An internet-based HIV self-testing program to increase HIV testing uptake among men who have sex with men in Brazil: Descriptive cross-sectional analysis. J Med Internet Res. 2019;21(8):115. 10.2196/14145

88 

OAdeagbo, CHerbst, ABlandford, RMcKendry, CEstcourt, JSeeley, et al. Exploring people’s candidacy for mobile health-supported HIV testing and care services in rural kwaZulu-natal, South Africa: Qualitative study. J Med Internet Res. 2019;21(11):113. 10.2196/15681

89 

HAGesesew, PWard, KWoldemichael, PLyon, LMwanri. Policy and practice suggestions to improve performance on the UNAIDS 90-90-90 targets: Results from a nominal group technique with HIV experts in Southwest Ethiopia. Heal Expect. 2020;(7):112. 10.1111/hex.13115

90 

JGohil, ESBaja, TRSy, EGGuevara, CHemingway, PMBMedina, et al. Is the Philippines ready for HIV self-testing? BMC Public Health. 2020;20(1):18. 10.1186/s12889-019-7969-5

91 

CHarichund, MMoshabela, PKunene, QAbdool Karim. Acceptability of HIV self-testing among men and women in KwaZulu-Natal, South Africa. AIDS Care—Psychol Socio-Medical Asp AIDS/HIV [Internet]. 2018;0(0):17. Available from: 10.1080/09540121.2018.1503638

92 

CHarichund, QAKarim, PKunene, SSimelane, MMoshabela. Exploring factors that influence the integration of HIVST with HCT using a qualitative comparative cross-over design in KwaZulu-Natal, South Africa. Glob Public Health [Internet]. 2019;14(9):127587. Available from: 10.1080/17441692.2019.1587638

93 

LJennings, DFConserve, JMerrill, LKajula, JIwelunmor, SLinnemayr, et al. Perceived Cost Advantages and Disadvantages of Purchasing HIV Self-Testing Kits among Urban Tanzanian Men: An Inductive Content Analysis. J AIDS Clin Res. 2017;8(8). 10.4172/2155-6113.1000725

94 

MKumwenda, AMunthali, MPhiri, DMwale, TGutteberg, EMacPherson, et al. Factors shaping initial decision-making to self-test amongst cohabiting couples in urban Blantyre, Malawi. AIDS Behav. 2014;18(SUPPL. 4):396404. 10.1007/s10461-014-0817-9

95 

MKKumwenda, ELCorbett, JChikovore, MPhiri, DMwale, ATChoko, et al. Discordance, Disclosure and Normative Gender Roles: Barriers to Couple Testing Within a Community-Level HIV Self-Testing Intervention in Urban Blantyre, Malawi. AIDS Behav [Internet]. 2018;22(8):24919. Available from: 10.1007/s10461-018-2038-0

96 

FLiu, YQin, SMeng, WZhang, WTang, LHan, et al. HIV self-testing among men who have sex with men in China: a qualitative implementation research study. J virus Erad [Internet]. 2019;5(4):2204. Available from: http://www.ncbi.nlm.nih.gov/pubmed/31754445%0Ahttp://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=PMC6844410

97 

WSLora, NDesmond, AObasi, MKumwenda, MTaegtmeyer, RTolhurst, et al. “I wanted evidence that my status had changed, so that is why I tested”: experiences with HIV self-testing among female sex workers in Malawi. AIDS Care—Psychol Socio-Medical Asp AIDS/HIV [Internet]. 2020;32(sup2):20613. Available from: 10.1080/09540121.2020.1739212

98 

TMakusha, LKnight, MTaegtmeyer, OTulloch, ADavids, JLim, et al. HIV self-testing could “revolutionize testing in South Africa, but it has got to be done properly”: Perceptions of key stakeholders. PLoS One. 2015;10(3):110. 10.1371/journal.pone.0122783

99 

VMBurke, NNakyanjo, WDdaaki, CPayne, NHutchinson, MJWawer, et al. HIV self-testing values and preferences among sex workers, fishermen, and mainland community members in Rakai, Uganda: A qualitative study. PLoS One. 2017;12(8):114.

100 

GMartínez Pérez, VCox, TEllman, AMoore, GPatten, AShroufi, et al. “I know that I do have HIV but nobody saw me”: Oral HIV self-testing in an informal settlement in South Africa. PLoS One. 2016;11(4):115.

101 

JKBMatovu, EBuregyeya, JArinaitwe, RKWanyenze. ‘. if you bring the kit home, you [can] get time and test together with your partner’: Pregnant women and male partners’ perceptions regarding female partner-delivered HIV self-testing in Uganda–A qualitative study. Int J STD AIDS [Internet]. 2017;28(13):13417. Available from: http://www.embase.com/search/results?subaction=viewrecord&from=export&id=L618787546 10.1177/0956462417705800

102 

JKBMatovu, RKisa, EBuregyeya, HChemusto, SMugerwa, WMusoke, et al. ‘If I had not taken it [HIVST kit] home, my husband would not have come to the facility to test for HIV’: HIV self-testing perceptions, delivery strategies, and post-test experiences among pregnant women and their male partners in Central Uganda. Glob Health Action [Internet]. 2018;11(1). Available from: 10.1080/16549716.2018.1503784

103 

TMoyo, MMokgatle, SMadiba. Opinions about and acceptability of HIV self-testing amongst students at the Institute of Health Sciences- Lobatse, Botswan. PULA Botswana J African Stud. 2017;31(1):617.

104 

BNjau, ELisasi, DJDamian, DLMushi, ABoulle, CMathews. Feasibility of an HIV self-testing intervention: A formative qualitative study among individuals, community leaders, and HIV testing experts in northern Tanzania. BMC Public Health. 2020;20(1):115. 10.1186/s12889-019-7969-5

105 

SNnko, DNyato, EKuringe, CCasalini, AShao, AKomba, et al. Female sex workers perspectives and concerns regarding HIV self-testing: an exploratory study in Tanzania. BMC Public Health. 2020;20(1):19. 10.1186/s12889-019-7969-5

106 

OKOduetse, BNkomo, NMajingo, YMashalla, ESeloilwe. Perceptions and attitudes towards acceptability of HIV self-testing among female sex workers in Selibe Phikwe, Botswana. African J AIDS Res. 2019;18(3):1927. 10.2989/16085906.2019.1638427

107 

SOkoboi, ATwimukye, OLazarus, BCastelnuovo, CAgaba, MImmaculate, et al. Acceptability, perceived reliability and challenges associated with distributing HIV self-test kits to young MSM in Uganda: a qualitative study. J Int AIDS Soc. 2019;22(3). 10.1002/jia2.25269

108 

KPal, CNgin, STuot, PChhoun, CLy, SChhim, et al. Acceptability study on HIV self-testing among transgender women, men who have sex with men, and female entertainment workers in Cambodia: A qualitative analysis. PLoS One. 2016;11(11):110.

109 

CRainer, BChihota, CDziva Chikwari, GMcHugh, EDauya, HMujuru, et al. Adolescents’ and caregivers’ perceptions of caregiver-provided testing and HIV self-testing using oral mucosal transudate tests in Zimbabwe: a short report. AIDS Care—Psychol Socio-Medical Asp AIDS/HIV [Internet]. 2020;0(0):15. Available from: 10.1080/09540121.2020.1749226

110 

YMChang, TSevekari, ADuerr, YMolina, TGilada. HIV self-testing in Pune, India: perspectives and recommendations of female sex workers and peer educators. AIDS Care—Psychol Socio-Medical Asp AIDS/HIV [Internet]. 2020;32(2):1825. Available from: 10.1080/09540121.2019.1683804

111 

FShaba, OAOfforjebe, KPhiri, ELungu, PKalande, MNyirenda, et al. Perceived Acceptability of a Facility-Based HIV Self-Test Intervention in Outpatient Waiting Spaces among Adult Outpatients in Malawi: A Formative Study. J Acquir Immune Defic Syndr. 2019;81(3):e924. 10.1097/QAI.0000000000002055

112 

EShava, KManyake, CMdluli, KMaribe, NMonnapula, BNkomo, et al. Acceptability of oral HIV self-testing among female sex workers in Gaborone, Botswana. PLoS One. 2020;15(7 July):111. 10.1371/journal.pone.0236052

113 

ASpyrelis, SAbdulla, SFrade, TMeyer, MMhazo, NTaruberekera, et al. Are women more likely to self-test? A short report from an acceptability study of the HIV self-testing kit in South Africa. AIDS Care. 2017;29(3):33943. 10.1080/09540121.2016.1234687

114 

ATembo, LMutunga, SSchwartz, JBassett, TPNgwato, NPakade, et al. Home-based delivery of HIV self-tests by adolescent girls and young women to male sexual partners in Johannesburg, South Africa: benefits and concerns. AIDS Care—Psychol Socio-Medical Asp AIDS/HIV [Internet]. 2020;0(0):19. Available from: 10.1080/09540121.2020.1810615

115 

CWei, HYan, CYang, HFRaymond, JLi, HYang, et al. Accessing HIV Testing and Treatment among Men Who Have Sex. AIDS Care. 2014;26(3):3728. 10.1080/09540121.2013.824538

116 

ALWirtz, EClouse, VVeronese, KHThu, SNaing, SDBaral, et al. New HIV testing technologies in the context of a concentrated epidemic and evolving HIV prevention: Qualitative research on HIV self-Testing among men who have sex with men and transgender women in Yangon, Myanmar. J Int AIDS Soc [Internet]. 2017;20(1):19. Available from: 10.7448/IAS.20.01.21796

117 

LPLWulandari, ARuddick, RGuy, JKaldor. “Self-testing sounds more private, rather than going to the clinic and everybody will find out”: Facilitators and barriers regarding HIV testing among men who purchase sex in Bali, Indonesia. PLoS One. 2019;14(4):116.

118 

ATChoko, MKKumwenda, CCJohnson, DWSakala, MCChikalipo, KFielding, et al. Acceptability of woman-delivered HIV self-testing to the male partner, and additional interventions: A qualitative study of antenatal care participants in Malawi: A. J Int AIDS Soc [Internet]. 2017;20(1):110. Available from: 10.7448/IAS.20.1.21610

119 

SNChristian, JEMantell, MLRomo, CGrov, GGeorge, EMwai, et al. Applying a social-ecological lens to opinions about HIV self-testing among Kenyan truckers who declined to test: a qualitative study. African J AIDS Res. 2020;19(2):14755. 10.2989/16085906.2020.1764070

120 

DFConserve, KEMuessig, LLMaboko, SShririma, MNKilonzo, SMaman, et al. Mate yako afya yako: Formative research to develop the Tanzania HIV self-testing education and promotion (Tanzania STEP) project for men. PLoS One [Internet]. 2018;13(8):e0202521. Available from: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0202521&type=printable%0Ahttp://ovidsp.ovid.com/ovidweb.cgi?T=JS&PAGE=reference&D=emexb&NEWS=N&AN=623664243 10.1371/journal.pone.0202521

121 

DFConserve, JMichel, JEAdrien Demes, JMChéry, JGBalan, ATChoko, et al. Local and national stakeholders’ perceptions towards implementing and scaling up HIV self-testing and secondary distribution of HIV self-testing by Option B+ patients as an assisted partner service strategy to reach men in Haiti. PLoS One. 2020;15(5):117. 10.1371/journal.pone.0233606

122 

ODirisu, ASekoni, LVu, SAdebajo, JNjab, EShoyemi, et al. ‘I will welcome this one 101%, I will so embrace it’: a qualitative exploration of the feasibility and acceptability of HIV self-testing among men who have sex with men (MSM) in Lagos, Nigeria. Health Educ Res. 2020;

123 

TDzinamarira, CKamanzi, TPMashamba-Thompson. Key stakeholders’ perspectives on implementation and scale up of HIV self-testing in Rwanda. Diagnostics. 2020;10(4):112. 10.3390/diagnostics10040194

124 

AAmstutz, MKopo, TILejone, LKhesa, MKao, JMuhairwe, et al. “If it is left, it becomes easy for me to get tested”: Use of oral self-tests and community health workers to maximize the potential of home-based HIV testing among adolescents in Lesotho. J Int AIDS Soc. 2020;23(S5):329. 10.1002/jia2.25563

125 

SNapierala, NADesmond, MKKumwenda, MTumushime, ELSibanda, PIndravudh, et al. HIV self-testing services for female sex workers, Malawi and Zimbabwe. Bull World Health Organ. 2019;97(11):76476. 10.2471/BLT.18.223560

126 

National AIDS and STD Control Programme Ministry of Health Kenya. Preparedness for HIV/AIDS Service Delivery: Kenya Health Workers Survey 2005. Nairobi, Kenya; 2006.

127 

KNgure, RHeffron, NMugo, KAThomson, EIrungu, NNjuguna, et al. Feasibility and acceptability of HIV self-testing among pre-exposure prophylaxis users in Kenya. J Int AIDS Soc [Internet]. 2017;20:21234. Available from: NS- 10.7448/IAS.20.1.21234

128 

ENkuna, NZNyazema. HIV Self-Testing, Self-Stigma and Haart Treatment at the University of Limpopo: Health Sciences Students’ Opinion and Perspectives. Open AIDS J [Internet]. 2016;10(1):7882. Available from: http://benthamopen.com/ABSTRACT/TOAIDJ-10-78 10.2174/1874613601610010078

129 

Ochako R, Vu L, Peterson K. Insights Into Potential Users and Messaging for HIV Oral Self-Test Kits in Kenya, 3ie Grantee Final Report [Internet]. Washington, DC; 2014. Available from: http://www.3ieimpact.org/media/filer_public/2014/07/21/insights_into_potential_users-final.pdf

130 

POyaro, ZKwena, EABukusi, JMBaeten. Is HIV Self-Testing a Strategy to Increase Repeat Testing Among Pregnant and Postpartum Women? A Pilot Mixed Methods Study. J Acquir Immune Defic Syndr. 2020;84(4):36571. 10.1097/QAI.0000000000002347

131 

RBPeck, JMLim, Hvan Rooyen, WMukoma, LChepuka, PBansil, et al. What Should the Ideal HIV Self-Test Look Like? A Usability Study of Test Prototypes in Unsupervised HIV Self-Testing in Kenya, Malawi, and South Africa. AIDS Behav. 2014;18:S42232. 10.1007/s10461-014-0818-8

132 

TDRitchwood, ASelin, APettifor, SALippman, HGilmore, LKimaru, et al. HIV self-testing: South African young adults’ recommendations for ease of use, test kit contents, accessibility, and supportive resources. BMC Public Health. 2019;19(1).

133 

ASarkar, GMburu, VShivkumar P, PSharma, FCampbell, JBehera, et al. Feasibility of supervised self-testing using an oral fluid-based HIV rapid testing method: A cross-sectional, mixed method study among pregnant women in rural India: A. J Int AIDS Soc [Internet]. 2016;19(1). Available from: http://www.embase.com/search/results?subaction=viewrecord&from=export&id=L619363106

134 

PBwana, LOchieng, MMwau. Performance and usability evaluation of the INSTI HIV self-test in Kenya for qualitative detection of antibodies to HIV. PLoS One. 2018;13(9):117. 10.1371/journal.pone.0202491

135 

JChipungu, SBosomprah, AZanolini, HThimurthy, RChilengi, ASharma, et al. Understanding linkage to care with HIV self-test approach in Lusaka, Zambia—A mixed method approach. PLoS One. 2017;12(11):112.

136 

ATChoko, NDesmond, ELWebb, KChavula, SNapierala-Mavedzenge, CAGaydos, et al. The uptake and accuracy of oral kits for HIV self-testing in high HIV prevalence setting: A cross-sectional feasibility study in Blantyre, Malawi. PLoS Med. 2011;8(10). 10.1371/journal.pmed.1001102

137 

PPIndravudh, ELSibanda, MD’Elbée, MKKumwenda, BRingwald, GMaringwa, et al. “I will choose when to test, where i want to test”: Investigating young people’s preferences for HIV self-testing in Malawi and Zimbabwe. Aids. 2017;31(February):S20312. 10.1097/QAD.0000000000001516

138 

BKebede, TAbate, DMekonnen. HIV self-testing practices among Health Care Workers: Feasibility and options for accelerating HIV testing services in Ethiopia. Pan Afr Med J. 2013;15:18. 10.11604/pamj.2013.15.1.2228

139 

LKnight, TMakusha, JLim, RPeck, MTaegtmeyer, HVan Rooyen. “i think it is right”: A qualitative exploration of the acceptability and desired future use of oral swab and finger-prick HIV self-tests by lay users in KwaZulu-Natal, South Africa. BMC Res Notes. 2017;10(1):18. 10.1186/s13104-016-2345-3

140 

JKBMatovu, LMBogart, JNakabugo, JKagaayi, DSerwadda, RKWanyenze, et al. Feasibility and acceptability of a pilot, peer-led HIV self-testing intervention in a hyperendemic fishing community in rural Uganda. PLoS One [Internet]. 2020;15(8 July):119. Available from: 10.1371/journal.pone.0236141

141 

PMMugo, MMicheni, JShangala, MHHussein, SMGraham, TFRinke De Wit, et al. Uptake and acceptability of oral HIV self-testing among community pharmacy clients in Kenya: A feasibility study. PLoS One. 2017;12(1):115. 10.1371/journal.pone.0170868

142 

GMarley, DKang, ECWilson, THuang, YQian, XLi, et al. Introducing rapid oral-fluid HIV testing among high risk populations in Shandong, China: Feasibility and challenges. BMC Public Health. 2014;14(1):17. 10.1186/1471-2458-14-422

143 

PMacPherson, DGLalloo, ELWebb, HMaheswaran, ATChoko, SDMakombe, et al. Effect of optional home initiation of HIV care following HIV self-testing on antiretroviral therapy initiation among adults in Malawi: A randomized clinical trial. JAMA—J Am Med Assoc. 2014;312(4):3729. 10.1001/jama.2014.6493

144 

SHMasters, KAgot, BObonyo, SNapierala Mavedzenge, SMaman, HThirumurthy. Promoting Partner Testing and Couples Testing through Secondary Distribution of HIV Self-Tests: A Randomized Clinical Trial. PLoS Med. 2016;13(11):115. 10.1371/journal.pmed.1002166

145 

CMulubwa, BHensen, MPhiri, KShanaube, ASchaap, SFloyd, et al. Community distribution of oral HIV self-test kits nested in four HPTN 071 (PopART) communities in Zambia: A cluster-randomized trial. Lancet HIV [Internet]. 2018;071(18):46. Available from: 10.1016/S2352-3018(18)30258-3

146 

KOrtblad, DKibuuka Musoke, TNgabirano, ANakitende, JMagoola, PKayiira, et al. Direct provision versus facility collection of HIV self-tests among female sex workers in Uganda: A cluster-randomized controlled health systems trial. PLoS Med. 2017;14(11):124. 10.1371/journal.pmed.1002458

147 

APettifor, SALippman, LKimaru, NHaber, ZMayakayaka, ASelin, et al. HIV self-testing among young women in rural South Africa: A randomized controlled trial comparing clinic-based HIV testing to the choice of either clinic testing or HIV self-testing with secondary distribution to peers and partners. EClinicalMedicine [Internet]. 2020;21:100327. Available from: 10.1016/j.eclinm.2020.100327

148 

ELSibanda, Md’Elbée, GMaringwa, NRuhode, MTumushime, CMadanhire, et al. Applying user preferences to optimize the contribution of HIV self-testing to reaching the “first 90” target of UNAIDS Fast-track strategy: results from discrete choice experiments in Zimbabwe. J Int AIDS Soc. 2019;22(S1):3342. 10.1002/jia2.25245

149 

WTang, CWei, BCao, DWu, KTLi, HLu, et al. Crowdsourcing to expand HIV testing among men who have sex with men in China: A closed cohort stepped wedge cluster randomized controlled trial. PLoS Med [Internet]. 2018;15(8):e1002645. Available from: http://www.embase.com/search/results?subaction=viewrecord&from=export&id=L623900180%0A 10.1371/journal.pmed.1002645

150 

XZhu, WZhang, DOperario, YZhao, AShi, ZZhang, et al. Effects of a Mobile Health Intervention to Promote HIV Self-testing with MSM in China: A Randomized Controlled Trial. AIDS Behav [Internet]. 2019;23(11):312939. Available from: 10.1007/s10461-019-02452-5

151 

MMChanda, KFOrtblad, MMwale, SChongo, CKanchele, NKamungoma, et al. HIV self-testing among female sex workers in Zambia: A cluster randomized controlled trial. PLoS Med. 2017;14(11):119. 10.1371/journal.pmed.1002442

152 

ATChoko, ELCorbett, NStallard, HMaheswaran, ALepine, CCJohnson, et al. HIV self-testing alone or with additional interventions, including financial incentives, and linkage to care or prevention among male partners of antenatal care clinic attendees in Malawi: An adaptive multi-arm, multi-stage cluster randomised trial. PLoS Med [Internet]. 2019;116. Available from: https://journals.plos.org/plosmedicine/article?id=10.1371/journal.pmed.1002719

153 

EAKelvin, GGeorge, EMwai, SKinyanjui, MLRomo, JOOdhiambo, et al. A Randomized Controlled Trial to Increase HIV Testing Demand Among Female Sex Workers in Kenya Through Announcing the Availability of HIV Self-testing Via Text Message. AIDS Behav [Internet]. 2018;23(1):11625. Available from: 10.1007/s10461-018-2248-5

154 

EAKelvin, GGeorge, EMwai, ENyaga, JEMantell, MLRomo, et al. Offering self-administered oral HIV testing to truck drivers in Kenya to increase testing: a randomized controlled trial. AIDS Care—Psychol Socio-Medical Asp AIDS/HIV. 2018;30(1):4755. 10.1080/09540121.2017.1360997

155 

EAKelvin, GGeorge, SKinyanjui, EMwai, MLRomo, FOruko, et al. Announcing the availability of oral HIV self-test kits via text message to increase HIV testing among hard-to-reach truckers in Kenya: a randomized controlled trial. BMC Public Health [Internet]. 2019;19(1):7. Available from: https://bmcpublichealth.biomedcentral.com/articles/10.1186/s12889-018-6345-1

156 

JEKorte, RKisa, CJVrana-Diaz, AMMalek, EBuregyeya, JKBMatovu, et al. HIV Oral Self-Testing for Male Partners of Women Attending Antenatal Care in Central Uganda: Uptake of Testing and Linkage to Care in a Randomized Trial. J Acquir Immune Defic Syndr. 2020;84(3):2719. 10.1097/QAI.0000000000002341

157 

TAnand, CNitpolprasert, SJKerr, TApornpong, JAnanworanich, PPhanuphak, et al. Implementation of an online HIV prevention and treatment cascade in Thai men who have sex with men and transgender women using Adam’s Love Electronic Health Record system. J Virus Erad. 2017;3(1):1523.

158 

RBDe Boni, NLentini, ACSantelli, ABarbosa, MCruz, TBingham, et al. Self-testing, communication and information technology to promote HIV diagnosis among young gay and other men who have sex with men (MSM) in Brazil. J Int AIDS Soc [Internet]. 2018;21(S5):e25116. Available from: http://doi.wiley.com/10.1002/jia2.25116

159 

KHatzold, SGudukeya, MNMutseta, RChilongosi, MNalubamba, CNkhoma, et al. HIV self-testing: breaking the barriers to uptake of testing among men and adolescents in sub-Saharan Africa, experiences from STAR demonstration projects in Malawi, Zambia and Zimbabwe. J Int AIDS Soc. 2019;22(S1):4352. 10.1002/jia2.25244

160 

XJin, JXu, MKSmith, DXiao, ERRapheal, XXiu, et al. An internet-based self-testing model (easy test): Cross-sectional survey targeting men who have sex with men who never tested for HIV in 14 provinces of China. J Med Internet Res. 2019;21(5):113. 10.2196/11854

161 

MLuo, KHann, GZhang, XPan, QMa, JJiang, et al. HIV testing uptake and yield among sexual partners of HIV-positive men who have sex with men in Zhejiang Province, China, 2014–2016: A cross-sectional pilot study of a choicebased partner tracing and testing package. PLoS One [Internet]. 2020;15(6):113. Available from: 10.1371/journal.pone.0232268

162 

VTTNguyen, HTTPhan, MKato, QTNguyen, Ai KALe, SHVo, et al. Community-led HIV testing services including HIV self-testing and assisted partner notification services in Vietnam: lessons from a pilot study in a concentrated epidemic setting. J Int AIDS Soc. 2019;22(S3):408.

163 

SOkoboi, OLazarus, BCastelnuovo, MNanfuka, AKambugu, AMujugira, et al. Peer distribution of HIV self-test kits to men who have sex with men to identify undiagnosed HIV infection in Uganda: A pilot study. PLoS One. 2020;15(1):228. 10.1371/journal.pone.0227741

164 

LPasipamire, RCNesbitt, LDube, EMabena, MNzima, MDlamini, et al. Implementation of community and facility-based HIV self-testing under routine conditions in southern Eswatini. Trop Med Int Heal. 2020;25(6):72331.

165 

JPintye, ALDrake, EBegnel, JKinuthia, FAbuna, HLagat, et al. Acceptability and outcomes of distributing HIV self-tests for male partner testing in Kenyan maternal child health and family planning clinics. AIDS. 2019;33(8):136978. 10.1097/QAD.0000000000002211

166 

WXiao, LYan, LChen, GFu, HYang, CYang, et al. Sexual network distribution of HIV self-testing kits: Findings from the process evaluation of an intervention for men who have sex with men in China. PLoS One [Internet]. 2020;15(4):111. Available from: 10.1371/journal.pone.0232094

167 

XYan, HSu, BZhang, YLi, LZhang, ZJia. Adherence of HIV Self-Testing Among Men Who Have Sex With Men in China: Longitudinal Study. J Med Internet Res. 2020;22(9):e19627. 10.2196/19627

168 

WZhang, QHu, WTang, XJin, XMao, TLu, et al. HIV Self-Testing Programs to Men Who Have Sex With Men Delivered by Social Media Key Opinion Leaders and Community-Based Organizations are Both Effective and Complementary: A National Pragmatic Study in China. J Acquir Immune Defic Syndr. 2020;84(5):45362. 10.1097/QAI.0000000000002375

169 

ALDrake, EBegnel, JPintye, JKinuthia, ADWagner, CWRothschild, et al. The utility of SMS to report male partner HIV self-testing outcomes among women seeking reproductive health services in Kenya: Cohort study. J Med Internet Res. 2020;22(3):17. 10.2196/15281

170 

LHan, CHBien, CWei, KEMuessig, MYang, FLiu, et al. HIV Self-Testing Among Online MSM in China: Implications for Expanding HIV Testing Among Key Populations. J Acquir Immune Defic Syndr. 2014;67(2):21621. 10.1097/QAI.0000000000000278

171 

BHensen, AJSchaap, CMulubwa, SFloyd, KShanaube, MMPhiri, et al. Who Accepts and Who Uses Community-Based Secondary Distribution HIV Self-Testing (HIVST) Kits? Findings From the Intervention Arm of a Cluster-Randomized Trial of HIVST Distribution Nested in Four HPTN 071 (PopART) Communities in Zambia. J Acquir Immune Defic Syndr. 2020;84(4):35564. 10.1097/QAI.0000000000002344

172 

PPIndravudh, BHensen, RNzawa, RChilongosi, RNyirenda, CCJohnson, et al. Who is reached by HIV self-testing? Individual factors associated with self-testing within a community-based programme in rural Malawi. JAIDS J Acquir Immune Defic Syndr. 2020;Publish Ah(2):16573.

173 

EAKelvin, GGeorge, EMwai, ENNyaga, JEMantell, MLRomo, et al. Offering Self-administered Oral HIV Testing as a Choice to Truck Drivers in Kenya: Predictors of Uptake and Need for Guidance While Self-testing. AIDS Behav. 2018;22(2):58092. 10.1007/s10461-017-1783-9

174 

LLebina, NSeatlholo, NTaruberekera, MRadebe, AKinghorn, TMeyer, et al. Feasibility of community-based HIV self-screening in South Africa: A demonstration project. BMC Public Health. 2019;19(1):18. 10.1186/s12889-018-6343-3

175 

YLiu, GWu, RLu, ROu, LHu, YYin, et al. Facilitators and barriers associated with uptake of HIV self-testing among men who have sex with men in Chongqing, China: A cross-sectional survey. Int J Environ Res Public Health. 2020;17(5):111. 10.3390/ijerph17051634

176 

JJOng, HLi, WDan, HFu, ELiu, WMa, et al. Coercion and HIV self-testing in Chinese men who have sex with men: implementation data from a cross-sectional survey. Lancet [Internet]. 2017;390(2):S57. Available from: http://linkinghub.elsevier.com/retrieve/pii/S0140673617331951

177 

KFOrtblad, DKMusoke, TNgabirano, ANakitende, JEHaberer, MMcConnell, et al. Female Sex Workers Often Incorrectly Interpret HIV Self-Test Results in Uganda. J Acquir Immune Defic Syndr [Internet]. 2018;79(1):e425. Available from: http://insights.ovid.com/crossref?an=00126334-201809010-00024%0Apapers3://publication/doi/10.1097/QAI.0000000000001765

178 

YQin, WTang, ANowacki, KMollan, SAReifeis, MGHudgens, et al. Benefits and Potential Harms of HIV Self-Testing Among Men Who Have Sex With Men In China: An Implementation Perspective. Sex Transm Dis. 2017;44(4):2338. 10.1097/OLQ.0000000000000581

179 

EMSchaffer, KAgot, HThirumurthy. The Association Between Intimate Partner Violence and Womenʼs Distribution and Use of HIV Self-Tests With Male Partners. JAIDS J Acquir Immune Defic Syndr [Internet]. 2017;76(3):e857. Available from: http://insights.ovid.com/crossref?an=00126334-201711010-00019 10.1097/QAI.0000000000001502

180 

WTang, WHuang, HLu, BCao, DWu, JOng, et al. What happens after HIV self-testing? Results from a longitudinal cohort of Chinese men who have sex with men. BMC Infect Dis. 2019;19(1):17. 10.1186/s12879-018-3567-x

181 

CJVrana-Diaz, JEKorte, MGebregziabher, LRichey, ASelassie, MSweat, et al. Relationship Gender Equality and Couples’ Uptake of Oral Human Immunodeficiency Virus Self-Testing Kits Delivered by Pregnant Women in Kenya. Sex Transm Dis. 2019;46(9):58893. 10.1097/OLQ.0000000000001037

182 

CWei, LYan, SALippman, XSu, JLi, LChen, et al. Prevalence and correlates of point-of-sex HIV self-testing among HIV-negative men who have sex with men in China. Sex Transm Dis [Internet]. 2018;45(12):1. Available from: http://insights.ovid.com/crossref?an=00007435-900000000-98220 10.1097/OLQ.0000000000000885

183 

KAgot, GNWango, BObonyo, HThirumurthy. HIV Self-Testing Can Be Liberating to HIV-Positive Women and Their Sexual Partners: A Qualitative Study in Kisumu, Western Kenya. J Int Assoc Provid AIDS Care. 2020;19:18. 10.1177/2325958220919230

184 

CBwalya, MSimwinga, BHensen, LGwanu, AHang’Andu, CMulubwa, et al. Social response to the delivery of HIV self-testing in households: Experiences from four Zambian HPTN 071 (PopART) urban communities. AIDS Res Ther [Internet]. 2020;17(1):112. Available from: 10.1186/s12981-019-0257-8

185 

CHarichund, PKunene, SSimelane, QAKarim, MMoshabela. Repeat HIV testing practices in the era of HIV self-testing among adults in KwaZulu-Natal, South Africa. PLoS One. 2019;14(2):112. 10.1371/journal.pone.0212343

186 

RBHershow, CCZimba, OMweemba, KFChibwe, TPhanga, WDunda, et al. Perspectives on HIV partner notification, partner HIV self-testing and partner home-based HIV testing by pregnant and postpartum women in antenatal settings: a qualitative analysis in Malawi and Zambia. J Int AIDS Soc. 2019;22(S3):5764. 10.1002/jia2.25293

187 

JIwelunmor, OEzechi, CObiezu-Umeh, TGbaja-Biamila, UNwaozuru, DOladele, et al. The 4 youth by youth HIV self-testing crowdsourcing contest: A qualitative evaluation. PLoS One [Internet]. 2020;15(5):113. Available from: 10.1371/journal.pone.0233698

188 

MKKumwenda, CCJohnson, ATChoko, WLora, WSibande, DSakala, et al. Exploring social harms during distribution of HIV self-testing kits using mixed-methods approaches in Malawi. J Int AIDS Soc. 2019;22(S1). 10.1002/jia2.25251

189 

SMaman, KRMurray, SNMavedzenge, LOluoch, FSijenje, KAgot, et al. A qualitative study of secondary distribution of HIV self-test kits by female sex workers in Kenya. PLoS One. 2017;12(3):115. 10.1371/journal.pone.0174629

190 

Hvan Rooyen, OTulloch, WMukoma, TMakusha, LChepuka, LCKnight, et al. What are the constraints and opportunities for HIVST scale-up in Africa? Evidence from Kenya, Malawi and South Africa. J Int AIDS Soc [Internet]. 2015;18:19445. Available from: NS- 10.7448/IAS.18.1.19445

191 

OAOfforjebe, RMHoffman, FShaba, KBalakasi, DJDavey, MNyirenda, et al. Acceptability of index partner HIV self-testing among HIV-positive clients in Malawi: A mixed methods analysis. PLoS One [Internet]. 2020;15(7):113. Available from: 10.1371/journal.pone.0235008

192 

JJOng, DWu, WHuang, HFu, NDesmond, WMa, et al. Pressured HIV testing "in the name of love: a mixed methods analysis of pressured HIV testing among men who have sex with men in China. J Int AIDS Soc [Internet]. 2018;21(3):e25098. Available from: http://doi.wiley.com/10.1002/jia2.25098%0Ahttp://www.ncbi.nlm.nih.gov/pubmed/29577598%0Ahttp://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=PMC5867275

193 

LWei, LChen, HZhang, ZYang, SLiu, WTan, et al. Relationship between gay app use and HIV testing among men who have sex with men in Shenzhen, China: A serial cross-sectional study. BMJ Open. 2019;9(8):111. 10.1136/bmjopen-2019-028933

194 

CWei, LYan, JLi, XSu, SLippman, HYan. Which user errors matter during HIV self-testing? A qualitative participant observation study of men who have sex with men (MSM) in China. BMC Public Health. 2018;18(1):1108. 10.1186/s12889-018-6007-3

195 

CHarichund, QAKarim, PKunene, SSimelane. HIV self-testing as part of a differentiated HIV testing approach: exploring urban and rural adult experiences from KwaZulu-Natal, South Africa using a cross-over study design. BMC Public Health. 2019;19:53. 10.1186/s12889-018-6366-9

196 

EAKelvin, SCheruvillil, SChristian, JEMantell, CMilford, LRambally-Greener, et al. Choice in HIV testing: the acceptability and anticipated use of a self-administered at-home oral HIV test among South Africans. African J AIDS Res. 2016;15(2):99108. 10.2989/16085906.2016.1189442

197 

SALippman, KAKoester, KRAmico, JRLama, NMFernandes, PGonzales, et al. Client and provider perspectives on new HIV prevention tools for MSM in the Americas. PLoS One. 2015;10(3). 10.1371/journal.pone.0121044

198 

PAMuwanguzi, EMNasuuna, CPOsingada, GKSeruwagi, ENuwagira, NKiwanuka, et al. Employers’ and Employees’ Perspectives of HIV Self-Testing at Male-Dominated Work Sites and Linkage to Posttest Services in Uganda. J Assoc Nurses AIDS Care. 2020;00(00). 10.1097/JNC.0000000000000188

199 

DFConserve, DAlemu, TYamanis, SMaman, LKajula. “He Told Me to Check My Health”: A Qualitative Exploration of Social Network Influence on Men’s HIV Testing Behavior and HIV Self-Testing Willingness in Tanzania. Am J Mens Health. 2018;12(5):118596. 10.1177/1557988318777674

200 

RJDacombe, VWatson, LNyirenda, CMadanhire, MSimwinga, LChepuka, et al. Regulation of HIV self-testing in Malawi, Zambia and Zimbabwe: a qualitative study with key stakeholders. J Int AIDS Soc. 2019;22(S1):511. 10.1002/jia2.25229

201 

RJanssen, NEngel, AEsmail, SOelofse, AKrumeich, KDheda, et al. Alone But Supported: A Qualitative Study of an HIV Self-testing App in an Observational Cohort Study in South Africa. AIDS Behav [Internet]. 2020;24(2):46774. Available from: 10.1007/s10461-019-02516-6

202 

CHarichund, PKunene, MMoshabela. Feasibility of HIV self-testing: experiences of people seeking HIV testing in rural and urban KwaZulu-Natal, South Africa. African J AIDS Res. 2019;18(2):11522. 10.2989/16085906.2019.1621358

203 

MSimwinga, MKKumwenda, RJDacombe, LKayira, AMuzumara, CCJohnson, et al. Ability to understand and correctly follow HIV self-test kit instructions for use: applying the cognitive interview technique in Malawi and Zambia. J Int AIDS Soc. 2019;22(S1):128. 10.1002/jia2.25253

204 

HMaheswaran, SPetrou, PMacPherson, ATChoko, FKumwenda, DGLalloo, et al. Cost and quality of life analysis of HIV self-testing and facility-based HIV testing and counselling in Blantyre, Malawi. BMC Med [Internet]. 2016;14(1):112. Available from: 10.1186/s12916-016-0577-7

205 

RSambakunsi, MKumwenda, AChoko, ELCorbett, NADesmond. Whose failure counts? A critical reflection on definitions of failure for community health volunteers providing HIV self-testing in a community-based HIV/TB intervention study in urban Malawi. Anthropol Med [Internet]. 2015;22(3):23449. Available from: 10.1080/13648470.2015.1077202

206 

YZhao, XZhu, AEPérez, WZhang, AShi, ZZhang, et al. MHealth approach to promote Oral HIV self-testing among men who have sex with men in China: a qualitative description. BMC Public Health [Internet]. 2018;18(1):1146. Available from: https://bmcpublichealth.biomedcentral.com/articles/10.1186/s12889-018-6046-9

207 

GMartínez Pérez, SJSteele, IGovender, GArellano, AMkwamba, MHadebe, et al. Supervised oral HIV self-testing is accurate in rural KwaZulu-Natal, South Africa. Trop Med Int Heal. 2016;21(6):75967. 10.1111/tmi.12703

208 

STonen-Wolyec, MFilali, SMbop, LBelec. HIV Self-Testing In Central Africa: Stakes And Challenges. 2018;19(June):18.

209 

STonen-Wolyec, SBatina-Agasa, JDDLongo, RSMboumba Bouassa, LBélec, CZhang. Insufficient education is a key factor of incorrect interpretation of HIV self-test results by female sex workers in Democratic Republic of the Congo: A multicenter cross-sectional study. Med (United States). 2019;98(6):27. 10.1097/MD.0000000000014218

210 

WBelete, TDeressa, AFeleke, TMenna, TMoshago, SAbdella, et al. Evaluation of diagnostic performance of noninvasive HIV self-testing kit using oral fluid in Addis Ababa, Ethiopia: A facility-based cross-sectional study. PLoS One. 2019;14(1):110.

211 

NGous, AFischer, NRhagnath, MPhatsoane, MMajam, SLalla-Edward. Evaluation of a mobile application to support HIV self-testing in Johannesburg, South Africa. South Afr J HIV Med. 2020;21(1):17. 10.4102/sajhivmed.v21i1.1088

212 

JACatania, CHuun, MMDolcini, AJUrban, NFleury, CNdyetabula, et al. Overcoming cultural barriers to implementing oral HIV self-testing with high fidelity among Tanzanian youth. Transl Behav Med. 2019;(11).

213 

MABulterys, AMujugira, ANakyanzi, MNampala, GTaasi, CCelum, et al. Costs of providing HIV self-test kits to pregnant women living with HIV for secondary distribution to male partners in Uganda. Diagnostics. 2020;10(5). 10.3390/diagnostics10050318

214 

DFConserve, JIssango, AMKilale, BNjau, PNhigula, PMemiah, et al. Developing national strategies for reaching men with HIV testing services in Tanzania: Results from the male catch-up plan. BMC Health Serv Res. 2019;19(1):110. 10.1186/s12913-018-3827-x

215 

MD’elbée, MCMakhetha, MJubilee, MTaole, CNkomo, AMachinda, et al. Using HIV self-testing to increase the affordability of community-based HIV testing services. Aids. 2020;Publish Ah. 10.1097/QAD.0000000000002664

216 

GGeorge, TChetty, MStrauss, SInoti, SKinyanjui, EMwai, et al. Costing analysis of an SMS-based intervention to promote HIV self-testing amongst truckers and sex workers in Kenya. PLoS One [Internet]. 2018;13(7):116. Available from: http://www.embase.com/search/results?subaction=viewrecord&from=export&id=L622895185%0A 10.1371/journal.pone.0197305

217 

CMangenah, LMwenge, LSande, NAhmed, Md’Elbée, PChiwawa, et al. Economic cost analysis of door-to-door community-based distribution of HIV self-test kits in Malawi, Zambia and Zimbabwe. J Int AIDS Soc. 2019;22(S1):7481. 10.1002/jia2.25255

218 

BENichols, OAOfforjebe, RCele, FShaba, KBalakasi, MChivwara, et al. Economic evaluation of facility-based HIV self-testing among adult outpatients in Malawi. J Int AIDS Soc. 2020;23:e35612. 10.1002/jia2.25612

219 

VCambiano, DFord, TMabugu, SNapierala Mavedzenge, AMiners, OMugurungi, et al. Assessment of the Potential Impact and Cost-effectiveness of Self-Testing for HIV in Low-Income Countries. J Infect Dis. 2015;212(4):5707. 10.1093/infdis/jiv040

220 

VCambiano, CCJohnson, KHatzold, FTerris-Prestholt, HMaheswaran, HThirumurthy, et al. The impact and cost-effectiveness of community-based HIV self-testing in sub-Saharan Africa: a health economic and modelling analysis. J Int AIDS Soc. 2019;22(S1):8293. 10.1002/jia2.25243

221 

HMaheswaran, AClarke, PMacpherson, FKumwenda, DGLalloo, ELCorbett, et al. Cost-Effectiveness of Community-based Human Immunodeficiency Virus Self-Testing in Blantyre, Malawi. Clin Infect Dis. 2018;66(8):121121. 10.1093/cid/cix983

222 

LFJohnson, Cvan Rensburg, CGovathson, GMeyer-Rath. Optimal HIV testing strategies for South Africa: a model-based evaluation of population-level impact and cost-effectiveness. Sci Rep. 2019;9(1):112. 10.1038/s41598-018-37186-2

223 

WTang, DWu. Opportunities and challenges for HIV self-testing in China. Lancet HIV [Internet]. 2018;5(11):e6112. Available from: https://linkinghub.elsevier.com/retrieve/pii/S2352301818302443 10.1016/S2352-3018(18)30244-3

224 

HAMoore, CAMetcalf, TCassidy, DHacking, AShroufi, SJSteele, et al. Investigating the addition of oral HIV self-tests among populations with high testing coverage–Do they add value? Lessons from a study in Khayelitsha, South Africa. PLoS One. 2019;14(5):114. 10.1371/journal.pone.0215454

225 

NPhanuphak, JJantarapakde, LHimmad, TSungsing, RMeksena, SPhomthong, et al. Linkages to HIV confirmatory testing and antiretroviral therapy after online, supervised, HIV self-testing among Thai men who have sex with men and transgender women. J Int AIDS Soc. 2020;23(1):113. 10.1002/jia2.25448

226 

ALWirtz, SNaing, EClouse, KHThu, SHHMon, ZMTun, et al. The Parasol Protocol: An Implementation Science Study of HIV Continuum of Care Interventions for Gay Men and Transgender Women in Burma/Myanmar. JMIR Res Protoc [Internet]. 2017;6(5):e90. Available from: http://www.researchprotocols.org/2017/5/e90/ 10.2196/resprot.7642

227 

CEOldenburg, KFOrtblad, MMChanda, KMwanda, WNicodemus, RSikaundi, et al. Zambian Peer Educators for HIV Self-Testing (ZEST) study: Rationale and design of a cluster randomised trial of HIV self-testing among female sex workers in Zambia. BMJ Open. 2017;7(4):111. 10.1136/bmjopen-2016-014780

228 

EKProctor, BJPowell, AABaumann, AMHamilton, RLSantens. Writing implementation research grant proposals: Ten key ingredients. Implement Sci. 2012;7(1):113. 10.1186/1748-5908-7-96