# Telephone peer recruitment and interviewing during a respondent-driven sampling (RDS) survey: feasibility and field experience from the first phone-based RDS survey among men who have sex with men in Côte d'Ivoire

Maxime Inghels, Arsene Kra Kouassi, Serge Niangoran, Anne Bekelynck, Severine Carillon, Lazare Sika, Mariatou Kone, Christine Danel, Annabel

Degrees Du Lou, Joseph Larmarange

► To cite this version:

Maxime Inghels, Arsene Kra Kouassi, Serge Niangoran, Anne Bekelynck, Severine Carillon, et al. Telephone peer recruitment and interviewing during a respondent-driven sampling (RDS) survey: feasibility and field experience from the first phone-based RDS survey among men who have sex with men in Côte d'Ivoire. BMC Medical Research Methodology, 2021, 21 (1), pp.25. 10.1186/s12874-021-01208-x. [https://doi.org/10.1186/s12874-021-01208-x](https://doi.org/10.1186/s12874-021-01208-x).

HAL Id: hal-03188848

https://hal.science/hal-03188848

Submitted on 2 Apr 2021

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
<figure><img src="image_2.png" /></figure>

# Telephone peer recruitment and interviewing during a respondent-driven sampling (RDS) survey: feasibility and field experience from the first phone-based RDS survey among men who have sex with men in Côte d'Ivoire

Maxime Inghels<fnref n="1" />,<fnref n="2" />* , Arsène Kra Kouassi<fnref n="2" />,³, Serge Niangoran³, Anne Bekelynck<fnref n="2" />,³, Séverine Carillon<fnref n="2" />, Lazare Sika⁴, Mariatou Koné⁵, Christine Danel³,⁶, Annabel Desgrées du Loû<fnref n="2" />, Joseph Larmarange<fnref n="2" /> and for the research team ANRS 12323 DOD-CI

**Abstract**

**Background:** Many respondent-driven sampling (RDS) methodologies have been employed to investigate hard-to-reach populations; however, these methodologies present some limits. We describe a minimally investigated RDS methodology in which peer recruitment and interviewing are phone-based. The feasibility of the methodology, field experiences, validity of RDS assumptions and characteristics of the sample obtained are discussed.

**Methods:** We conducted a phone-based RDS survey among men who have sex with men (MSM) aged 18 or above and living in Côte d'Ivoire. Eight initial MSM across Côte d'Ivoire were selected. Participants were asked to call a hotline to be registered and interviewed by phone. After the participants completed the questionnaire, they were asked to recruit a maximum of 3 MSM from their acquaintances.

**Results:** During the 9 months of the survey, 576 individuals called the hotline, and 518 MSM completed the questionnaire. The median delay between the invitation to participate and the completion of the questionnaire by peer-recruited MSM was 4 days [IQR: 1–12]. The recruitment process was not constant, with high variation in the number of people who called the hotline during the survey period.
RDS chain convergence to equilibrium was reached within 6 waves for most of the selected variables. For the network size estimation assumption, participants who incorrectly estimated their network size were observed.

(Continued on next page)

<footnote>* Correspondence: maxime.inghels@gmail.com</footnote>

<footnote n="1">¹Lincoln International Institute for Rural Health, University of Lincoln, Brayford Pool, Lincoln, Lincolnshire LN6 7TS, UK</footnote>

<footnote n="2">²Centre Population et Développement (UMR 196 Paris Descartes – IRD), SageSud (ERL INSERM 1244), Institut de Recherche pour le Développement, Paris, France</footnote>

<footnote>Full list of author information is available at the end of the article</footnote>
(Continued from previous page)

Regarding the sample obtained, MSM were recruited from all the regions of Côte d'Ivoire with frequent interregional recruitment; 23.5% of MSM were recruited by someone who does not live in the same region. Compared to the MSM who participated in two other surveys in Côte d'Ivoire, the MSM in our sample were less likely to know about an MSM non-governmental organisation. However, MSM aged 30 years old and above and those with a low level of education were underrepresented in our sample.

**Conclusion:** We show that phone-based RDS surveys among MSM are feasible in the context of sub-Saharan Africa. Compared to other classical RDS survey methodologies, the phone-based RDS methodology seems to reduce selection bias based on geography and proximity with the MSM community. However, similar to other methodologies, phone-based RDS fails to reach older and less-educated MSM.

**Keywords:** Phone-based survey, Respondent-driven sampling, Men who have sex with men, Côte d'Ivoire

## Background

Respondent-driven sampling (RDS) is a popular methodology for biological and behavioural surveillance among hard-to-reach or hidden populations [1–4]. This methodology is particularly suitable for the investigation of small communities or those subject to discrimination (who hide their belonging to the community) [5]. Unlike other link-tracing methodologies, such as snowball sampling, RDS allows a representative sample of the targeted population to be obtained with several conditions and assumptions [6, 7]. The collection of information about the link between recruiters and recruited participants and information about the size of each participant's network during the recruitment process makes it possible to compute sample weights for each individual and adjust the variance estimation.

Two theorems are often used to justify RDS [6]. The first theorem states that as the recruitment process continues (i.e., as the number of recruitment waves increases), the cumulative proportion of an individual's characteristics in a sample will tend to stabilise around an equilibrium, regardless of the characteristics of the initially recruited subjects (i.e., also referred to as the “seeds”). The larger is the number of successive waves, the more accurate is the real population estimator, regardless of the choice of the first people recruited. The second theorem states that the group of individuals generated by RDS reaches equilibrium at a rapid (i.e., geometric) rate. According to Heckathorn, an approximation to equilibrium is theoretically expected to be reached in fewer than 6 waves with a tolerance of within 2% [6]. In practice, the equilibrium often stabilised between 5 and 10 waves, or even much later in some cases [8].

The validity of RDS estimators depends on six assumptions that were initially stated by Heckathorn [6]. Subsequent enhancements to estimators have been made to reduce the number of assumptions that need to be met [9–11]. For example, when using the Salganik-Heckathorn estimator (i.e., RDS-I), a uniform number of recruited

individuals by each participant is not needed because this estimator takes into account the variation in the recruitment differential [11]. When the size of the targeted population is known, the RDS-SS corrects the bias induced by the non-replacement sampling that is not needed [9].

Two strong assumptions remain: (i) respondents can self-report their network sizes with accuracy, and (ii) the selection of participants from the recruiter's network is random. While some authors disagree about the resistance of the RDS method to errors in the participants' reporting of their network sizes, most authors agree about the large increase in bias and variance with non-random recruitment [12–14]. In practice, validation of a random peer recruitment process is challenging. In most RDS surveys, the recruitment process requires the referred individuals to visit study centres to be interviewed; thus, most recruited individuals live in or near the cities where the study centres are based [3, 4, 15–17]. Moreover, recruited individuals tend to share common characteristics. Several studies have indicated concern regarding the representativeness of the samples obtained in RDS surveys [18, 19]. These surveys suggest that selection bias during the peer recruitment process is responsible for the over- or under-estimation of subpopulations in RDS samples.

Phone-based surveys that are conducted in the West African context are relatively recent. Mobile phone coverage has dramatically increased over the past decade in Côte d'Ivoire, and data indicate that more than 91% of households have at least one mobile phone [20]. Phone-based surveys that are conducted in this context have shown high participation rates compared to those of surveys conducted in the global North [21–23]. These surveys have also been able to reach individuals on a national scale, even though people who live in rural areas tend to be underestimated [21].

Some web-based RDS surveys have also been conducted [24–26]. In certain cases, web-based interviews were completed via phone-based interviews [19]. However, to the best of our knowledge, no RDS survey has adopted a purely phone-based approach, i.e., an
approach that consists of interviews conducted by phone and the use of a dedicated hotline for recruitment.

In this paper, we describe the lessons learned from a fully phone-based RDS survey (in which the phone is used for both recruitment and interviewing) that was conducted in Côte d'Ivoire among men who have sex with men (MSM). This subpopulation faces social stigmatisation in Côte d'Ivoire [27] and is considered hard to reach. First, we report field experiences and describe the respondent recruitment process. Second, we discuss the validity of certain assumptions and hypotheses of the RDS methodology in our study context. Third, we compare the sample obtained in our phone-based RDS survey with those obtained in two other MSM surveys that were conducted in the same context but employed a different sampling design.

## Methods

Between 25th April 2018 and 1st February 2019, we conducted a phone-based RDS survey among MSM aged 18 or above who live in Côte d'Ivoire as part of the ANRS 12323 DOD-CI research project. The utilisation of the phone in this survey was motivated by the premise that MSM often rely on phone applications to meet other MSM, as reported by local MSM non-governmental organisations (NGOs). Initially, seven seeds were selected across Côte d'Ivoire. The telephone contact information of each seed was obtained from various MSM NGOs in Côte d'Ivoire. The emphasis was placed on obtaining seeds from various regions of residences and seeds in various proximities to MSM community networks. Because of the slow recruitment process, one additional seed from a region with low recruitment (i.e., north of Côte d'Ivoire) was added in September 2018.

The seeds received a text message that invited them to participate in the survey. None of the text messages mentioned that the survey was MSM-related to avoid any unwanted disclosure of participants' sexual orientation. In the text message, a toll-free hotline number was provided for individuals who wanted to participate. Two of the three eligibility criteria (i.e., male, aged 18 or above and living in Côte d'Ivoire) were assessed for everyone who called the hotline. People who were eligible because they met two criteria were offered to be interviewed at a convenient time. During the first part of the interview, we collected non-MSM-related data (demographic characteristics and human immunodeficiency virus (HIV) testing practices) and then collected data regarding sexual behaviours. At the end of this section, the third eligibility criterion was assessed by asking participants if they had previously had sex with women only, men only or both women and men.

For the participants who reported ever having sexual intercourse with a man, MSM-related data (e.g., MSM

identity perceptions and access to MSM-related health structure) were collected. At the end of the interview, the participants were invited to refer a maximum of 3 other MSM from their acquaintances. If a participant agreed to provide referrals, a text message with a brief introduction of the study (that did not mention that the survey was MSM-related), the referral number to provide to acquaintances and the toll-free hotline number were sent to the participant for recruitment purposes. Participants were asked to call or speak with the MSM who they wanted to refer and send them the introductory text message. A financial incentive of 1500 FCFA (2.5 US dollars) was sent to the recruiting participant using a telephone cash transfer for each recruited participant who completed the questionnaire. No financial incentives were given for participation only or if the participant only referred peers who did not fully complete the questionnaire.

For participants who reported having had sex only with women during the data collection, the questionnaire ended at this section: these individuals were thanked for their participation but were not invited to recruit other participants. These individuals were then excluded from the analysis.

To avoid repeat enrolments, the phone number of every individual who called the hotline was systematically compared with the phone numbers of previous participants. The referral number that was given was also checked during the hotline call to avoid more than three referrals by participants. There was no time limit for referrals.

We initially planned to recruit between 500 MSM and 900 MSM to obtain a sample size comparable to other RDS surveys that were conducted in the subregion [3, 4, 15, 28]. Recruitment was stopped when the number of new recruits became too low to financially maintain the survey.

To allow RDS-weighted calculations, we linked the recruiter to the recruited using their referral number and asked each participant for an estimation of their MSM network size (i.e., “In total, how many men who have sex with men do you know, whether they are friends, partners, or acquaintances?”). Voltz-Heckathorn’s RDS-II estimator was applied for the analysis as it is commonly utilised in the literature and is shown to perform very well when a small sampling fraction is employed [11, 29]. The empirical likelihood interval was calculated using an estimated size of the total MSM population in Côte d’Ivoire of 29,500 individuals based on The Joint United Nations Programme on HIV and AIDS (UNAIDS) estimations [30, 31]. The seeds were kept in the analyses as the bias due to their convenience selection was considered to be negligible [9, 32]. The RDS design of the study was taken into account in the analyses using the RDS package in R [30].
The sociodemographic characteristics of the MSM included in our sample were compared with those of the MSM who participated in the Integrated Biological and Behavioural Surveillance (IBBS) study and CohMSM cohort study [33, 34].

The IBBS surveys aimed to measure HIV prevalence and sexual behaviour among specific high-risk population groups. In Côte d'Ivoire, the last IBBS survey among MSM was conducted from January 2015 to October 2015 among 1301 MSM. The study included 5 RDS surveys that were implemented in 5 Ivorian cities. Three to four seeds were employed to obtain the estimated sample size for each city. The questionnaires were completed face-to-face at a study centre, and peer recruitment was performed using coupons.

CohMSM is an open cohort of MSM who attended sexual health clinic visits with different services, including pre-exposure prophylaxis. The CohMSM study has been conducted since 2015 in four West African countries. In Côte d'Ivoire, participants were recruited mainly in Abidjan via peer educators. Baseline and follow-up visits required the participant to be present in person at the study centre. In this article, we only considered participants who were recruited in Côte d'Ivoire from 2015 to January 2020.

# Results

## Recruitment process

In total, 576 individuals called the hotline number (Table 1). Among these individuals, 39 could not be reached by phone after being registered via the hotline, 2 were not eligible (lived outside Côte d'Ivoire or were

younger than 18 years old), and 1 spoke a language that was not spoken by the investigators. Among the remaining 534 individuals, 16 reported never having had sex with a man and were thus excluded from the analysis. In total, 518 MSM were interviewed.

Once they completed the questionnaire, the MSM were invited to recruit a maximum of three other MSM; 99.4% of them accepted this offer. The latter totalised the theoretical possibility to refer a maximum of 1530 MSM of their acquaintances, of which 510 (33.1%) led to the referral of MSM who completed the questionnaire. The recruitment process was not uniform over time, with a high variation in the number of people who call the hotline per week (Fig. 1). The 8th seed that was introduced in week 21 had a minor effect on the recruitment process.

The median delay between the completion of the questionnaire by MSM and the registration of their recruited MSM was 1 day [interquartile range (IQR): 0–8]. The median time between participant registration and questionnaire completion was 1 day [IQR: 0–2]; thus, the median time between the invitation to recruit additional participants and questionnaire completion by recruited MSM was 4 days [IQR: 1–12]. The delay between recruitment and completion was more dependent on the delay in recruiting MSM rather than the delay in completing the questionnaire once MSM had registered via the hotline (Fig. 2).

Four seeds were recruited in the Abidjan region, and three seeds were recruited in the Woroba, Bas-Sassandra and Yamoussoukro regions (Fig. 3). The additional 8th

<table><caption>**Table 1** Results of telephone calls among men who have sex with men, 2018–2019</caption><thead><tr><th></th><th></th><th>n</th><th>%</th></tr></thead><tbody><tr><td></td><td><strong>Registered phone numbers</strong></td><td>576</td><td>100.0</td></tr><tr><td>EF</td><td>Respondent unable to be reached, no contact after initial registration</td><td>20</td><td>3.5</td></tr><tr><td>EF</td><td>Respondent could not be reached after appointment (questionnaire started or not)</td><td>10</td><td>1.7</td></tr><tr><td>EF</td><td>Wrong phone number given when making an appointment</td><td>9</td><td>1.6</td></tr><tr><td>OT</td><td>Language barrier with the respondent</td><td>1</td><td>0.2</td></tr><tr><td>OT</td><td>Respondent was not living in Côte d'Ivoire</td><td>1</td><td>0.2</td></tr><tr><td>OT</td><td>Respondent was younger than 18 years old</td><td>1</td><td>0.2</td></tr><tr><td></td><td><strong>Individuals interviewed</strong></td><td>534</td><td>92.6</td></tr><tr><td></td><td>–</td><td>–</td><td>–</td></tr><tr><td></td><td><strong>Individuals interviewed</strong></td><td>534</td><td>100.0</td></tr><tr><td>OT</td><td>Respondent reported never having had sex with a man</td><td>16</td><td>2.8</td></tr><tr><td>EF</td><td>Respondent discontinued questionnaire</td><td>0</td><td>0.0</td></tr><tr><td></td><td><strong>Completed questionnaires</strong></td><td>518</td><td>97.2</td></tr><tr><td></td><td>–</td><td>–</td><td>–</td></tr><tr><td></td><td><strong>Overall execution failure rate</strong>(Eligible individuals with off-target persons excluded)</td><td>–</td><td>7.0</td></tr></tbody></table>

EF Execution Failures; OT Off Target
<figure><img src="image_3.png" /><figcaption>**Fig. 1** Number of individuals registered (via the hotline) per week and per recruitment wave, 2018–2019 (n = 576). Note 1: This figure includes execution failures and non-eligible people who call the hotline. Note 2: Seven seeds were introduced in week 1, and an additional seed was introduced in week 21</figcaption></figure>

seed was recruited in the Savanes region and led only to 16 peer recruits. Three seeds led to no MSM referrals, and one seed led to only three recruited MSM. The two seeds recruited in Abidjan led to the recruitment of most of our sample (46.3 and 33.4%).

## RDS equilibrium theorems

As previously mentioned, the two RDS theorems state that equilibrium should be reached at a rapid rate [35]. For 7 of the 8 selected variables, equilibrium was reached in wave 6 (Fig. 4). For one variable (living in

<figure><img src="image_4.png" /><figcaption>**Fig. 2** Delay between participants' agreement to recruit other MSM at the end of the questionnaire and hotline registration of the recruited MSM and participants' completion of the questionnaire by the recruited MSM, 2018–2019 (n = 510). Note 1: The percentage corresponds to the cumulative proportion. Note 2: The eight seeds are excluded</figcaption></figure>
<figure><img src="image_5.png" /></figure>

Abidjan), a plateau was visible at wave 16, but the cumulative proportion was still slightly increasing over the waves.

### Participant network estimation

Regarding network size, the respondents estimated that they knew a median number of 20 MSM [IQR: 10–50] in their network. Even though it was not possible to verify whether the network size estimation was accurate, errors in participants’ estimation of the size of their networks were observed. Some participants reported inconsistent numbers of MSM in their networks (5 participants and 3 participants reported either no MSM in

their networks or fewer MSM in their networks than the number of MSM that they recruited or than the number of their male sexual partners in the last 12 months, respectively). Some participants (6.6%) reported networks of more than 100 MSM (refer to supplemental file 1).

We documented the effect of a correction that was applied to extreme values. When reducing outliers to a more realistic value (values above 100 were reduced to 100), there was a minimal effect on the estimators and their confidence intervals (refer to supplemental file 2).
<figure><img src="image_6.png" /><figcaption>**Fig. 4** Cumulative distribution of eight indicators by recruitment wave, DOD-CI study, 2018 (n = 518). Note: In this graph, the distribution is cumulative. The proportion of a variable in wave 5 is calculated based on all individuals recruited from wave 0 to wave 5 (inclusive)</figcaption></figure>

## Sample characteristics and comparison with the IBBS and CohMSM samples

Most of the MSM recruited in the present DOD-CI sample lived in Abidjan (63.1%), but MSM were recruited across all the regions of Côte d'Ivoire; however, in three of the regions, fewer than 5 MSM were recruited (Table 2). Recruitment across regions was common, as 23.5% of MSM were recruited by someone who did not live in the same region (Fig. 3). Abidjan was more represented in the DOD-CI sample than in the IBBS sample but far less represented than in the CohMSM sample, which was exclusively based in Abidjan.

Age and level of education were quite similar between the DOD-CI sample and the IBBS sample. In CohMSM, MSM were older and had higher education levels.

The percent of MSM who report being HIV-positive in the DOD-CI sample was higher than that in the IBBS sample (4.3% vs 2.0%) but lower than that in the CohMSM sample (17.9%).

Self-reported gender and sexual orientation were different across the three samples. The number of participants who reported a gender other than male was higher in the CohMSM sample (51.5%) than in the DOD-CI sample (34.9%) and IBBS (14.9%) sample. More MSM in the DOD-CI sample than in the other two samples reported being heterosexual (8.1% versus 0.9% in the IBBS sample and 4.1% in the CohMSM sample). The disclosure of sexual orientation to one family member was more frequently reported in the CohMSM study (54.5%), followed by the DOD-CI survey (41.7%, unweighted

proportion) and IBBS survey (30.2%, unweighted proportion).

In both the DOD-CI survey and IBBS survey, MSM were asked if they knew about the MSM NGO “Arc-en-ciel Plus”, which is an NGO that is represented mostly in the southeastern regions of Côte d'Ivoire, including Abidjan, and if they knew about the “Clinique Confiance”, which is a health centre dedicated to key populations, such as MSM and sex workers based in Abidjan. Although most MSM who participated in the DOD-CI survey were from Abidjan, they were less likely to report knowing about the NGO “Arc-en-ciel Plus” and “Clinique Confiance” than those in the IBBS study (19.3% versus 40.8 and 34.4% versus 56.8%, respectively; unweighted proportions).

## Discussion

To the best of our knowledge, our survey is the first phone-based RDS survey in which both recruitment and interviewing were conducted by phone in sub-Saharan Africa. Our results showed that the phone-based RDS methodology is feasible among MSM—a population that is considered hard to reach in Côte d'Ivoire because of the stigmatising environment [27]. This methodology, therefore, has the potential to be implemented with other hard-to-reach populations in the sub-Saharan context.

One important result of our study was the high cross-regional recruitment as 23.5% of the MSM included in our sample were recruited by someone who did not live in the same region. RDS chain convergence to
<table><caption>**Table 2** Description of characteristics reported by MSM from the DOD-CI (2018), IBBS (2015) and CohMSM (2018) study samples, Côte d'Ivoire</caption><thead><tr><th rowspan="3"></th><th colspan="3">DOD-CI (n = 518)</th><th colspan="3">IBBS (n = 1301)</th><th colspan="2">CohMSM (n = 274)</th></tr><tr><th colspan="2">unweighted</th><th>RDS-weighted</th><th colspan="2">unweighted</th><th>RDS-weighted</th><th rowspan="2">n</th><th rowspan="2">%</th></tr><tr><th>n</th><th>%</th><th>%</th><th>n</th><th>%</th><th>%</th></tr></thead><tbody><tr><td><strong>Age</strong></td><td></td><td></td><td></td><td></td><td></td><td></td><td>NA = 18</td><td></td></tr><tr><td>&lt; 20</td><td>49</td><td><strong>9.5</strong></td><td><strong>14.3</strong></td><td>154</td><td><strong>11.8</strong></td><td><strong>14.8</strong></td><td>21</td><td><strong>8.2</strong></td></tr><tr><td>20-24</td><td>228</td><td><strong>44.0</strong></td><td><strong>47.1</strong></td><td>639</td><td><strong>49.1</strong></td><td><strong>50.4</strong></td><td>111</td><td><strong>43.4</strong></td></tr><tr><td>25-29</td><td>169</td><td><strong>32.6</strong></td><td><strong>35.9</strong></td><td>374</td><td><strong>28.8</strong></td><td><strong>27.2</strong></td><td>80</td><td><strong>31.3</strong></td></tr><tr><td>&gt; =30</td><td>72</td><td><strong>13.9</strong></td><td><strong>2.7</strong></td><td>134</td><td><strong>10.3</strong></td><td><strong>7.6</strong></td><td>44</td><td><strong>17.2</strong></td></tr><tr><td><strong>Level of education</strong></td><td></td><td></td><td></td><td></td><td></td><td></td><td>NA = 18</td><td></td></tr><tr><td>Primary/none</td><td>38</td><td><strong>7.4</strong></td><td><strong>5.6</strong></td><td>138</td><td><strong>10.6</strong></td><td><strong>8.7</strong></td><td>26</td><td><strong>10.2</strong></td></tr><tr><td>Secondary</td><td>289</td><td><strong>55.8</strong></td><td><strong>66.1</strong></td><td>810</td><td><strong>62.3</strong></td><td><strong>69.0</strong></td><td>104</td><td><strong>40.6</strong></td></tr><tr><td>Tertiary</td><td>191</td><td><strong>36.9</strong></td><td><strong>28.3</strong></td><td>353</td><td><strong>27.1</strong></td><td><strong>22.4</strong></td><td>126</td><td><strong>49.2</strong></td></tr><tr><td><strong>Self-reported gender</strong></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>Man</td><td>322</td><td><strong>62.2</strong></td><td><strong>65.1</strong></td><td>962</td><td><strong>73.9</strong></td><td><strong>85.1</strong></td><td>133</td><td><strong>48.5</strong></td></tr><tr><td>Woman</td><td>130</td><td><strong>25.1</strong></td><td><strong>22.2</strong></td><td>339<sup>a</sup></td><td><strong>26.0<sup>a</sup></strong></td><td><strong>14.9<sup>a</sup></strong></td><td>48</td><td><strong>17.5</strong></td></tr><tr><td>Transgender</td><td>66</td><td><strong>12.7</strong></td><td><strong>12.7</strong></td><td></td><td></td><td></td><td>–</td><td>–</td></tr><tr><td>Both man and woman</td><td>–</td><td>–</td><td>–</td><td>–</td><td>–</td><td>–</td><td>93</td><td><strong>33.9</strong></td></tr><tr><td><strong>Sexual orientation</strong></td><td></td><td></td><td></td><td></td><td></td><td></td><td>NA = 3</td><td></td></tr><tr><td>Homosexual</td><td>245</td><td><strong>47.3</strong></td><td><strong>42.1</strong></td><td>499</td><td><strong>38.4</strong></td><td><strong>35.1</strong></td><td>115</td><td><strong>42.4</strong></td></tr><tr><td>Bisexual</td><td>251</td><td><strong>48.5</strong></td><td><strong>49.8</strong></td><td>775</td><td><strong>59.6</strong></td><td><strong>64.0</strong></td><td>145</td><td><strong>53.5</strong></td></tr><tr><td>Heterosexual</td><td>22</td><td><strong>4.2</strong></td><td><strong>8.1</strong></td><td>27</td><td><strong>2.1</strong></td><td><strong>0.9</strong></td><td>11</td><td><strong>4.1</strong></td></tr><tr><td><strong>Reported HIV status</strong></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>Never tested</td><td>41</td><td><strong>7.9</strong></td><td><strong>11.1</strong></td><td>259</td><td><strong>19.9</strong></td><td><strong>29.1</strong></td><td>0</td><td><strong>0.0</strong></td></tr><tr><td>Negative (≤12 months)</td><td>345</td><td><strong>66.6</strong></td><td><strong>60.4</strong></td><td>656</td><td><strong>50.4</strong></td><td><strong>42.8</strong></td><td>224<sup>b</sup></td><td><strong>81.8<sup>b</sup></strong></td></tr><tr><td>Negative (&gt; 12 months)</td><td>73</td><td><strong>14.1</strong></td><td><strong>17.1</strong></td><td>332</td><td><strong>25.5</strong></td><td><strong>26.1</strong></td><td></td><td></td></tr><tr><td>Positive</td><td>34</td><td><strong>6.6</strong></td><td><strong>4.3</strong></td><td>54</td><td><strong>4.2</strong></td><td><strong>2.0</strong></td><td>49</td><td><strong>17.9</strong></td></tr><tr><td>Do not know</td><td>25</td><td><strong>4.8</strong></td><td><strong>7.8</strong></td><td>–</td><td>–</td><td>–</td><td>1</td><td><strong>0.4</strong></td></tr><tr><td><strong>Disclosure of sexual orientation to one family member</strong></td><td></td><td></td><td></td><td></td><td></td><td></td><td>NA = 17</td><td></td></tr><tr><td>Yes</td><td>216</td><td><strong>41.7</strong></td><td><strong>29.9</strong></td><td>393</td><td><strong>30.2</strong></td><td>DNA</td><td>140</td><td><strong>54.5</strong></td></tr><tr><td>No</td><td>302</td><td><strong>58.3</strong></td><td><strong>70.1</strong></td><td>908</td><td><strong>69.8</strong></td><td>DNA</td><td>117</td><td><strong>45.5</strong></td></tr><tr><td><strong>Knowledge of the MSM NGO "Arc-en-ciel Plus"</strong></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>Yes</td><td>100</td><td><strong>19.3</strong></td><td><strong>10.1</strong></td><td>531</td><td><strong>40.8</strong></td><td>DNA</td><td>–</td><td>–</td></tr><tr><td>No</td><td>418</td><td><strong>80.7</strong></td><td><strong>89.9</strong></td><td>770</td><td><strong>59.2</strong></td><td>DNA</td><td>–</td><td>–</td></tr><tr><td><strong>Knowledge of the "Clinique Confiance"</strong></td><td></td><td></td><td></td><td>NA = 200</td><td></td><td></td><td></td><td></td></tr><tr><td>Yes</td><td>178</td><td><strong>34.4</strong></td><td><strong>20.7</strong></td><td>645</td><td><strong>58.6</strong></td><td>DNA</td><td>–</td><td>–</td></tr><tr><td>No</td><td>340</td><td><strong>65.6</strong></td><td><strong>79.3</strong></td><td>456</td><td><strong>41.4</strong></td><td>DNA</td><td>–</td><td>–</td></tr><tr><td><strong>Region of residence</strong></td><td></td><td></td><td></td><td></td><td></td><td></td><td>NA = 17</td><td></td></tr><tr><td>Abidjan</td><td>327</td><td><strong>63.1</strong></td><td><strong>58.3</strong></td><td>351</td><td><strong>27.0</strong></td><td><strong>10.9</strong></td><td>249</td><td><strong>96.9</strong></td></tr><tr><td>Yamoussoukro</td><td>15</td><td><strong>2.9</strong></td><td><strong>3.7</strong></td><td>250</td><td><strong>19.2</strong></td><td><strong>18.4</strong></td><td>–</td><td>–</td></tr><tr><td>Agboville (Lagunes)</td><td>11</td><td><strong>2.1</strong></td><td><strong>1.2</strong></td><td>200</td><td><strong>15.4</strong></td><td><strong>18.2</strong></td><td>–</td><td>–</td></tr><tr><td>Bouaké (Bandama)</td><td>17</td><td><strong>3.3</strong></td><td><strong>5.5</strong></td><td>350</td><td><strong>26.9</strong></td><td><strong>35.0</strong></td><td>–</td><td>–</td></tr><tr><td>Gagnoa (Gôh-Djiboua)</td><td>26</td><td><strong>5.0</strong></td><td><strong>7.8</strong></td><td>150</td><td><strong>11.5</strong></td><td><strong>17.5</strong></td><td>–</td><td>–</td></tr><tr><td>Other regions</td><td>122</td><td><strong>23.6</strong></td><td><strong>23.5</strong></td><td>–</td><td>–</td><td>–</td><td>8</td><td><strong>3.1</strong></td></tr></tbody></table>

MSM Men who have sex with men; NGO Non-governmental organisation; DNA Data not available

<footnote>aFor the IBBS survey, woman and transgender were grouped</footnote>

<footnote>bFor the CohMSM study, participants were only asked if they had a negative test</footnote>
equilibrium requires characteristics mixing of sufficient participants, which is rarely met for the region of residence in traditional in-person RDS as chains rarely cross regions in these studies [15, 28, 33]. Therefore, these studies implement separate RDS surveys in each region that is considered, and the results are often aggregated into a pooled estimate. Phone-based RDS could then lead to a better regional representation of the distribution of MSM in the study by facilitating the recruitment of MSM who live far from cities where traditional in-person RDS surveys are conducted.

The use of phone-based peer recruitment and questionnaire interviewing provided significant advantages during the peer recruitment process for both participants and investigators. First, participants could choose the day and time of their interview and did not need to travel, which saved time and transport costs compared to RDS methodologies that require face-to-face interviews. Second, the determination of the eligibility of participants was more convenient and avoided the tasks associated with the management of non-eligible people who visit a study centre, as reported in one survey [36]. Third, the methodology facilitated peer recruitment since only a text message was needed. It was also possible to send reminder text messages for participants who agreed to recruit MSM from their networks and who had not yet recruited new participants—a strategy we applied during the weeks with low recruitment, which led to several additional participants in the survey. Coupon loss was also avoided since it was possible to send the referral code to a participant who had lost it. Phone-based RDS avoided potential breaches of anonymity. As participants were not required to be present in person for the interview, unwanted disclosure of sexual orientation was limited as participants could not be seen or recognised by visiting a survey centre.

Despite these advantages, participant recruitment was relatively slow compared to that in the IBBS survey. In 10 months and starting from 13 seeds, the IBBS survey included more than 1301 MSM; in our survey, in 9 months and starting from 8 seeds, we included only 518 MSM. There are two possible explanations for these differences. First, our survey was conducted after several other surveys were conducted in the same community, which may have caused "study fatigue" and decreased interest in participating. Second, prior to the implementation of their survey, researchers of the IBBS organised several gathering events in the different cities where the survey was being conducted, which may have sensitised MSM to participate in the survey. Researchers who perform RDS surveys (phone-based or otherwise) in the future should consider advertising surveys among the MSM networks to hasten the recruitment process. Nevertheless, the characteristics of our recruitment

process (i.e., total number of individuals recruited, number of seeds and data collection duration) remained comparable to those of other RDS surveys that were implemented in the West African context [4]. Another significant disadvantage of the phone-based RDS was the inability to collect biological data, which renders this methodology less adapted for disease-related surveillance.

Our results showed that the phone-based RDS methodology seems to satisfy the rapid convergence of RDS chains to equilibrium but still has some limitations regarding the validation of some of the hypotheses, similar to other traditional RDS methodologies.

Consistent with the RDS theorems, equilibrium was reached for most of the variables explored in our survey. With phone-based RDS, similar to other classical RDS methodologies that are based on face-to-face interviews, equilibrium tended to be reached rapidly [8, 17].

The assumption of a random peer recruitment process is a strong hypothesis that is assumed in most RDS surveys but rarely validated [12–14]. By using a phone-based approach, we were likely able to reduce the geographical bias that was induced by in-person referral. However, in the absence of a national reference (population census does not include data on sexual orientation), it is not possible to measure this effect.

Similar to other RDS methodologies and MSM surveys, with our approach, we encountered difficulties reaching older and less educated MSM [3, 15, 16].

Inaccuracy in the estimation of personal network size may be responsible for substantial biases in the estimates [1, 13]. In our survey, some participants reported a very high number of MSM in their networks (above 100), but this finding had a negligible impact on the RDS estimators. It was not possible to assess the accuracy of participants' network sizes for participants with small networks, which could have led to important biases [13].

In terms of sociodemographic characteristics, the sample that was obtained using phone-based RDS was quite similar to the sample of a previous face-to-face RDS survey and a previously investigated MSM cohort. Some differences were observed, including the proximity to MSM communities and the region of residence. Participants in our sample were also less likely to know about one of the largest Ivorian MSM NGOs, which suggests that phone recruitment could potentially reach MSM who are less engaged in the MSM community. Although our sample was mainly concentrated in Abidjan, a large part of the sample was recruited in other regions of Côte d'Ivoire.

Similar to other surveys that were conducted among MSM in sub-Saharan African countries, our sample was mainly composed of young and educated MSM [15, 16, 25]. Thus, even with a phone-based methodology, which is supposed to reduce selection bias, older and less-
educated MSM continue to be underestimated in RDS
surveys [15].

Several surveys have investigated the effects of web-
based or application (app)-based RDS methodologies on
the recruitment process and the characteristics of re-
cruited participants. These studies showed that web-
based RDS allowed a faster peer recruitment process
than traditional RDS but tended to reach different types
of participants [24, 26, 37, 38]. Individuals that were re-
cruited via web-based RDS tend to have a higher socio-
economic status, especially a higher education level, than
those recruited via off-line RDS methodologies [24, 37,
38]. Proximity to MSM communities varied according to
the survey, with one survey showing fewer gay-identified
MSM among those recruited via web-based methodolo-
gies in Canada and another survey showing more MSM
who identify themselves as homosexual and having sex
only with men in China [38, 39]. To our knowledge, no
web- or app-based RDS has been implemented in sub-
Saharan Africa. In this specific context, we believe that
these web-based approaches would tend to induce selec-
tion bias since internet access (and thus possession of an
email address and access to web applications) remains
inequal in African countries [40]. Phone-based RDS
could be a more appropriate alternative solution in the
context of poor internet access.

RDS methodologies that require the presence of par-
ticipants continue to be broadly utilised in epidemio-
logical surveillance. Unlike web and phone-based RDS,
these methodologies allow the collection of biological
data (e.g., blood sample for HIV test). On the other
hand, phone-based surveys are usually well adapted to
the collection of data on sexual behaviours: several sur-
veys in France and Côte d'Ivoire have shown that people
are quite comfortable answering sexuality-related ques-
tions by phone [21, 22, 41]. In addition, in our survey,
the percentage of people who self-report being HIV-
positive was higher than that in the IBBS survey, which
suggests a higher acceptance of discussing stigmatising
subjects, such as HIV status, by phone in this context.

Conclusion

We showed that phone-based RDS surveys among MSM
are feasible in the context of sub-Saharan Africa, as they
have the ability to reach MSM from different geograph-
ical regions and some individuals located far from MSM
communities and to collect sensitive data, such as data
on sexual behaviours. Compared to face-to-face RDS
surveys, phone-based RDS surveys still present chal-
lenges in reaching older and less-educated MSM.

Phone-based RDS may be a suitable alternative for be-
havioural surveillance that does not require the collec-
tion of biological data from participants.

**Supplementary Information**

The online version contains supplementary material available at https://doi.org/10.1186/s12874-021-01208-x.

**Additional file 1.** MSM network size reported by recruitment wave.

**Additional file 2.** Distribution by age, education level and reported sexual orientation with and without outlier correction (for values above 100) of the MSM network size.

Abbreviations

DNA: Data not available; IBBS: Integrated biological and behavioural surveillance; MSM: Men with have sex with men; NGO: Non-governmental organisation; RDS: Respondent-driven sampling; UNAIDS: Joint United Nations programme on HIV/AIDS

Acknowledgements

We thank the participants of the survey as well as the implementing partners and other stakeholders who supported the deployment of the survey. We also thank the IBBS and CohMSM research teams for their help by sharing data with us as needed.

Authors' contributions

MI, conceptualisation, data curation, formal analysis, methodology, validation, visualisation, writing of the original draft and review and editing of the final draft; AKK and SN, data curation, formal analysis and project administration; AB and SC, conceptualisation, methodology, project administration, review and editing of the final draft; LS, CD, MK, ADDL, and JL, conceptualisation, methodology, review and editing of the final draft. All authors have read and approved the manuscript.

Funding

The study was funded by the France Recherche Nord & Sud Sida-HIV Hépatites (http://www.anrs.fr, grant number: ANRS 12,323). MI received a grant from the association SIDACTION as part of his PhD work. The funders had no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Availability of data and materials

The datasets that were analysed during this are not publicly available as they are the property of the DOD-CI project. Data are, however, available from the authors upon reasonable request and with permission of one of the principal investigators.

Ethics approval and consent to participate

The ANRS 12323 DOD-CI project was approved by the Ethics Council of Côte d'Ivoire (ref: 058/MSHP/CNER-kp) in accordance with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. Oral consent, which was approved by the Ethics Council of Côte d'Ivoire, was obtained from all participants prior to starting the interview.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Author details

¹Lincoln International Institute for Rural Health, University of Lincoln, Brayford Pool, Lincoln, Lincolnshire LN6 7TS, UK. ²Centre Population et Développement (UMR 196 Paris Descartes - IRD), SageSud (ERL INSERM 1244), Institut de Recherche pour le Développement, Paris, France.

³Programme PAC-CI/ANRS, Centre Hospitalier Universitaire de Treichville, Abidjan, Côte d'Ivoire. ⁴École Nationale Supérieure de Statistique et d'Economie Appliquée (ENSEA), Abidjan, Côte d'Ivoire. ⁵Institut d'Ethno-Sociologie (IES), Abidjan, Côte d'Ivoire. ⁶Centre Inserm 1219, Université de Bordeaux, Bordeaux, France.
Received: 29 October 2020 Accepted: 13 January 2021

Published online: 05 February 2021

## References

1. Johnston LG, Malekinejad M, Kendall C, Iuppa IM, Rutherford GW. Implementation challenges to using respondent-driven sampling methodology for HIV biological and behavioral surveillance: field experiences in international settings. AIDS Behav. 2008;12(4 Suppl):S131-41.

2. Malekinejad M, Johnston LG, Kendall C, Kerr LRFS, Rifkin MR, Rutherford GW. Using respondent-driven sampling methodology for HIV biological and behavioral surveillance in international settings: a systematic review. AIDS Behav. 2008;12(4 Suppl):S105-30.

3. Hakim AJ, Aho J, Semde G, Diarrassouba M, Ehoussou K, Vuylsteke B, et al. The epidemiology of HIV and prevention needs of men who have sex with men in Abidjan, Côte d'Ivoire. PLoS One. 2015;10(4).

4. Stahlman S, Liestman B, Ketende S, Kouanda S, Ky-Zerbo O, Lougue M, et al. Characterizing the HIV risks and potential pathways to HIV infection among transgender women in Côte d'Ivoire, Togo and Burkina Faso. J Int AIDS Soc. 2016;19(3 Suppl 2):20774.

5. Sudman S, Kalton G. New developments in the Sampling of special populations. Annu Rev Sociol. 1986;12(1):401-29.

6. Heckathorn DD. Respondent-Driven Sampling: a new approach to the study of hidden populations. Soc Probl. 1997;44(2):174-99.

7. Heckathorn DD. Snowball versus respondent-driven sampling. Sociol Methodol. 2011;41(1):355-66.

8. Wirtz AL, Mehta SH, Latkin C, Zelaya CE, Galai N, Peryshkina A, Mogilnyi V, Dzhigun P, Kostetskaya I, Beyrer C. Comparison of respondent driven sampling estimators to determine HIV prevalence and population characteristics among men who have sex with men in Moscow, Russia. PLoS One. 2016;11(6):e0155519. https://doi.org/10.1371/journal.pone.0155519.

9. Gile KJ. Improved inference for Respondent-Driven Sampling data with application to HIV prevalence estimation. J Am Stat Assoc. 2011;106(493): 135-46.

10. Goel S, Salganik MJ. Respondent-driven sampling as markov chain Monte Carlo. Stat Med. 2009;28(17):2202-29.

11. Heckathorn DD. Extensions of Respondent-Driven Sampling: analyzing continuous variables and controlling for differential recruitment. Sociol Methodol. 2007;37(1):151-207.

12. Lu X, Bengtsson L, Britton T, Camitz M, Kim BJ, Thorson A, et al. The sensitivity of respondent-driven sampling: Respondent-driven Sampling. J R Stat Soc Ser A Stat Soc. 2012;175(1):191-216.

13. Mills HL, Johnson S, Hickman M, Jones NS, Colijn C. Errors in reported degrees and respondent driven sampling: implications for bias. Drug Alcohol Depend. 2014;142:120-6.

14. Gile KJ, Handcock MS. Respondent-Driven Sampling: an assessment of current methodology. Sociol Methodol. 2010;40(1):285-327.

15. Larmarange J, Wade AS, Diop AK, et al. Men who have sex with men (MSM) and factors associated with not using a condom at last sexual intercourse with a man and with a woman in Senegal. Plos one. 2010;5(10). https://doi.org/10.1371/journal.pone.0013189.

16. Stahlman S, Johnston LG, Yah C, Ketende S, Maziya S, Trapence G, et al. Respondent-Driven Sampling as a recruitment method for men who have sex with men in southern sub-Saharan Africa: a cross-sectional analysis by wave. Sex Transm Infect. 2016;92(4):292-8.

17. Abdul-Quader AS, Heckathorn DD, McKnight C, Bramson H, Nemeth C, Sabin K, et al. Effectiveness of Respondent-Driven Sampling for recruiting drug users in new York City: findings from a pilot study. J Urban Health Bull N Y Acad Med. 2006;83(3):459-76.

18. McCreech N, Frost S, Seeley J, Katongole J, Tarsh MN, Ndunguse R, et al. Evaluation of Respondent-Driven Sampling. Epidemiol Camb Mass. 2012; 23(1):138-47.

19. Ngwakongnwi E, King-Shier KM, Hemmelgarn BR, Musto R, Quan H. Comparison of sampling methods for hard-to-reach francophone populations: yield and adequacy of advertisement and respondent-driven sampling. Open Med. 2014;8(4):e120-9.

20. Ministère de la Santé et de la Lutte contre le Sida [Côte d'Ivoire], Institut National de la Statistique (INS), MEASURE DHS. Enquête Démographique et de Santé et à Indicateurs Multiples (EDS-MICS) 2016. Calverton: INS & ORC Macro; 2017. p. 395.

21. Larmarange J, Kassoum O, Kakou É, Fradier Y, Sika L, Danel C. Faisabilité et représentativité d'une enquête téléphonique avec échantillonnage aléatoire de lignes mobiles en Côte d'Ivoire. Population. 2016;71(1):121-34.

22. Inghels M, Kouassi AK, Niangoran S, Bekelynck A, Carillon S, Sika L, et al. Cascade of provider-initiated human immunodeficiency virus testing and counselling at specific life events (pregnancy, sexually transmitted infections, marriage) in Côte d'Ivoire. Sex Transm Dis. 2020;47(1):54-61.

23. Inghels M, Kouassi AK, Niangoran S, Bekelynck A, Carillon S, Sika L, et al. Practices and obstacles to provider-initiated HIV testing and counseling (PITC) among healthcare providers in Côte d'Ivoire. AIDS Behav. 2020;24(9): 3491-500.

24. Bauermeister JA, Zimmerman MA, Johns MM, Glowacki P, Stoddard S, Volz E. Innovative recruitment using online networks: lessons learned from an online study of alcohol and other drug use utilizing a web-based, Respondent-Driven Sampling (webRDS) strategy. J Stud Alcohol Drugs. 2012;73(5):834-8.

25. Bengtsson L, Lu X, Nguyen QC, et al. Implementation of web-based respondent-driven sampling among men who have sex with men in Vietnam. Plos one. 2012;7(11):e49417. https://doi.org/10.1371/journal.pone.0049417.

26. Hildebrand J, Burns S, Zhao Y, et al. Potential and challenges in collecting social and behavioral data on adolescent alcohol norms: comparing respondent-driven sampling and web-based respondent-driven sampling. J Med Internet Res. 2015;17(12):e285. https://doi.org/10.2196/jmir.4762. Published 2015 Dec 24.

27. Aho J, Hakim A, Vuylsteke B, Semde G, Gbais HG, Diarrassouba M, et al. Exploring risk behaviors and vulnerability for HIV among men who have sex with men in Abidjan, côte d'Ivoire: poor knowledge, homophobia, sexual violence. Plos One. 2014;9(6):e99591.

28. Vu L, Andrinopoulos K, Tun W, Adebajo S. High levels of unprotected anal intercourse and never testing for HIV among men who have sex with men in Nigeria: evidence from a cross-sectional survey for the need for innovative approaches to HIV prevention. Sex Transm Infect. 2013;89(8):659-65.

29. Abdesselam K, Verdery A, Pelude L, Dhami P, Momoli F, Jolly AM. The development of respondent-driven sampling (RDS) inference: a systematic review of the population mean and variance estimates. Drug Alcohol Depend. 2020;206:107702.

30. Handcock MS, Gile KJ, Fellows IE, Neely WW. RDS: Respondent-Driven Sampling [Internet]. 2017 [Cited 8 Feb 2019]. Available on: https://CRAN.R-project.org/package=RDS

31. UNAIDS. Key population atlas. UNaids - key population website. Available on: https://kpatlas.unaids.org/dashboard. [cited 20 nov 2018].

32. Wejnert C. An empirical test of respondent-driven sampling: point estimates, variance, degree measures, and out-of-equilibrium data. Sociol Methodol. 2009;39(1):73-116.

33. Ministère de la Santé et de la Lutte contre le Sida [Côte d'Ivoire]. Etude biologique et comportementale des IST, du VIH et du sida chez les Hommes ayant des rapports Sexuels avec des Hommes des villes d'Abidjan, Agboville, Bouaké, Gagnoa, et Yamoussoukro. Abidjan: Ministère de la santé; 2016.

34. Coulaud P-J, Sagaon-Teyssier L, M'madi Mrenda B, Maradan G, Mora M, Bourrelly M, et al. Interest in HIV pre-exposure prophylaxis in men who have sex with men in West Africa (CohMSM ANRS 12324 - expertise France). Trop Med Int Health TM IH. 2018;23(10):1084-91.

35. Gile KJ, Johnston LG, Salganik MJ. Diagnostics for respondent-driven sampling. J R Stat Soc Ser A Stat Soc. 2015;178(1):241-69.

36. Okal J, Raymond HF, Tun W, et al. Lessons learned from respondent-driven sampling recruitment in Nairobi: experiences from the field. BMC Res Notes. 2016;9:158. https://doi.org/10.1186/s13104-016-1965-y. Published 2016 Mar 11.

37. Burrell E, Pines H, Robbie E, Colman L, Murphy R, Hess K, et al. Use of the location-based social networking application GRINDR as a recruitment tool in rectal microbicide development research. AIDS Behav. 2012;16(7):1816-20.

38. Zhang D, Bi P, Lv F, Zhang J, Hiller JE. Differences between Internet and community samples of MSM: implications for behavioral surveillance among MSM in China. AIDS Care. 2008;20(9):1128-37.

39. Lachowsky NJ, Lal A, Forrest JI, et al. Including online-recruited seeds: a respondent-driven sample of men who have sex with men. J Med Internet Res. 2016;18(3):e51. https://doi.org/10.2196/jmir.5258. Published 2016 Mar 15.
40. The Telecommunication Development Sector. Percentage of Individuals using the Internet [Internet]. ITU Statistics. 2017 [Cited Mai 2020]. Available on: https://www.itu.int/en/ITU-D/Statistics/Pages/stat/default.aspx

41. Bajos N, Bozon M. Enquête sur la sexualité en France. Paris: La Découverte; 2008. p. 609. Available on: https://www.cairn.info/enquete-sur-la-sexualite-en-france--9782707154293.htm

**Publisher’s Note**

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Ready to submit your research? Choose BMC and benefit from:

* fast, convenient online submission

* thorough peer review by experienced researchers in your field

* rapid publication on acceptance

* support for research data, including large and complex data types

* gold Open Access which fosters wider collaboration and increased citations

* maximum visibility for your research: over 100M website views per year

At BMC, research is always in progress.

Learn more biomedcentral.com/submissions