Registration Survey Redesign
KEN -19 -1447Last modified on December 19th, 2025 at 10:17 am
-
Abstract
PxD operates the MoA-INFO platform in collaboration with Kenya’s Ministry of Agriculture to provide free agricultural recommendations to farmers via SMS messages. In February 2019, the MoA-INFO platform was undergoing various expansions that required a redesign of the registration survey. First, the content on the platform was increased from a single-crop maize service to include two additional crops. Second, the customization of content was improved by targeting message content and timing with the farmer’s location information. Third, Safaricom (a large Kenyan phone company) planned to deliver the third nationwide blast campaign, which was expected to more than double the number of platform users. In the redesign process, we considered ways to optimize the new registration survey.
The first consideration was whether to start the survey by asking the user’s first name. The potential benefit is that users who answer the question may feel trust in the platform when it subsequently refers to them by name. The potential downsides are that adding an extra message to the registration may decrease completion rates, and that the name question might make some users feel less inclined to complete the survey due to reservations about sharing personal information. The second consideration was whether to include questions asking if users farm potatoes and beans in addition to a question about maize. The potential benefit is that this information allows targeting of subsequent messages. The downside is that it adds two additional questions about potato and bean farming to the survey.
After experimentally testing these variations, we find that asking users their first names increased the rates of both response to the first question and survey completion. However, asking whether users grow potatoes and beans decreased the registration survey completion rate. -
Status
Completed
-
Start date
Q1 Jan 2019
-
End date
Q1 Feb 2019
-
Experiment Location
Kenya
-
Partner Organization
Kenya Ministry of Agriculture
-
Agricultural season
Long Rains
-
Experiment type
A/B test
-
Sample frame / target population
MoA-INFO newly registered farmers
-
Sample size
954
-
Outcome type
Service engagement
-
Mode of data collection
PxD administrative data
-
Research question(s)
1. What is the effect on registration completion of asking for each user’s first name?
2. What is the effect on registration completion of asking users whether they grow each crop that is available on the platform? -
Research theme
Communication technology, Service design
-
Research Design
The sample consisted of new farmers who registered on the MoA-INFO platform following referrals by existing MoA-INFO users (see Methods of Inviting Farmers to Refer Fellow Farmers). Each newly registered farmer was randomly assigned to a treatment group. In one group, farmers were asked their name at the beginning of the registration survey, and in another group, farmers were asked whether they farm potatoes and beans, in addition to all farmers being asked whether they farm maize.
The main outcome of interest is the number of farmers who successfully completed the registration survey within 24 hours. This indicates whether users have actively completed the registration instead of simply auto-progressing through the survey.
This experiment builds on previous trials, which found that improved invitation messages could increase registration completion rates. For more information, see: Improving Invitation Messaging to Increase Registration Rates.
-
Results
Asking users their names increased response rates to the first question by 7 percentage points (pp) and increased the registration survey completion rate by 2 pp. Additionally, asking whether users grow potatoes and beans decreased the survey completion rate by 7 pp over a 64% comparison mean.