Removing the Prompt to Save a Selected Crop to the User’s Profile (ATA Experiment 104)
ETH -17 -1459Last modified on December 19th, 2025 at 10:18 am
-
Abstract
PxD is partnering with Ethiopia’s Agricultural Transformation Agency (ATA) to help improve the effectiveness of their voice-based mobile-phone advisory service, the 8028 hotline, by conducting continuous iterations and experiments, as well as by making suggestions for improvements to and customization of the service. The service has millions of registered farmers and represents the first in Africa to be maintained by a government entity at such a large scale.
The 8028 hotline Interactive Voice Response (IVR) system uses phone key navigation. When users call the 8028 hotline, they are prompted to select a crop to hear advisory content. When users select a crop they haven’t added to their profile before, the system prompts users to save the selected crop to their profile, before the system provides advisory content. This prompt was identified as a source of both confusion for users and drop-off from the system. We tested whether removing the prompt to save the selected crop to the user’s profile improved access to content. The intervention resulted in a modest positive effect: a one percentage point (pp) increase in the share of users accessing content, which would translate to approximately 5,000 additional messages accessed per month across all the 8028 hotline users. -
Status
Completed
-
Start date
Q4 Nov 2017
-
End date
Q1 Feb 2018
-
Experiment Location
Ethiopia
-
Partner Organization
Ethiopian ATA
-
Agricultural season
_N/A
-
Experiment type
A/B test
-
Sample frame / target population
All Users of 8028 IVR system
-
Sample size
392,974
-
Outcome type
Knowledge, Information access
-
Mode of data collection
PxD administrative data
-
Research question(s)
Does removing the prompt to save the selected crop to a user’s profile improve content access?
-
Research theme
Communication technology
-
Research Design
Users of the 8028 hotline service were randomly assigned to one of two groups:
Treatment Group: Were not prompted to save their selected crop to their profile; were directed to the content menu immediately after making a selection.
Control Group: Received the standard prompt asking them to save their selected crop to their profile before proceeding to access the content.
We used administrative platform data to measure the number of content items accessed.
Study publication forthcoming.
-
Results
Not being prompted to save their selected crop to their profile led to a 1pp increase in treatment-group users accessing content, compared to control-group users (p < 0.01). On average, treatment-group users accessed 0.1 additional content items, which would translate to approximately 5,000 additional messages accessed per month across all 8028 hotline users.