Postponing Registration (ATA Experiment 101)
ETH -17 -1457Last modified on December 19th, 2025 at 10:17 am
-
Abstract
PxD is partnering with Ethiopia’s Agricultural Transformation Agency (ATA) to help improve the effectiveness of their voice-based mobile-phone advisory service, the 8028 hotline, by conducting continuous iterations and experiments, as well as by making suggestions for improvements to and customization of the service. The service has millions of registered farmers and represents the first in Africa to be maintained by a government entity at such a large scale.
The 8028 hotline Interactive Voice Response (IVR) system uses phone key navigation. First-time callers to the 8028 hotline are prompted to register by selecting their preferred language, and their region, zone, and woreda, before accessing any content. This registration process delays access to the core informational content of the IVR system and has been found to compromise the accuracy of the registration information that is collected. Specifically, while 85% of users correctly reported their region, only 65% accurately reported their zone, and just 15% provided correct woreda information. To address this issue, we implemented an experiment in which users in the treatment group, after selecting their language, bypassed the registration process and were immediately directed to the top menu to access content. Postponing registration significantly increased the share of users accessing content, from 52% to 63%. Based on these findings, the registration step was postponed to gather profile information in a later call. -
Status
Completed
-
Start date
Q4 Nov 2017
-
Experiment Location
Ethiopia
-
Partner Organization
Ethiopian ATA
-
Agricultural season
_N/A
-
Experiment type
A/B test
-
Sample frame / target population
Farmers who called to 8028 for the first time (new users)
-
Sample size
27,686
-
Outcome type
Information access
-
Mode of data collection
PxD administrative data
-
Research question(s)
Does postponing user registration in an automated hotline service increase the accessing of agricultural content by new users?
-
Research theme
Communication technology
-
Research Design
We randomly assigned new users who called in to the 8028 hotline service for the first time to the treatment or control group:
- Treatment group: New users were directed straight to the menu to access agricultural content immediately after selecting their language.
- Control group: New users were required to complete the full registration process (indicating region, zone, woreda) before accessing any agricultural content.
We used administrative platform data to measure whether new users accessed any agricultural content and the number of topics they accessed.
Study publication forthcoming.
-
Results
Removing registration on the first call has a large positive effect on whether new users access any content and on the number of topics accessed. The share of treatment group farmers who accessed any agricultural content was 11 percentage points (pp) higher than control group farmers (63% vs. 52%; p < 0.01) for a two week period from November 10 to November 22, 2017. The intervention also increased the average number of topics accessed during that time from 3.1 topics by control farmers to 3.6 topics by treatment farmers (p < 0.01).