not-registered Login to view full entry:

Postponing Registration (ATA Experiment 101)

ETH -17 -1457

    Basic Information

  • Abstract
    PxD is partnering with Ethiopia’s Agricultural Transformation Agency (ATA) to help improve the effectiveness of their voice-based mobile-phone advisory service, the 8028 hotline, by conducting continuous iterations and experiments, as well as by making suggestions for improvements to and customization of the service. The service has millions of registered farmers and represents the first in Africa to be maintained by a government entity at such a large scale.

    The 8028 hotline Interactive Voice Response (IVR) system uses phone key navigation. First-time callers to the 8028 hotline are prompted to register by selecting their preferred language, and their region, zone, and woreda, before accessing any content. This registration process delays access to the core informational content of the IVR system and has been found to compromise the accuracy of the registration information that is collected. Specifically, while 85% of users correctly reported their region, only 65% accurately reported their zone, and just 15% provided correct woreda information. To address this issue, we implemented an experiment in which users in the treatment group, after selecting their language, bypassed the registration process and were immediately directed to the top menu to access content. Postponing registration significantly increased the share of users accessing content, from 52% to 63%. Based on these findings, the registration step was postponed to gather profile information in a later call.
  • Status
    Completed
  • Start date
    Q4 Nov 2017
  • Experiment Location
    Ethiopia
  • Partner Organization
    Ethiopian ATA
  • Agricultural season
    _N/A
  • Research Design

  • Experiment type
    A/B test
  • Sample frame / target population
    Farmers who called to 8028 for the first time (new users)
  • Sample size
    27,686
  • Outcome type
    Information access
  • Mode of data collection
    PxD administrative data
  • Research question(s)
    Does postponing user registration in an automated hotline service increase the accessing of agricultural content by new users?
  • Research theme
    Communication technology
  • Research Design

    We randomly assigned new users who called in to the 8028 hotline service for the first time to the treatment or control group:

    • Treatment group: New users were directed straight to the menu to access agricultural content immediately after selecting their language.
    • Control group: New users were required to complete the full registration process (indicating region, zone, woreda) before accessing any agricultural content.

    We used administrative platform data to measure whether new users accessed any agricultural content and the number of topics they accessed.

    Study publication forthcoming.

  • Results

  • Results
    Removing registration on the first call has a large positive effect on whether new users access any content and on the number of topics accessed. The share of treatment group farmers who accessed any agricultural content was 11 percentage points (pp) higher than control group farmers (63% vs. 52%; p < 0.01) for a two week period from November 10 to November 22, 2017. The intervention also increased the average number of topics accessed during that time from 3.1 topics by control farmers to 3.6 topics by treatment farmers (p < 0.01).