not-registered Login to view full entry:

Removing the Prompt to Save a Selected Crop to the User’s Profile (ATA Experiment 104)

ETH -17 -1459

    Basic Information

  • Abstract
    PxD is partnering with Ethiopia’s Agricultural Transformation Agency (ATA) to help improve the effectiveness of their voice-based mobile-phone advisory service, the 8028 hotline, by conducting continuous iterations and experiments, as well as by making suggestions for improvements to and customization of the service. The service has millions of registered farmers and represents the first in Africa to be maintained by a government entity at such a large scale.

    The 8028 hotline Interactive Voice Response (IVR) system uses phone key navigation. When users call the 8028 hotline, they are prompted to select a crop to hear advisory content. When users select a crop they haven’t added to their profile before, the system prompts users to save the selected crop to their profile, before the system provides advisory content. This prompt was identified as a source of both confusion for users and drop-off from the system. We tested whether removing the prompt to save the selected crop to the user’s profile improved access to content. The intervention resulted in a modest positive effect: a one percentage point (pp) increase in the share of users accessing content, which would translate to approximately 5,000 additional messages accessed per month across all the 8028 hotline users.
  • Status
    Completed
  • Start date
    Q4 Nov 2017
  • End date
    Q1 Feb 2018
  • Experiment Location
    Ethiopia
  • Partner Organization
    Ethiopian ATA
  • Agricultural season
    _N/A
  • Research Design

  • Experiment type
    A/B test
  • Sample frame / target population
    All Users of 8028 IVR system
  • Sample size
    392,974
  • Outcome type
    Knowledge, Information access
  • Mode of data collection
    PxD administrative data
  • Research question(s)
    Does removing the prompt to save the selected crop to a user’s profile improve content access?
  • Research theme
    Communication technology
  • Research Design

    Users of the 8028 hotline service were randomly assigned to one of two groups:

    Treatment Group: Were not prompted to save their selected crop to their profile; were directed to the content menu immediately after making a selection.

    Control Group: Received the standard prompt asking them to save their selected crop to their profile before proceeding to access the content.

    We used administrative platform data to measure the number of content items accessed.

    Study publication forthcoming.

  • Results

  • Results
    Not being prompted to save their selected crop to their profile led to a 1pp increase in treatment-group users accessing content, compared to control-group users (p < 0.01). On average, treatment-group users accessed 0.1 additional content items, which would translate to approximately 5,000 additional messages accessed per month across all 8028 hotline users.