Rearrangement of a Livestock Menu to Increase User Access to Desired Content (ATA Experiment 112)
ETH -21 -1703Last modified on January 27th, 2026 at 8:58 am
-
Abstract
PxD is partnering with Ethiopia’s Agricultural Transformation Agency (ATA) to help improve the effectiveness of their voice-based mobile advisory service, the 8028 hotline, by conducting continuous iterations and experiments, as well as by making suggestions for improvements to and customization of the service. The service has millions of registered farmers and represents the first in Africa to be maintained by a government entity at such a large scale.
The livestock content was prepared and launched through the 8028 hotline in May 2020. The livestock content and the menu were structured as Dairy (first menu), Fattening (second menu), Small-Scale [commercial] Poultry (third menu), Improved Household Poultry (fourth menu), and Apiculture (fifth menu). Based on our exploration of user experience, we hypothesized that callers were likely choosing menu options based on the arrangement of the menu items instead of their desired content. Dairy was the most frequently selected menu option, followed by Fattening, then Small-Scale [commercial] Poultry, Improved Household Poultry, and Apiculture. However, our user base’s farming activities indicate that the majority of these poultry farmers engage in household production, not small-scale commercial production.
In this experiment, we aimed to help users, specifically poultry farmers, reach their desired content more easily. We randomly assigned users who selected the Livestock menu to either a control group with no changes to the Livestock menu options or to the treatment group with the two poultry menu options as sub-menus under a new Poultry menu. We find the gap between selecting Small-Scale [commercial] and Improved Household Poultry menu options significantly narrowed in the treatment group, thus aligning more closely with production-activity patterns in our user base. -
Status
Completed
-
Start date
Q2 May 2021
-
Experiment Location
Ethiopia
-
Partner Organization
Ethiopian ATA
-
Agricultural season
_N/A
-
Experiment type
A/B test
-
Sample frame / target population
8028 hotline Amharic language users
-
Sample size
390,463
-
Outcome type
Beliefs or perceptions
-
Mode of data collection
Automated survey
-
Research question(s)
Does revising the livestock menu to combine poultry topics into a new sub-menu increase the proportion of users who access poultry content?
-
Research theme
Communication technology
-
Research Design
The sample comprised all 8028 hotline users who selected the Livestock menu. Farmers were randomly assigned to the control group with no changes to the Livestock menu options or to the treatment group with the two poultry menu options combined under a new Poultry menu.
- Control group: Five livestock menu options for Dairy, Fattening, Small-Scale Poultry, Improved Household Poultry, Apiculture.
- Treatment group: Four livestock menu options for Dairy, Fattening, Poultry, Apiculture. If users selected the Poultry option, then they could press 1 for Small-Scale Poultry or press 2 for Improved Household Poultry.
We used administrative data to measure the key outcomes of interest, namely access to content, and distribution of accessed content.
-
Results
The gap between selecting Small-Scale and Improved Household Poultry menu options significantly narrowed in the treatment group, which was provided the new Poultry menu. Of treatment group farmers who selected the Poultry menu from the main Livestock menu, 57% selected Small-Scale Poultry and 43% selected Improved Household Poultry. In the control group the gap in menu selection was much wider with 72% selecting Small-Scale Poultry and 28% selecting Improved Household Poultry. Since the majority of poultry farmers in our user base engage in household production rather than small-scale commercial production, these findings imply that users were able to reach content more relevant to their production activities.