Research: Benchmarking data points [comparative analysis of CKAN websites]

Benchmarking task flows of data points [by conducting a comparative analysis of CKAN websites]

Research Date

February - April 2023

Summary of Research

Question

• What is the Information Architecture of the data points across the selected CKAN websites?
• What are all the available task flows of the data points on the selected CKAN websites?

Purpose

The primary goal is to focus on identifying all existing data points and taskflows on the landing page of the CKAN websites. The goal is to deep dive into this particular feature (data points) & benchmark it.

Definitions:

• Task Flow: The point where the user clicks first to access the data catalogue. The journey of the user across the website to complete this one task (i.e. finding the relevant data)
• Data Point: Touch points on the landing page of the website which gives access or entry to the data
• Benchmarking: Is the process of creating a foundation or yardstick against which all future processes/features are measured, based on business goals.

Methods

• Desk Research (scoping literature review) is first conducted of 20+ research articles/journals/blogs. The purpose of this desk research is to identify existing best practices & research methods that can be implemented, based on objectives.
• Second, conduct a methodical visual and qualitative audit of the five(5) selected CKAN websites. Utilising the Content Analysis technique in UX Research, the relevant raw data is identified & tabulated.
• For the purpose of this study, Dovetail was selected, as this UX tool has a robust infrastructure that supports end-to-end qualitative user research (including setting up research plans, setting up a spreadsheet, affinity mapping, documenting visual and textual data).
• The codes/groups are predetermined based on the research questions, to keep this project focussed. These codes are identified and affinity mapped for enhanced data visualisation. After grouping, each cluster in the affinity map is assigned a statement discussing the learnings (providing the analysis or key insight).

Current Status

• Data collection and data analysis complete
• Benchmarked three CKAN websites as best practices:
  1. opendata.swiss
  2. openAfrica
  3. Data.Gov
• Benchmarking the above 3 CKAN websites based on existing standards & best practices, will support in further developing Access the Data's product features (for the website & mobile application)

All Issues

• Label: Research: Benchmarking
• Benchmarking task flows of data points [by conducting a comparative analysis of CKAN websites]
• Impact of this UXR Project:
  • Reorganize Home Page
  • ATD Glossary (public facing)
  • Identifying the Information Architecture (IA) for the Search Bar feature, using CKAN benchmarking

Outstanding task items

Assets

Google Drive Folders

Benchmarking data points - Comparative analysis of CKAN websites

Research Plan

RESEARCH PLAN

Recruitment Strategy

Scripts

Interview recordings & Transcripts

Data Collection - content analysis of selected 6 CKAN websites

Synthesis (Dovetail or Miro or Figjam)

Affinity Mapping/ Content Analysis - Dovetail

Presentation of Findings

• Research Presentation
• Research Report
• Demo Day Presentation (December 2022), Study set-up, background & potential

Action Items Spreadsheet

---

Related Wiki Pages

• ATD Research: Unmoderated Usability Testing (Competitive analysis of CKAN websites)