A peer-reviewed workshop paper from NLP4PI 2026, held with the EMNLP conference, describes an interactive tool that helps screen reader users understand charts. The MATCHA Chart Summarizer reads a chart aloud in everyday language and lets people ask follow-up questions about the data.
Online charts are everywhere, from news stories to school assignments, but they are often little more than pictures to someone using a screen reader. A short alt-text label, or no description at all, can leave the actual pattern in the data out of reach.
In a summative test, task accuracy rose from about 29% with a basic static summary to 55% with the refined spoken summary plus interactive questions.
Participants also reported higher confidence. That is a meaningful gain for people who want to read the same charts everyone else sees, not a claim that the tool is already built into everyday websites.
How the tool was tested
Researchers Lauren C. Kahn, Jaime Soto, Om Arya, Audrey Michal, and Steven R. Wilson built a browser-based prototype that uses a multimodal language model to describe a chart and answer questions in natural language. They evaluated it in three stages, with a total of 126 people, recruited separately for each stage. Participants were screen reader users who identified as having low vision, as neurodivergent, or as both.
The accuracy comparison used a within-subjects design. People completed chart tasks with a basic, unrefined summary and, in the other condition, with an optimized summary plus a chance to ask questions. The jump from 29% to 55% correct reflects that combined, interactive experience, not a magic one-sentence caption alone. Ratings of how informative and usable the tool felt also moved in a positive direction, though the authors did not formally test those two measures for statistical significance.
The team also looked at messy, real-world charts. Missing labels or poor contrast can push the model into “semantic drift,†meaning the spoken summary can wander away from what the chart actually shows. That is a serious caveat for any tool that tries to describe data automatically.
Why this matters for people
If you cannot see a bar chart, you should still be able to learn whether sales rose, which group was largest, or whether two lines crossed. A spoken overview, plus the chance to ask “what was the highest year?†can turn a silent image into something you can reason about.
The authors frame this as a way to narrow the gap in chart comprehension, and they offer design recommendations for future systems. The work is a research prototype, presented at a peer-reviewed workshop, not a finished feature in a screen reader. It is a start, though, toward charts that can be heard, questioned, and understood rather than skipped.
Limits to keep in view
The 126-person figure covers the whole project, not a single large trial of the final tool. The accuracy result comes from the later comparison of a basic summary with the optimized, interactive version. The study does not show how the tool would perform on every kind of chart, in every browser, or over weeks of daily use. A pie chart, a dense dashboard, or a poorly scanned graphic could all behave differently, and those harder cases still need careful testing.
Because flawed charts can produce flawed summaries, users still need a way to notice when the description might be wrong. And because this is a workshop paper about a prototype, independent tests and real deployments are still ahead.
Looking ahead for screen reader users and charts
Even with those limits, the study points to a practical path. Better AI summaries, especially ones you can question, can help screen reader users understand charts that would otherwise be closed to them.
For students, news readers, and anyone who uses a screen reader at work, that could mean fewer charts that have to be skipped or explained by someone else.
You can read the paper in the ACL Anthology. If later products take this approach carefully, more of the charts that fill the web could become not just visible, but understandable, to everyone who needs to read them.