A11YBench

A11YBench consists of 60 real-world web projects, encompassing 145 web pages and 8,886 accessibility violations detected by the IBM Accessibility Checker. The projects vary substantially in size, from 123 to 43,198 source files and from 3,610 to 1,555,532 lines of code, covering both lightweight documentation sites and large production-grade applications.

Dataset

LLM4APR/A11YBench · Datasets at Hugging Face

A11YBench

A Benchmark for Web Accessibility Repair

A11YBench is a curated benchmark designed to evaluate automated systems that repair real-world Web Accessibility (A11Y) violations. It contains diverse, production-quality web projects along with violation reports, DOM snapshots, and execution environments that enable reproducible end-to-end evaluation.

You can download the full dataset directly from the Hugging Face Hub.

Web A11Y Violation Report

We present an example of a violation report generated by IBM A11Y Checker for a webpage. We focus solely on addressing the detected violations.

Collected Web Projects

GitHub - microsoft/TypeScript-Website: The Website and web infrastructure for learning TypeScriptThe Website and web infrastructure for learning TypeScript - microsoft/TypeScript-Website

TypeScript-Website

The Website and web infrastructure for learning TypeScript

The Go Programming LanguageGo is an open source programming language that makes it simple to build secure, scalable systems.

golang/website

Home of the go.dev and golang.org websites

Carbon Design SystemCarbon is IBM’s open source design system for products and digital experiences. With the IBM Design Language as its foundation, the system consists of working code, design tools and resources, human interface guidelines, and a vibrant community of contributors.

carbon-website

The website for the Carbon Design System

Tailwind CSS - Rapidly build modern websites without ever leaving your HTML.Tailwind CSS is a utility-first CSS framework for rapidly building modern websites without ever leaving your HTML.

tailwindcss.com

The Tailwind CSS documentation website

GitHub - pnpm/pnpm.io: pnpm's websitepnpm's website. Contribute to pnpm/pnpm.io development by creating an account on GitHub.

pnpm.io

pnpm's website

GitHub - TheAlgorithms/website: The Algorithms website providing GitHub's largest open-source algorithm library.The Algorithms website providing GitHub's largest open-source algorithm library. - TheAlgorithms/website

The Algorithms/website

The Algorithms website providing GitHub's largest open-source algorithm library

GitHub - electron/website: :electron: The Electron website:electron: The Electron website. Contribute to electron/website development by creating an account on GitHub.

electron/website

The Electron website

LynxEmpower the web community and invite more to build cross-platform apps

lynx-website

Official Website of the Lynx Family

GitHub - asyncapi/conference-website: Website for the AsyncAPI online conferenceWebsite for the AsyncAPI online conference. Contribute to asyncapi/conference-website development by creating an account on GitHub.

conference-website

Website for the AsyncAPI online conference

PostHog – We make dev tools for product engineersAll your developer tools in one place. PostHog gives engineers everything to build, test, measure, and ship successful products faster. Get started free.

posthog.com

Official docs, website, and handbook for PostHog

GitHub - PaperMC/website: The PaperMC websiteThe PaperMC website. Contribute to PaperMC/website development by creating an account on GitHub.

PaperMC/website

The PaperMC website

GitHub - jhipster/jhipster.github.io: Public website for JHipster - generates https://www.jhipster.techPublic website for JHipster - generates https://www.jhipster.tech - jhipster/jhipster.github.io

jhipster.github.io

Public website for JHipster - generates https://www.jhipster.tech

GitHub - open-feature/openfeature.dev: OpenFeature WebsiteOpenFeature Website. Contribute to open-feature/openfeature.dev development by creating an account on GitHub.

openfeature.dev

OpenFeature Website

GitHub - jetkvm/website: JetKVM WebsiteJetKVM Website. Contribute to jetkvm/website development by creating an account on GitHub.

jetkvm/website

JetKVM Website

Home | Ethereum Foundation ESPThe Ecosystem Support Program provides support to builders creating public goods for the Ethereum ecosystem.

esp-website

Website for the Ethereum Foundation's Ecosystem Support Program (ESP):

esp.ethereum.foundation/

OpenTofuOpenTofu - Modern Infrastructure as Code

opentofu.org

The OpenTofu Website

GitHub - usememos/dotcom: https://www.usememos.com websitehttps://www.usememos.com website. Contribute to usememos/dotcom development by creating an account on GitHub.

dotcom

https://www.usememos.com website

ShorebirdOver the air updates for Flutter. Confidently update Flutter apps instantly.

website

The shorebird.dev site

GitHub - ethereum/nxbn-website: Website for the Ethereum Foundation's Next Billion InitiativeWebsite for the Ethereum Foundation's Next Billion Initiative - ethereum/nxbn-website

nxbn-website

Website for the Ethereum Foundation's Next Billion Initiative

GitHub - mlflow/mlflow-websiteContribute to mlflow/mlflow-website development by creating an account on GitHub.

mlflow-website

Build optimized websites quickly, focus on your content | DocusaurusAn optimized site generator in React. Docusaurus helps you to move fast and write content. Build documentation websites, blogs, marketing pages, and more.

docusaurus

Easy to maintain open source documentation websites.

GitHub - chaos-mesh/website: Source for Chaos Mesh website.Source for Chaos Mesh website. Contribute to chaos-mesh/website development by creating an account on GitHub.

website

Source for Chaos Mesh website.

GitHub - recodehive/recode-website: recodehive helps you to learn and master the skills on data, and encourage you to code on opensource.recodehive helps you to learn and master the skills on data, and encourage you to code on opensource. - recodehive/recode-website

recode-website

recodehive helps you to learn and master the skills on data, and encourage you to code on opensource.

GitHub - reactjs/react.dev: The React documentation websiteThe React documentation website. Contribute to reactjs/react.dev development by creating an account on GitHub.

react.dev

The React documentation website

GitHub - babel/website: :globe_with_meridians: The Babel documentation website:globe_with_meridians: The Babel documentation website - babel/website

website

The Babel documentation website

GitHub - algolia/docsearch: :blue_book: The easiest way to add search to your documentation.:blue_book: The easiest way to add search to your documentation. - algolia/docsearch

docsearch

The easiest way to add search to your documentation.

GitHub - jestjs/jest: Delightful JavaScript Testing.Delightful JavaScript Testing. Contribute to jestjs/jest development by creating an account on GitHub.

jest

Delightful JavaScript Testing.

GitHub - facebook/react-native-website: The React Native website and docsThe React Native website and docs. Contribute to facebook/react-native-website development by creating an account on GitHub.

react-native-website

The React Native website and docs

GitHub - facebook/relay: Relay is a JavaScript framework for building data-driven React applications.Relay is a JavaScript framework for building data-driven React applications. - facebook/relay

relay

Relay is a JavaScript framework for building data-driven React applications.

GitHub - autodesk-platform-services/aps-tutorials-website: APS Tutorials: Docusaurus project for the APS Tutorials Website.APS Tutorials: Docusaurus project for the APS Tutorials Website. - autodesk-platform-services/aps-tutorials-website

aps-tutorials-website

APS Tutorials: Docusaurus project for the APS Tutorials Website.

GitHub - conda/conda-dot-org: conda.org websiteconda.org website. Contribute to conda/conda-dot-org development by creating an account on GitHub.

conda-dot-org

conda.org website

GitHub - mui/material-ui: Material UI: Comprehensive React component library that implements Google's Material Design. Free forever.Material UI: Comprehensive React component library that implements Google's Material Design. Free forever. - mui/material-ui

material-ui

Material UI: Comprehensive React component library that implements Google's Material Design. Free forever.

GitHub - ant-design/ant-design: An enterprise-class UI design language and React UI libraryAn enterprise-class UI design language and React UI library - ant-design/ant-design

ant-design

An enterprise-class UI design language and React UI library

GitHub - prettier/prettier: Prettier is an opinionated code formatter.Prettier is an opinionated code formatter. Contribute to prettier/prettier development by creating an account on GitHub.

prettier

Prettier is an opinionated code formatter.

GitHub - docsifyjs/docsify: 🃏 A magical documentation site generator.🃏 A magical documentation site generator. Contribute to docsifyjs/docsify development by creating an account on GitHub.

docsify

A magical documentation site generator.

JSON Crack | Online JSON Viewer - Transform your data into interactive graphsJSON Crack Editor is a tool for visualizing into graphs, analyzing, editing, formatting, querying, transforming and validating JSON, CSV, YAML, XML, and more.

jsoncrack.com

Innovative and open-source visualization application that transforms various data formats, such as JSON, YAML, XML, CSV and more, into interactive graphs.