This is a guest article from Crawford Technologies, a valued BCC Software partner.
While automation has made creating accessible documents more efficient, testing is a vitally important step in the process that many organizations don’t always consider. When discussing testing accessible documents, the terms Quality Assurance and Quality Control are frequently used interchangeably, but in reality, they are different things. According to ISO-9000:2015, Quality Assurance (QA) refers to the procedures that must be followed to ensure that a product meets certain standards or customer requirements. Quality Control (QC), on the other hand, refers to testing and reviewing the final product to ensure that there are no problems or errors. Both QA and QC are necessary and important elements of document accessibility, but this article will focus on QC, or testing the final product.
Requirements for Effective Quality Control
QC is the phase of the process where you ensure that your documents comply with current legislation, including the recent Section 508 refresh. It's also essential to get a sense of how the end user will experience the files. That’s why, particularly with Accessible PDF and Accessible HTML5, it’s essential to test with screen readers as well as verify technical accuracy.
Each accessible format has certain standards, guidelines, and best practices that must be followed to achieve technical accuracy. For example, braille has both code and formatting rules. Code rules tell which symbol is needed and formatting rules tell how to arrange elements of text (such as lists and headings) on a page. Similarly, large print has industry standards regarding fonts, spacing, and other aspects of page layout. In both cases, the best way to verify technical accuracy is to have someone well-versed in the appropriate standards read through the files. For braille, this person should be a certified braille proofreader. Regardless of the format, the person who transcribes or remediates the files should not be the one who proofs them.
Verifying Technical Accuracy
Verifying technical accuracy and the end user experience is particularly important for Accessible PDF and Accessible HTML5. If you’re going to test your documents in-house, you’ll need to test for both.
When it comes to technical accuracy of Accessible PDF files, you can use tools such as Adobe’s Accessibility Checker, CommonLook PDF Validator, or PAC 2.0. These tools provide reports that tell you if your file meets a series of success criteria for accessibility. There are similar tools that perform the same function for Accessible HTML5 – we call this type of testing “machine verification.” On the other hand, “human verification” of these formats involves a subject matter expert reviewing the file to verify that each element has either been properly tagged or changed into an artifact. Utilizing both machine and human verification are important. Consider that even if an automated checker verifies the format, it can’t tell if alt text descriptions make sense or are helpful, or if the read order is logical. In other words, a file can “pass” when verified by machine, yet fail to communicate all of the content in the document properly.
Evaluating the End User Experience
A positive user experience is not only essential, but also considered an important criteria of success for accessible documents. So how can this best be assessed? As a starting point, once you’ve determined that your Accessible PDF or Accessible HTML5 documents are technically accurate, they need to be tested with a screen reader. These programs (such as JAWS, NVDA, and VoiceOver) are designed to convert text into speech. It is critical to note that Adobe Read Aloud is NOT a screen reader – it does not function as a screen reader so it will not reflect how the end user will interact with your files. It’s also essential that the tester is proficient with the screen reader used for QC purposes. This means knowing the keyboard commands that enable the end user to navigate the file and access specific information. Without a thorough knowledge of these commands, the tester is not able to fully replicate the end user experience.
Quality control is a vital step in ensuring your documents are truly accessible for everyone who wants to use and gain value from them. It is an important process within the workflow that will help your organization achieve the dual goals of maintaining regulatory compliance and meeting your customers' needs.
For more information on testing accessible documents, contact Crawford Technologies.