Evaluating Deliverables

Evaluating Deliverables provides guidance on how to ensure that deliverables fulfil the specified accessibility requirements.

When procuring off the shelf products such as a laptop or kiosk, the evidence level you choose influences the type of conformity assessment you require the supplier to provide.  It is important that you choose the correct evidence level so that you can be confident that the accessibility requirements specified in the Call for Tenders have been fulfilled in the deliverable.  See more in Conformity assessment and attestations.

When procuring a development service, such as the development of a website or a piece of bespoke software, use the Accessibility Requirements Generator. This enables you to define either the high-level functional performance statements or the more detailed technical accessibility requirements that the final deliverable must meet. Include these accessibility requirements in both the Call for Tenders and in the contract.

It is important to know if what you have received from the supplier actually meets the accessibility requirements included in the Call for Tenders and the contract. Accessibility evaluation and testing of the deliverables is essential.

If possible and feasible, evaluations may be carried out by independent evaluators with specialist accessibility skills. You may wish to put aside part of the budget for the procurement for the evaluation of the deliverable. It is very difficult to objectively evaluate a product that you have been involved in creating or otherwise have a vested interest in. Your organization may not have anyone who has specialist knowledge in accessibility. You will need to factor in the time required to evaluate the delivered product and the time required for the supplier to take remedial action to fix any problems that are identified by the evaluation. The supplier may have engaged an accessibility expert during the development process. If the supplier carries out accessibility auditing and user testing as part of its quality control procedures, the product or service should have a high level of accessibility on delivery. The independent auditing or testing should then reveal fewer and less serious problems, which will reduce the time and effort required for remedial work.

The evaluation should cover not only the technical accessibility of the product or service, but its usability for people with disabilities. This will enable you to assess important practical issues such as effectiveness of use with assistive technologies and identify any aspects of the system that cause confusion and frustration for the user.

The evaluation of the deliverables will be the final arbiter in deciding whether the accessibility requirements have been met. It should be done rigorously and may go well beyond the supplier’s internal quality assurance process.