An accessibility specialist named Michelle P. posted this on one of the Slack boards I use. She gave me permission to repost it.
Person to vendor: How close are you to automating screen reader testing?
Me, on the call: There’s no such thing, screen reader testing and automated testing don’t work like that.
Person, to me: I want to see how close they are.
Me: There is no close, it doesn’t exist and no one can claim it exists. It’s like asking how close we are to automating your own personal eye exam results without you physically being there.
Every screen reader user will use the system differently. Every screen reader behaves differently — there’s no “Jeffrey Zeldman of screen readers” to help muscle all of the screen readers to behave the same way. And every browser that you use with a screen reader is also going to behave differently.
And I just love the metaphor about the eye exam so much.