The Cost of Accessibility in AI — Jemima Abu, CAIS

AI Engineer · 10 min · 126 sentences · from YouTube's caption track

Each timecode opens YouTube at the start of that sentence. Line anchors (#s42) are the cue ids in the WebVTT, and every line carries its start and end seconds. All transcripts has every talk, and the whole corpus as one file.

00:00Hi all, my name is Rima, and I'm going to be talking to you about the cost of accessibility in AI, or as I like to call it, stop wasting tokens on building products that people can't use.
00:09Because at the end of the day, what is accessibility?
00:11Accessibility is the quality of being able to be used by anyone regardless of disability.
00:16So, what this means is that when you build a product that is inaccessible, that product is inherently useless because people cannot use it.
00:23I think this is a very prevalent talk, especially in these days of vibe coding and prompt engineering and AI basically writing all the code for us.
00:30We need to ensure that even with all the code being written by AI, we're still building for humans, and we're ensuring that humans are able to use the products that we are building.
00:38It's all very well and good to vibe good five different apps in one day, but if people can't use those apps, then is there really any point?
00:44A study by WebAIM shows that 96% of the homepages of the top 1 million websites in the world have some form of accessibility issue or another.
00:52Now, I'm someone that goes around a lot and speaks about accessibility, and whenever I ask why don't people build websites to be accessible, I usually hear it takes too long.
00:59While I will agree that accessibility is a labor and time-intensive process, I do think that now that we're at the stage of AI writing most of our code, it's actually easier to make things accessible.
01:08If anything, I would say it costs more time and more money to build inaccessible websites.
01:14So, I decided to carry out a little experiment using the code base at work.
01:17So, I gave this prompt to the agents.
01:18It's just a simple prompt with no guidelines, implement this design from Figma.
01:22And they ran it twice.
01:23The first time without any accessibility skill, and the second time by using the skill that I had written.
01:27And what I noticed was that not only was it faster for the agent to build the accessible skill, but there was also a 58% reduction in cost when using that skill.
01:36And we can take a look at the data here.
01:37We see that not only was it cheaper, but it also took a third of the time to finish the prompt while using the accessibility skill.
01:43So, in conclusion, we can't say that it is actually cheaper for AI agents to build accessible websites.
01:48We can't say that, but we won't say that because this was a one-off experiment, and it was not carried out in a constrained environment, so it cannot serve as empirical data that proves the of But, when we look into the reasons why it took the AI agent much longer to carry out the prompts without any accessibility skills,
02:01then we can have a better idea of why exactly it is faster to build accessible websites.
02:06But, before we get into that, hi, my name is Joreima Abu.
02:09I am a product engineer at Case and an alternative investment platform.
02:12I'm also a Google Dev Expert, a Microsoft MVP, and a certified professional in accessibility core competencies.
02:17Basically, I like to go around talking about how to make the web a more accessible place.
02:21Also, I will give a slight disclaimer.
02:23While a lot of my examples relating to accessibility will be web-based because that is my area of expertise, this can also apply regardless of whatever platform you're working on, whether that's mobile or hardware or anything at all.
02:33So, let's get back to it.
02:35This is your AI agent.
02:36Now, it's a super intelligent tool that can do almost anything in the world, but at the same time, it's just 3 years old.
02:42And much like a baby, AI is very impressionable.
02:44If you tell it enough times that the sky is red, eventually it will start to accept that the sky is red.
02:49What this means is as the responsible developers in charge, we have to make sure that we're providing the right skills and guidance for AI agents to build the product that we want them to build.
02:58There's a Japanese show on Netflix that I love called Old Enough.
03:01It's basically about toddlers being sent on their first errand.
03:03It can be like a 3-year-old being sent to a supermarket to purchase groceries.
03:06And one thing I like about the show is that you can always see the steps that the parents have put in place before they send them on that first errand.
03:12So, it could be that the child has gone with their parents to the supermarket multiple times, or they provide a list that's very clearly detailed that shows them where the supermarket is, what they need to get there, what paths to avoid,
03:23and it basically makes it a lot easier for the child to carry out that errand.
03:26It's the same thing with an agent.
03:27When you're given an instruction to an agent, if I'm saying build this webpage or implement this design, if I provide the right skills and prompts, it makes it a lot easier
03:35for that agent to avoid going down the wrong path and for the finished product to look like what I intended it to look like.
03:41So, let's take a look at what happens when we don't provide any form of guidance for our agents in developing products.
03:46Firstly, human bias becomes AI bias.
03:49For years, humans have been developing websites or products that are inaccessible because frankly we just don't think that way.
03:54Especially as developers, we tend to have a it works for me mindset.
03:57So I'm like this thing works on my laptop and it works the way I intended it to work and I'm not going to check anything else.
04:01I don't concern myself with if it works for screen readers or if it works in low light environments.
04:06I'm just like it works, it's built, I'm done.
04:07Whenever you build like that or if you have a code base that reflects that kind of mentality, once you put an AI agent in that code base, it's going to absorb all your biases.
04:16It's going to say, "Oh, we don't need to make these things accessible because that has not that been mentioned in the past.
04:20So I'm just going to build things anyhow."
04:22And then the more you use that AI agent to generate codes, the more you build a code base that is inherently inaccessible because accessibility was never constraint in the first place.
04:31Secondly, and this is something that I really noticed in the experiment, AI tends to default to a lot of verbose code.
04:36If you don't provide any particular prompt or guidelines for your agent, it will reinvent the wheel as many times as it wants to.
04:42So even if you tell it just build a simple accordion component or build a modal component, it's not going to bother checking is there already an existing semantic elements
04:51that can give me the same functionality?
04:52It's just going to build one from scratch.
04:53AI loves to write code.
04:55So it'll go off and write as many things as it wants.
04:58And as you can see here, if you are trying to recreate a semantic element, it takes a lot more time and effort because number one, you have to carry out a lot more testing,
05:06you have to implement a lot more features to replicate the native functionality, and it's just a very cumbersome process.
05:12So these are some of the things that you want to ensure you're focusing on when you're providing prompts to your agent.
05:16I saw an analogy once that said an accessible website is like a blueberry muffin.
05:19If someone hands you a plain muffin that they've shoved a bunch of blueberries on, similar to the picture on the right, that's not a blueberry muffin.
05:26For it to be a proper blueberry muffin like the one on the left, then the blueberries need to have been baked in from the start.
05:31It's the same thing with an accessible website.
05:32If you have a fully built website and then once it's done, you start shoving in area labels in different places, that is not an accessible website.
05:39For it to be an accessible website, you need to put accessibility at the forefront at every build process.
05:44And this does not just apply to developers, accessibility is the responsibility of everyone.
05:48So, you want to make sure that even from the business idea to design to QA, that we're ensuring that we're looking for accessibility and testing that can this product be used by everyone in the exact same way.
05:59And that issue with waiting till the end to consider accessibility is that you waste a lot of time on regressive testing.
06:03So, if you've waited until your website is fully built and then you start testing and going back to fix issues, you end up refactoring and rewriting a lot more code than you'd have had to do if you don't build it to be accessible from the start.
06:14And then of course, there are business consequences to building inaccessible products.
06:18The thing I hear sometimes is that a business might say, "Oh, but we don't have to consider accessibility because none of our users rely on assistive technologies."
06:24And I think that's very funny because it's sort of a self-fulfilling prophecy.
06:27It's not that your users don't rely on assistive technologies, it's that people with assistive technologies cannot use your website in the first place, so they just never go to it.
06:35Imagine a business that didn't have a door.
06:38You would never get any customers.
06:39How would they get in the building?
06:40It's the same thing with building an inaccessible product.
06:42If you build a product that people cannot use, then people will not use it.
06:45And then finally, there are legal repercussions to not making your website accessible.
06:49In the United States, the Americans with Disabilities Act states that any public-facing products must be accessible and can be used by people with disabilities, or you could face fines and even lawsuits.
06:58But on the plus side, you could get to use this really cute sticker on Microsoft Teams, so you know, weigh your options.
07:03Based on all this, we can see that it actually is a lot more expensive to be building products that aren't accessible.
07:08You're exposing yourself to losing money from customers, possible lawsuits where you have to pay fines, you're spending more time building code and refactoring things.
07:16So, if you do build your product to be accessible from the start, it's going to be a lot faster and a lot cheaper.
07:22So, now that we know all that, how can we actually ensure that our AI agents are building things to be accessible?
07:27Because everyone's code base is different and we can be working with different technologies, I'm just going to give an overarching general view of how to get your AI agents to produce accessible code.
07:36So firstly, you need to define your accessibility requirements.
07:38Accessibility requirements differ based on what platform you're working on.
07:42So, you do need to carry out research and ensure that you know what accessibility requirements you're supposed to be meeting for the platform you are building for.
07:50Once that's done, you need to audit your existing code base.
07:51So, if you're going to introduce an AI agent into your code base, you need to ensure that you don't have any pre-existing issues that the AI agent might copy as what it thinks is best behavior.
08:01So, you can use automated tools to carry out accessibility testing, or you can even tell your AI agent to do it.
08:06But, you want to identify any existing issues and then fix them before you start writing new features.
08:11Then, you want to implement some sort of reusable system.
08:14This is a very nice to have, but basically, if you're going to work with accessibility, it's a lot easier to fix things in one component that is used in multiple places as opposed to making fixes to the same components across different files.
08:26So, just having an implemented design system or any form of reusable component library is going to save you a lot more time in the long run when making things accessible.
08:34And then finally, you want to enforce a mandatory accessibility skill.
08:38This is a skill that your AI agents will basically use anytime you're running anything related to maybe generating UI or writing code that requires accessibility.
08:45One skill that I really like to use is the Modern Web Guidance skill from Chrome.
08:48It's basically a skill that ensures that your agent is using the newest HTML and CSS features as opposed to custom JavaScript implementations.
08:55You can also have a lightweight version of an accessibility skill.
08:57I think this is very important, especially if you're like vibe coding or you're not working in a big code base.
09:01You just want something quick that your agent can refer to and not carry out a lot of in-depth research.
09:05This is what I would recommend for meeting like bare minimum accessibility requirements.
09:08So, you want to make sure that you're using semantic HTML wherever possible, only reaching for ARIA when semantic HTML can't express the behavior.
09:15Every interactive element, if it can be operated by a mouse, it should also be operated by a keyboard.
09:19You also make sure that elements are properly labeled and can be read by screen readers.
09:23And then finally, before running the code, your agent should carry out an audit against all those steps.
09:26Of course, this is not enough to build a fully accessible website.
09:30You still need to carry out a lot of manual testing yourself because it's not possible for a one tool to make a website fully accessible.
09:36But, just having these skills in place can help a lot more than not having them there at all.
09:41Regardless of why you use AI, most times the goal is to solve a particular problem.
09:45So, just make sure that your solution is useful to as many people as possible.
09:48So, build things to be accessible.
09:50And that is all.
09:51Thank you so much for listening to my talk.
09:53I hope you enjoyed it.
09:54If you do have any questions, feel free to reach out to me online at Jemima Abu.
09:58That's LinkedIn, Twitter, or GitHub.
09:59I would love to hear from you.
10:01Okay, bye.