Room 1

13:40 - 14:40 (UTC+01)

Talk (60 min)

Building a wearable live captioning display to help

My mum is hard of hearing and relies heavily on lipreading to understand conversations. Mask wearing has made her feel incredibly isolated as it muffles speech and covers the lips. I wondered if it was possible, using existing technologies, to build a live caption display into a mask so that she could read what I say as I say it, without having to check a phone or ask me to repeat myself. This talk will go over how I used a mask bought at Cyberdog, Microsoft Azure Cognitive Services, Ably's realtime MQTT broker and some good old JS, to make mask wearing even more assistive and brilliant.


Jo Franchetti

Jo is the lead developer advocate at Ably. She is passionate about making apps with realtime data, fun PWAs and writing great CSS. She’s got 10 years experience as a front end developer and has worked in various parts of the tech industry from start-ups, agencies, charities to large organisations. She is also a mentor and organiser at and at Front End Foxes where she is able to act on her passion not only for teaching good use of the web but also for improving the diversity and inclusivity of the tech industry.