Live Sarah
Stories every child can read, including the ones who sign.
Inclusive children's storybook library with BISINDO sign-language integration and AI-powered gesture recognition. Built for deaf and hearing children, parents, and educators.
- Field
- Inclusive education
- Built for
- Deaf children & families
- Timeline
- Live
- Stack
- 7 technologies
Case study
From problem to system
The problem
Deaf children are often left out of the stories hearing children enjoy. Picture books rarely include sign language, and there's no easy way for a child to practice signing while they read.
What we built
Sarah is an inclusive children's storybook library, complete with BISINDO. A 3D book whose pages you can flip is paired with AI gesture recognition: the camera tracks a child's hands (MediaPipe + TensorFlow.js) and gives instant feedback as they mirror the signs in the story.
Key features
What Sarah does
-
3D book with page-flip animation
-
Built-in BISINDO sign language
-
Real-time AI hand-gesture recognition
-
Sign-similarity scoring and practice quizzes
-
Bilingual (Indonesian/English)
-
Runs right in the browser, no install
Under the hood
Built with
- React 19
- Vite
- Tailwind CSS
- MediaPipe
- TensorFlow.js
- GSAP
- WebGL
