Developing an AI-Powered Speech Annotation and Transcription Enhancer Tool
openNIDCD - National Institute on Deafness and Other Communication Disorders
PROJECT SUMMARY/ABSTRACT
Language Sample Analysis (LSA) is the gold standard for Speech-Language Pathologists (SLPs) to evaluate
functional communication, but manual annotation is slow and inconsistent, taking 7–8 minutes per minute of
speech. This bottleneck delays interventions and exacerbates workforce strain, with 55% of SLPs reporting
excessive caseloads. Existing tools such as SALT, CLAN, and Whisper offer only partial automation and lack
comprehensive, multi-layer analysis. With the U.S. speech therapy market valued at $4.62 billion in 2023 and
projected to grow to $8.37 billion by 2032 (CAGR 6.9%), there is strong demand for efficient, scalable, and
clinically useful technologies that address SLP workflow needs. We propose SATE (Speech Annotation and
Transcription Enhancer), an AI-powered platform that automates multi-layer LSA with high accuracy and usability.
SATE delivers precise annotations across word- and phoneme-level transcription, C-unit segmentation, phonetic
analysis (e.g., mispronunciation detection), maze identification (pauses, repetitions, filler words), morpheme and
syllable analysis, and grammar evaluation. Outputs are presented in interactive reports with dynamic
visualization and enable real-time editing, enabling efficient review and refinement for SLPs. The system
leverages both a proprietary dataset and multiple public corpora (e.g., ENNI, L2-ARCTIC, Rescorla, UltraSuite)
to ensure robustness across linguistic accents, dialects, and demographic groups. Phase I will validate technical
performance on typical and disordered speech, targeting ≥0.8 sensitivity and specificity (95% CI), and assess
usability and adoption through participatory studies with 20 SLPs and heuristic evaluation by 8 HCI experts.
Success will be defined by robust annotation accuracy, strong usability ratings, and preliminary evidence of
financial feasibility. By reducing the time, effort, and variability of LSA, SATE will expand service capacity,
alleviate clinician burden, and improve access to high-quality speech and language evaluation. Completion of
Phase I will provide the technical, clinical, and commercial foundation for Phase II validation, workflow integration,
and SaaS-based commercialization, positioning SATE to transform LSA and strengthen speech and language
service delivery.
Up to $306K
health research