Revitalizing Cantonese Proficiency: An Interactive ASR-Driven Approach
Abstract
In recent years, an increasing number of children in the Guangdong region found themselves unfamiliar with Cantonese which is their native language. This trend poses a significant threat to the preservation of the rich cultural heritage and traditions associated with the Cantonese language, meanwhile Cantonese is very different from Mandarin so it is very difficult to learn. Recognizing this challenge, the "Assistant for Cantonese Learning" app has been developed to bridge this gap. The app aids in using an ASR model to provide exercises tailored to a student's proficiency, allowing the user's mastery of Cantonese to be assessed based on the comparison between the translated text and the original text provided by the system, as well as the correctness of the user's pronunciation and intonation. Using OpenAI's advanced Whisper ASR model, the app offers an interactive and dynamic learning experience, ensuring that anyone who wants to learn Cantonese can connect with the linguistic roots efficiently and effectively.
References
- [JECR 2013] Mostow, J., Nelson, J., & Beck, J. E. (2013). Computer-Guided Oral Reading versus Independent Practice: Comparison of Sustained Silent Reading to an Automated Reading Tutor that Listens. Journal of Educational Computing Research, 49(2): 249-276.
- Mostow, J. (1971) Potential Applications of Artificial Intelligence to Education
- [[SSSR 2012] Mostow, J., Nelson, J., Kantorzyk, M., Gates, D., & Valeri, J. (2012, July 11-14). How does the amount of context in which words are practiced affect fluency growth? Experimental results. Talk presented at the Nineteenth Annual Meeting of the Society for the Scientific Study of Reading, Montreal, Canada.
- [FLAIRS 2012 prosody] Sitaram, S., & Mostow, J. (2012, May 23-25). Mining Data from Project LISTEN’s Reading Tutor to Analyze Development of Children's Oral Reading Prosody [Best Paper Award]. In Proceedings of the 25th Florida Artificial Intelligence Research Society Conference (FLAIRS-25), 478-483. Marco Island, Florida.
- [[BKT20y 2014] Xu, Y. & Mostow, J. (2014, July 4). A Unified 5-Dimensional Framework for Student Models. In Proceedings of the EDM2014 Workshop on Approaching Twenty Years of Knowledge Tracing: Lessons Learned, Open Challenges, and Promising Developments, 122-129. Institute of Education, London, UK.