keyboard_arrow_up
Mymelody: An AI-Enhanced Unity Application for Vocal Range Identification, Real-Time Note Tracking, and Performance Scoring in Accessible Singing Education

Authors

Lily Chen 1 and Moddwyn Andaya 2, 1 USA, 2 California State Polytechnic University, USA

Abstract

MyMelody, a singing app created through Unity and C#, powered by an added element of AI, aims to become supplementary to traditional singing lessons, combating the limited accessibility, costliness, and other challenges people often face along their singing journey [2]. The three most important systems within the app are the Voice Type Identifier (for the user to identify their vocal range), Note Spawning (to display notes in the karaoke), and Song Scoring (for the user to determine their progress). The design process yielded many challenges, such as implementing math and outside algorithms to convert between pitch and frequency, making the UI fun and interactive for the user, and deciding how to score a user [1]. These challenges were addressed through iterative debugging and external research. System functionality was evaluated through a controlled test consisting of 10 predefined scenarios, of which the AI agent successfully handled 9. MyMelody is an innovative project that should be used increasingly, as it incorporates the power of artificial intelligence to help make music more accessible.

Keywords

AI-Assisted Music Learning, Vocal Range Identification, Pitch Detection, Interactive Music Education

Full Text  Volume 16, Number 1