ABOUT THE PROJECT
Customer / Partner Country
- Unity Development
- Game Development
- Mobile Development
TechnologiesIBM Watson Speech To TextIBM Watson Text to SpeechIBM Watson AssistantUnitySpineDoozy UIC#
Autisma is a digital assistant embedded into a game designed to improve cognitive, communication, and memory skills for children aged 5 to 12 that are affected by such disorders.
1 out of 59 children is diagnosed with a disease from the autism spectrum. All people affected by such a disorder show a lack of verbal and non-verbal communication as well as social interaction.
The app was developed based on the well-known therapy methods ABA (Applied Behavioral Analysis) and Logopedia (a digital speech therapy tool), researched in collaboration with therapists from Help Autism Suceava.
These were the technical goals of the project:
developing an app that changes the content dynamically, based on user progress;
delivering a highly customizable user experience;
creating a multi-user app that also provides doctors with a set of data about each user, that can be used to tailor better therapy sessions;
building a modular app that can be improved upon with ease.
The features of the Assistant module are as follows:
dynamic generation of game objects based on user progress;
handling of teaching objects;
animations that respond to player input;
an assistant that says the name of the object once it’s correctly guessed.
The first game (see figure 2) is a matching game that aims to help users improve their memory and awareness skills.
The third game (see figure 3) aims to help users improve their communication and social skills, improve their pronunciation, and to learn new words.
Autisma is designed to be a fun repetition-based app that aims to improve the quality of day-to-day life for children affected by autism.
Some advantages of the app include the following:
cheaper than traditional therapy sessions;
designed both for home/individual use and for help centers;
easy to export for multiple platforms.
designed from the get-go with multi-user/profile in mind each profile has it’s a particular set of settings:
AI and assistant module
dynamic generation of game objects based on user progress
handling of teaching materials/objects
increasing/decreasing game difficulty
an assistant that speaks out the object once it's correctly guessed
animations that respond to player input
IBM Watson module
real-time speech processing (English)
generation of assistant’s voice
game 1. match-two type mini-game
small doses of rewards
game 2. association game
learning what object belongs in which room
learning what food different animals eat
game 3.play by talking with the assistant
increasing speech and social skills
improved pronunciation -learning new words
visual and audio rewards
all objects have multiple tags/attributes
a score will be kept for each object, for data analysis
said data can be used to better tailor therapy sessions
behavior patterns could be observed by viewing the data (the user usually fails to match objects that are red)
Impact on our community
Autisma is designed to be a fun repetition-based app that aims to improve the quality of day-to-day life for children affected by the autism spectrum.
meant to be cheaper than traditional therapy sessions
designed both for home/single use or for help centers
easy to export for multiple platforms
Applied Behavioral Analysis
ASSIST Software - Autisma project - Applied Behavioral Analysis
ASSIST Software - Autisma project - application modules
ASSIST Software - Autisma project - third game
ASSIST Software - Autisma project - Character customization
ASSIST Software - Autisma project - first game
ASSIST Software - Autisma project - registration screen
ASSIST Software - Autisma project - session screen
ASSIST Software - Autisma project - volume options
Do you want to get in touch with us?
If you are interested in our software development services, you would like to join our team, or you simply want to find out more about us, we’d love to hear from you! Drop us a line and a member of the ASSIST team will get back to you as soon as possible. We are sure we can ASSIST you.GET IN TOUCH