CookingPro & Accessibility
CookingPro & Accessibility
Case study for fun explores the innovative Apple Vision Pro and a mixed reality app to elevate the cooking experience, focusing on user interaction, efficiency, and overall satisfaction
For fun
Mixed-Reality
Visual design
Product design
Cooking
Why & Data
Why & Data
I believe Vision Pro can make life easier for people with various impairments:
I believe Vision Pro can make life easier for people with various impairments:
Visual Impairments:
Visual Impairments:
Difficulty reading recipes, measuring ingredients, or navigating the kitchen
According to the World Health Organization (WHO), as of 2020, it was estimated that approximately 2.2 billion people globally had a vision impairment or blindness
Difficulty reading recipes, measuring ingredients, or navigating the kitchen
According to the World Health Organization (WHO), as of 2020, it was estimated that approximately 2.2 billion people globally had a vision impairment or blindness
Hearing Impairments
Hearing Impairments
Difficulty hearing timers, alarms, or other auditory cues
According to the World Health Organization (WHO), as of 2021, it was estimated that over 5% of the world's population (approximately 430 million people) had disabling hearing loss
Difficulty hearing timers, alarms, or other auditory cues
According to the World Health Organization (WHO), as of 2021, it was estimated that over 5% of the world's population (approximately 430 million people) had disabling hearing loss
Cognitive Impairments
Cognitive Impairments
Difficulty following complex recipes, multitasking, or remembering cooking
Approximately two out of three Americans experience some level of cognitive impairment at an average age of approximately 70 years
Difficulty following complex recipes, multitasking, or remembering cooking
Approximately two out of three Americans experience some level of cognitive impairment at an average age of approximately 70 years
Language Barriers
Language Barriers
Individuals who speak languages other than the dominant language in their region may face challenges understanding recipes or ingredient labels
Significant portion of the global population is likely to encounter language barriers in various aspects of life
Individuals who speak languages other than the dominant language in their region may face challenges understanding recipes or ingredient labels
Significant portion of the global population is likely to encounter language barriers in various aspects of life
Accessibility Personas
Accessibility Personas
Ron
Ron
About the persona
About the persona
Age: 62, retired
Sight impaired (partially sighted)
Uses a screen magnifier and changes colours to increase contrast
Age: 62, retired
Sight impaired (partially sighted)
Uses a screen magnifier and changes colours to increase contrast
Accessibility Needs:
Accessibility Needs:
Requires recipes in formats with larger font sizes, high contrast, and minimal reliance on visual elements.
Prefers text-to-speech functionality for recipe content.
Seeks alternative methods to identify ingredients, such as tactile labels, colour-coded markers, or auditory cues.
May benefit from a system providing auditory cues for locating different areas within the kitchen.
Requires recipes in formats with larger font sizes, high contrast, and minimal reliance on visual elements.
Prefers text-to-speech functionality for recipe content.
Seeks alternative methods to identify ingredients, such as tactile labels, colour-coded markers, or auditory cues.
May benefit from a system providing auditory cues for locating different areas within the kitchen.
Julia
Julia
About the persona
About the persona
Age: 34-year-old social worker
A profoundly deaf user
Uses British Sign Language as his main language, and English is his second language, always has video captions switched on
Age: 34-year-old social worker
A profoundly deaf user
Uses British Sign Language as his main language, and English is his second language, always has video captions switched on
Accessibility Needs:
Accessibility Needs:
Appreciates visual signifiers or notifications to alert about important events.
Values customization options for caption appearance, such as font size, colour, and background.
May benefit from a system that recognizes and identifies sounds such as a finished baking alarm also providing extra safety measures.
Appreciates visual signifiers or notifications to alert about important events.
Values customization options for caption appearance, such as font size, colour, and background.
May benefit from a system that recognizes and identifies sounds such as a finished baking alarm also providing extra safety measures.
David
David
About the persona
About the persona
Age: 20, student
An autistic user
adjusts things to reduce potential stress and distractions
Age: 20, student
An autistic user
adjusts things to reduce potential stress and distractions
Accessibility Needs:
Accessibility Needs:
Requires an option for a sensory-friendly mode that adjusts colour schemes and reduces visual complexity
Requires an organized and intuitive layout to reduce cognitive load during recipe exploration and cooking.
Values feature that allows personalization of the app's layout based on individual preferences.
Appreciates turning off unnecessary sounds and distractions during the cooking process.
Requires an option for a sensory-friendly mode that adjusts colour schemes and reduces visual complexity
Requires an organized and intuitive layout to reduce cognitive load during recipe exploration and cooking.
Values feature that allows personalization of the app's layout based on individual preferences.
Appreciates turning off unnecessary sounds and distractions during the cooking process.
Key Challenges
Key Challenges
Individuals with sight challenges often encounter difficulties in reading recipes, identifying ingredients, and following visual cues in a traditional kitchen setting. Printed text may be too small, and visual details may not be accessible.
Individuals with sight challenges often encounter difficulties in reading recipes, identifying ingredients, and following visual cues in a traditional kitchen setting. Printed text may be too small, and visual details may not be accessible.
One of the significant challenges faced by deaf individuals is the reliance on auditory alerts for critical information, such as timers, alarms, and notifications. Deaf individuals may encounter difficulties in monitoring the progress of cooking, leading to potential safety hazards. Timers and alarms designed for auditory cues may go unnoticed
One of the significant challenges faced by deaf individuals is the reliance on auditory alerts for critical information, such as timers, alarms, and notifications. Deaf individuals may encounter difficulties in monitoring the progress of cooking, leading to potential safety hazards. Timers and alarms designed for auditory cues may go unnoticed
Individuals on the autism spectrum may experience sensory sensitivities, cognitive differences, and challenges related to communication. Traditional kitchen environments with bright lights, loud sounds, and complex instructions can be overwhelming.
Individuals on the autism spectrum may experience sensory sensitivities, cognitive differences, and challenges related to communication. Traditional kitchen environments with bright lights, loud sounds, and complex instructions can be overwhelming.
How Vision Pro can leverage accessibility
How Vision Pro can leverage accessibility
Vision
Vision
Magnification for Ingredient Labels
Magnification for Ingredient Labels
A magnification feature for reading ingredient labels on packages. Users can use mixed reality to zoom in on text and obtain clear, magnified views of important information.
A magnification feature for reading ingredient labels on packages. Users can use mixed reality to zoom in on text and obtain clear, magnified views of important information.
Ingredient Recognition
Ingredient Recognition
Users can point their device at an item, and the mixed reality system can provide spoken information about the ingredient.
Users can point their device at an item, and the mixed reality system can provide spoken information about the ingredient.
Hearing
Hearing
Visual Alerts for Timers
Visual Alerts for Timers
Instead of relying solely on auditory timers, implement visual alerts using mixed reality. Users can receive on-screen notifications.
Instead of relying solely on auditory timers, implement visual alerts using mixed reality. Users can receive on-screen notifications.
Visual Feedback for Sound Intensity
Visual Feedback for Sound Intensity
Visual representations of sound intensity levels in the kitchen. This can help users be aware of noises like boiling water or sizzling, enhancing their situational awareness during the cooking process.
Visual representations of sound intensity levels in the kitchen. This can help users be aware of noises like boiling water or sizzling, enhancing their situational awareness during the cooking process.
Cognitive
Cognitive
Focus on Relevant Information
Focus on Relevant Information
identify and highlight essential elements, such as ingredients, utensils, and cooking instructions. This helps users focus on what's relevant, reducing distractions and cognitive overload.
identify and highlight essential elements, such as ingredients, utensils, and cooking instructions. This helps users focus on what's relevant, reducing distractions and cognitive overload.
Customizable Blur Levels
Customizable Blur Levels
Customizable blur levels based on user preference. Some individuals may prefer a minimal blur, while others may benefit from a higher level to minimize distractions effectively.
Customizable blur levels based on user preference. Some individuals may prefer a minimal blur, while others may benefit from a higher level to minimize distractions effectively.
Step-by-Step Guidance
Step-by-Step Guidance
Step-by-step guidance system that progressively reveals information. As users move through the cooking process, the mixed reality system can selectively blur or reveal elements to guide them through each step.
Step-by-step guidance system that progressively reveals information. As users move through the cooking process, the mixed reality system can selectively blur or reveal elements to guide them through each step.
Ingredient Recognition
Ingredient Recognition
Object recognition technology can identify and highlight specific ingredients. This can help users locate ingredients easily and ensure they are using the correct items during the cooking process. This also aids in clear identification and reduces the cognitive load associated with processing visual information
Object recognition technology can identify and highlight specific ingredients. This can help users locate ingredients easily and ensure they are using the correct items during the cooking process. This also aids in clear identification and reduces the cognitive load associated with processing visual information
How I'd like to continue this project
How I'd like to continue this project
Evaluate what the potential impact could be on users needing this type of assistive technology
Confirm actual needs with assumptions
Confirm what is achievable on the Apple device and what accessibility options are available automatically
Discuss the broader societal impact
Evaluate what the potential impact could be on users needing this type of assistive technology
Confirm actual needs with assumptions
Confirm what is achievable on the Apple device and what accessibility options are available automatically
Discuss the broader societal impact
Concept screns & Fin.
Concept screens
