.png)
timbre
a plug-in tool that empowers every online meeting attendees to confidently participate, acknowledge one another, and foster emotional connections
client/audience
AImpower
timeframe
Aug 2023 - Dec 2023
role
UX Designer
Project Manager
Current online conference programs are not tailored to accommodate users who need more time to speak, such as individuals who have speech disfluencies, which potentially affects their willingness to participate due to discomfort.
Hence, the goal of this project is to enhance communications, foster connections among meeting participants, and facilitate smoother turn-taking through a user-friendly interaction flow within existing video conferencing products. Our solution aims to alleviate stress and anxiety experienced by people who stutter (PWS), ensuring they feel confident and respected rather than self-conscious when participating in meetings.
The Overview
Project Journey
The Problem
In our research, we identified two primary obstacles the target users face during online meetings: firstly, the fear of speaking among PWS users, and secondly, the additional hurdles introduced by the mechanics of online meetings.
the common fear of speaking which can arise simply from the idea of speaking or even just the anticipation of speaking
the additional hurdles introduced by the mechanics of online meetings, which further induce fear
Literature Review Insights
User Interview Insights
another problem identified:
the lack of awareness among listeners regarding the nature and cause of speech disfluencies, which is also the root cause of misunderstandings, misinterpretations, negative or inappropriate reactions that pushes PWS users into the vicious cycle
another problem identified:
the lack of awareness among listeners regarding the nature and cause of speech disfluencies, which is also the root cause of misunderstandings, misinterpretations, negative or inappropriate reactions that pushes PWS users into the vicious cycle
The Solution Space: 2 Main Missed Opportunities
Most of current solution focuses on providing speech support techniques to enhance fluency which overlooks the significance of emotional support. Having a stronger perception of support and connection is crucial in helping PWS users overcome their self-doubt and build confidence in their communications.
None of the existing solutions embrace a balanced focus to support both listeners and speakers. Communication is a two-way process: in addition to enhancing fluency of the speaker, it is important to inform listeners about ways to be supportive. It is only in this way together can they foster a safe and inclusive environment that supports the speakers and normalizes stuttering.
Emotional Connection
Involving Listeners and Bridging Support Gaps
The Problem Statement Revised
fearing negative listener reactions and judgment from others
Despite the increasing reliance on video conferencing for communication in professional, educational, and social settings, PWS users face unique challenges that impact their ability to participate fully:
other participant's lack of awareness and knowledge about speech disfluencies, coupled with a lack of guidance on appropriate and supportive behaviour
complexities introduced by video conferencing, such as the recognition of speech disfluencies, hindered orderly turn-taking, and unintentional or premature disruptions
Design Directions
Increase awareness
encourage PWS users to disclose within their comfort level
introduce and educate meeting participants on speech disfluencies
create an environment that normalizes stuttering
provide timely positive feedback
Reduce fears and anxieties
reduce interruptions through effective turn-taking
assist users in articulating ideas more clearly
Foster effective communication
An assistive tool that promotes speech disfluency awareness, encourages disclosure, and fosters effective communication, all while reducing speaker anxieties and enhancing speaking experience.
The Gist: design idea one-liner
Following the outlined design directions, our team collaborated to generate ideas, initially honing in on five features aimed at addressing the target user's pain points.
The Initial Prototypes
During the meeting, the user wants to contribute to the discussion. They select the "Raise Hand" button that includes a specific message: "I would like to follow up on the upcoming project deadline", indicating the topic they intend to discuss.
Scenario 1
As the user starts speaking, the speech flow animation automatically activates, reassuring them that their voice is being recognized as the flow becomes visible to all participants. After they finish, a "Great insights!" message pops up on their screen, which boosts their confidence to participate again in the meeting.
Scenario 2
Once the user completes their
contribution to the discussion, they click
on the "I'm Done" button, announcing that they have finished their turn, allowing for smoother turn-taking in the conversation flow.
Scenario 3
For smoother communication in future meetings, the user has turned on a virtual background which displays the information: "PWS (People Who Stutter)", subtly informing others without the need for an explicit mention.
Scenario 4
User Scenarios
During the meeting, the user wants to contribute to the discussion. They select the "Raise Hand" button that includes a specific message: "I would like to follow up on the upcoming project deadline", indicating the topic they intend to discuss.
Scenario 1
As the user starts speaking, the speech flow animation automatically activates, reassuring them that their voice is being recognized as the flow becomes visible to all participants. After they finish, a "Great insights!" message pops up on their screen, which boosts their confidence to participate again in the meeting.
Scenario 2
Once the user completes their
contribution to the discussion, they click
on the "I'm Done" button, announcing that they have finished their turn, allowing for smoother turn-taking in the conversation flow.
Scenario 3
For smoother communication in future meetings, the user has turned on a virtual background which displays the information: "PWS (People Who Stutter)", subtly informing others without the need for an explicit mention.
Scenario 4
User Scenarios
User Scenarios
During the meeting, the user wants to contribute to the discussion. They select the "Raise Hand" button that includes a specific message: "I would like to follow up on the upcoming project deadline", indicating the topic they intend to discuss.
Scenario 1
As the user starts speaking, the speech flow animation automatically activates, reassuring them that their voice is being recognized as the flow becomes visible to all participants. After they finish, a "Great insights!" message pops up on their screen, which boosts their confidence to participate again in the meeting.
Scenario 2
Once the user completes their
contribution to the discussion, they click
on the "I'm Done" button, announcing that they have finished their turn, allowing for smoother turn-taking in the conversation flow.
Scenario 3
For smoother communication in future meetings, the user has turned on a virtual background which displays the information: "PWS (People Who Stutter)", subtly informing others without the need for an explicit mention.
Scenario 4
Thinking Out Loud
To evaluate our features, our team used mid-fi prototypes and assigned users tasks, incorporating the think-aloud approach. The testing process focused on understanding the user's thought process as they navigated through the product. Therefore, as users progressed through the tasks, we asked them to speak their thoughts, even if the action seemed obvious. Here is the feedback we received:
To evaluate our features, our team used mid-fi prototypes and assigned users tasks, incorporating the think-aloud approach. The testing process focused on understanding the user's thought process as they navigated through the product. Therefore, as users progressed through the tasks, we asked them to speak their thoughts, even if the action seemed obvious. Here is the feedback we received:
Thinking Out Loud
Final Features
Key Feature No.2
Key Feature No.1
Key Feature No.3:
Key Feature No.4:
Raise Hand+
-
prepares both speakers and listeners
-
facilitates smoother speech and reduces mental and emotional strain associated with verbal participation
-
helps to express the desire to speak, ask questions, or agree using explicit textual inputs
Changes Made
-
provided the option to input custom messages in addition to the default messages provided
Key Feature No.2:
Affirmative Messages
facilitates support and positivity among all meeting participants
offers real-time encouragement from the system and provides option to show bidirectional support, allowing participants to both receive support while speaking and offer it to others who are speaking
Changes Made
-
affirmative messages will randomly shuffle when users opt to reward themselves after speaking
-
meeting participants are now encouraged to leave positive feedback for others
Speak Signal
-
reduce the amount of effort experienced to take and finish one’s turn in meetings
-
indicate the end of a turn by using a visual "I'm done!" cue
Changes Made
-
the "my turn" button has been removed to reduce cognitive load when speaking
PWS Disclosure
-
facilitates support and positivity among all meeting participants
-
helps inform other meeting participants by optionally adding a "PWS" tag or sharing more information as a chat
Changes Made
-
included the option to activate/deactivate disclosure at the user's comfort
-
introduced a more discreet option for disclosure through tagging
Final Features
The Final Idea:
timbre
tim·bre
/ˈtæmbɚ/
noun
: refers to the unique quality and character of a sound in speech or music
an in-app plugin tool that empowers you to embrace the uniqueness of your voice
The Interaction
PWS Disclosure
Let other meeting participants know if you might need more time speaking and composing your thoughts by disclosing at your comfort!
Speak Signal
Indicate the end of your turn by using a cue.
Raise Hand+
Provide context for yourself and other meeting participants before speaking by raising your hand
with a (customizable) message.
Affirmative Messages
Positively reinforce yourself or other meeting participants for speaking each time!
Although the project began with a unique focus on PWS, its final outcome celebrates diverse communication styles, not only benefiting PWS but
also promoting an effective video-conferencing experience for all.
All features (with the exception of
the disclosure feature) extend beyond catering solely to individuals with speech disfluencies, offering oratory enhancement to all meeting participants, thereby fostering a more inclusive and effective communication environment during video conferences.
Inclusive design goes beyond merely incorporating diverse or inclusive features; it necessitates a thoughtful consideration of how the design can comprehensively ensure 100% the comfort and accessibility of every user. This entails not only accommodating various abilities, backgrounds, and preferences but also fostering an environment where every individual feels welcomed, valued, and able to engage with the design effortlessly. This means avoiding assumptions about users' knowledge or experiences and designing in a way that is sensitive to different cultural norms, languages, and communication styles.
Recognize the Impact
Beyond the Intended Audience
Recognize Individual
Needs and Comfort
+
Inclusive Design
The Reflection
