OpenAI has expressed worries about the possibility of users becoming overly reliant on ChatGPT for companionship, leading to potential 'dependence,' due to its new human-sounding voice mode. This concern was highlighted in a recent report released by OpenAI following a safety review of the tool and the underlying large language AI model it operates on.
The advanced voice mode of ChatGPT is designed to sound remarkably lifelike, responding in real-time, adjusting to interruptions, and mimicking human conversational cues such as laughter and thoughtful 'hmms.' Moreover, it can even gauge a speaker's emotional state based on their tone of voice.
Upon the announcement of this feature earlier this year, comparisons were drawn between ChatGPT and the AI digital assistant in the movie 'Her,' where the protagonist develops a romantic attachment to the AI. OpenAI observed users engaging with ChatGPT's voice mode in ways that suggested forming 'shared bonds' with the tool, raising concerns about potential social relationships developing and impacting human interaction.
The report also points out the broader risks associated with artificial intelligence, emphasizing how tech companies are rapidly deploying AI tools without a full understanding of their implications. Users often find novel uses for these tools, leading to unintended consequences.
Some individuals have already reported forming romantic connections with AI chatbots, prompting experts to caution against deep emotional ties with evolving technology. Ethical considerations are paramount as companies navigate this uncharted territory, with concerns about users developing emotional reliance on AI tools.
OpenAI acknowledges the potential influence of human interactions with ChatGPT's voice mode on social norms, as the AI's deferential behavior, allowing users to interrupt at any time, contrasts with typical human interactions.
As OpenAI continues to prioritize the safe development of AI, it remains committed to studying the impact of emotional reliance on its tools and the evolving dynamics of human-AI relationships.
