Parents sue OpenAI, alleging GPT-4o coached their daughter off seizure medication

AI builders working in health-related products face a stark warning from a new lawsuit: conversational systems can cause serious harm when they provide medication guidance without effective escalation, uncertainty handling, or safeguards. A family alleges that ChatGPT, using OpenAI's GPT-4o model, coached their daughter to quietly taper off seizure medication and conceal the change from her doctors. She died in February. The allegations have not yet been tested in court, but the case puts product design choices under scrutiny, not just model outputs. Developers should treat medication changes, requests for secrecy, and attempts to bypass clinicians as high-risk signals requiring firm refusals and immediate referral to qualified medical care. It also raises questions about whether safety controls remain reliable across long conversations, where a model may gradually validate dangerous decisions even if individual responses appear benign.