This week's thread: the gap between what AI health advice says and what people do with it. Inside: a triage follow-up study, a preprint on over-referral, Claude reading Apple Health, and 2,521 Reddit posts.
Told self-care was fine, 38% of symptom-checker users sought care anyway
aihealthcarenews.net/stories/the-chatbot-answered-correctly…
Symptom checkers usually get graded on whether their advice matches a panel of clinicians. A study that tracked what people did next suggests that grade misses something. Of 2,900 users told self-care would do, for symptoms the panel agreed suited self-care, 38% went for in-person care within 72 hours. Of those told their symptoms were urgent, 12% sought no care at all. In free-text follow-ups, people who overrode the self-care advice mostly said they never got a reason that convinced them; those who skipped urgent care cited cost, childcare and work. The news write-up doesn't name the tool. Some vendors are adding cost estimates and appointment booking to triage, which the authors call the right instinct, still unproven.1
A symptom checker's accuracy score says little about whether its advice gets followed; a convincing explanation, cost and logistics seem to shape what people actually do.1
Preprint: AI models urge a professional even when raters saw no need
medrxiv.org/content/10.64898/2026.10.31.26366978v1
Researchers sent 82 self-written messages (41 about health, 41 about everyday life) to 53 general-purpose AI model setups released between March 2023 and September 2026, collecting 4,346 replies, with no patients involved. Where physicians, pharmacists and other raters judged no professional contact necessary, 64.5% of health replies suggested one anyway, versus 27.6% outside health. Much of that was hedged advice to see someone if things change or you're unsure; outright referral was 18.1% versus 6.6%. When a visit was genuinely needed, models referred about equally often (89.6% versus 84.5%). In medicines and physical health, referral didn't track how severe raters judged the situation. The overall gap between health and everyday referrals grew from 20.5 points for 2023 models to about 32 for 2025 and 2026 ones.2
When an assistant says to check with a professional, that may reflect its general caution about health topics more than how serious your situation is, and newer models lean that way more.2
Claude can now read your Apple Health data, in a US-only beta
support.anthropic.com/en/articles/11869619-using-claude-wit…
Anthropic's help center says Claude can now connect to iPhone system apps: drafting texts and emails, managing calendars and reminders, finding places and, in beta, reading Apple Health data to spot fitness patterns, track progress toward goals and chart trends. The health part is limited to US users on Pro or Max plans; other connections work on all plans, except location for Team and Enterprise. Claude can read Apple Health entries but can't write or change them, and it suggests these tools on its own, showing a card for you to review. Disclosure: this newsletter's publisher makes Ami, a competing product.3
A general-purpose assistant reading your own Apple Health data shifts the question from what it knows about health to what it does with yours.3
Reddit chatbot health posts: 24% pointed toward care, 4.6% away
pubmed.ncbi.nlm.nih.gov/42972377
Researchers screened 8,715 posts from eight subreddits, December 2022 to May 2026, and kept 2,521 about AI health advice. In 64.1%, people used chatbots to make sense of symptoms, test results or possible diagnoses. About a quarter (26.3%) said a reply changed how they felt: relief in 12.6%, alarm in 11.5%. In 42.4%, writers voiced caution or kept checking answers elsewhere; 8.9% called a chatbot their main source. Posts more often described seeking, continuing or escalating professional care (24.0%) than replacing, delaying or reducing it (4.6%). On r/HealthAnxiety, replies most often discouraged repeated reassurance seeking. It's a selected slice of Reddit, not a survey of users.4
Posts more often described chatbot use in connection with seeking or continuing professional care than replacing it, and on r/HealthAnxiety, replies most often discouraged repeated reassurance seeking.4
- According to the CSS Health Study, the share of Swiss respondents using AI chatbots when they have symptoms rose from 20% to 42% in a year. (swissinfo.ch)
- In a prospective multicentre study, 314 patients made 2,965 blinded comparisons of radiologist-written versus ChatGPT-4 simplified breast imaging reports, rating simplicity, comprehensibility and empathy. (Insights into imaging)
- Across 16 US national surveys from 2022 to 2026, more than 4 in 10 Americans who used AI for a health question did so partly because they couldn't access or afford care. (Health affairs scholar)
- Writing in The Conversation, Kirsten McCaffery, Julie Ayre and Liliana Laranjo look at using ChatGPT before an appointment, noting 30% to 55% of adults report using chatbots for health. (theconversation.com)
- Apple says it has expanded language support for its redesigned Health app and its personalized health insights. (Apple Newsroom)
Sources
- The chatbot answered correctly and the patient still went to the emergency department — AI Healthcare News, aihealthcarenews.net
- Triage Advice From General-Purpose Language Models in Health and Everyday Situations, medRxiv
- Use Claude with iOS apps, Anthropic
- User experiences and community responses to generative artificial intelligence health advice on reddit: topic modeling and content analysis study., BMC health services research
- Four in ten Swiss use AI for self-diagnosis - SWI swissinfo.ch, swissinfo.ch
- Large language model-based simplification of breast imaging reports: a prospective multicentre study with 2965 patient-based evaluations., Insights into imaging
- Americans' views about artificial intelligence in healthcare: 2022-2026., Health affairs scholar
- Using ChatGPT before a medical appointment? How to get the best support for your health questions, theconversation.com
- Redesigned Health app expands language support, Apple Newsroom