The Rise of AI in Healthcare: Better Questions, Better Conversations, and the Evidence Behind the Promise

Understand where healthcare AI may help, where it can fail, and how Human Health Strategies helps patients turn information into better questions and care conversations.

Human Health Strategies® editorial team · 33 min read · Published

Evidence Summary

  • “Healthcare AI” is not one intervention. A regulated tool that analyzes retinal images for one defined purpose, a hospital mortality-risk alert, an ambient note writer, a navigation platform, and a public general-purpose chatbot have different users, evidence, controls, and risks. Results from one cannot be transferred automatically to another. [2] [3]
  • Accuracy is not the same as a better health outcome. A model can classify images well without showing that patients live longer, feel better, avoid disability, or receive safer care. Process outcomes—such as completed screening or better documentation—can matter, but should be named as process outcomes.
  • One pragmatic randomized AI-ECG trial measured a hard outcome. In a patient-level randomized trial of 15,965 hospitalized patients at two Taiwan hospitals (8,001 intervention; 7,964 control), an AI risk alert plus clinician response was associated with 90-day all-cause mortality of 3.6%, versus 4.3% with usual care (hazard ratio 0.83, 95% CI 0.70–0.99; p=0.040). This was evidence for the complete alert-and-response workflow in that setting, not proof that an algorithm by itself saves lives or that every AI alert will do so. The trial did not report a comprehensive adverse-event comparison. [4]
  • The 2026 MASAI mammography analysis demonstrated noninferiority, not significant superiority, for its primary endpoint. Interval-cancer rates were 1.55 versus 1.76 per 1,000; the ratio was 0.88 (95% CI 0.65–1.18; p=0.41), meeting the trial's noninferiority criterion. Sensitivity was higher and specificity was the same, but mortality was not established and the primary comparison did not prove superiority. [5]02464-X/fulltext)
  • AI can improve access and workflow without yet proving less illness. In the ACCESS randomized trial, all 81 young people assigned to point-of-care autonomous diabetic-eye screening completed the exam, compared with 18 of 82 in the referral-and-education arm. That is a major screening-completion result, not 100% diagnostic accuracy and not proof that blindness was prevented. [6]
  • Expertise changes reliance, but it does not create immunity. In a 2026 online dermatology experiment, AI assistance improved average performance for both lay participants and primary care physicians. Lay participants were especially vulnerable to persuasive text explanations when the supplied AI prediction was wrong; presenting AI first also increased deference patterns. The study tested decisions on curated images, not real-world patient outcomes. [7]
  • Named stories can illuminate a pathway, not estimate benefit. In the public accounts of Alex Hofmann, Barbara, and Sheila Tooth, AI suggested or flagged something that clinicians then evaluated. The stories differ in source quality and follow-up, and none proves how often AI helps, harms, misses disease, or improves survival. [8] [9] [10]
  • Governance is part of safety. WHO emphasizes autonomy, human well-being and safety, transparency, accountability, inclusion and equity, and responsive, sustainable systems. Intended use, privacy, population-specific validation, monitoring, and a genuine ability for humans to challenge an output are not administrative extras. [11] [2]
  • General chatbots deserve special caution. A systematic review of 137 health-advice chatbot studies found pervasive model/version opacity and frequent subjective performance definitions. Fluent wording is not a reliability certificate, and a consumer prompt may reveal sensitive health information. [12]

Human Health Strategies® | Patient and family education | Evidence reviewed September 23, 2026

Artificial intelligence can identify a pattern in an image, summarize a long record, predict a risk, draft a note, or answer a question in fluent prose. Those abilities are real. They are also easy to confuse with something much larger: understanding a whole person, making a diagnosis, choosing care, or proving that health will improve.

The most useful question is therefore not, “Is medical AI good or bad?” It is: What exact task is this system doing, for whom, under what safeguards, and what kind of evidence shows that it helps?

This guide follows that question from randomized trials to three public patient stories, from regulated clinical tools to general chatbots, and from impressive accuracy statistics to outcomes that patients actually experience. It also offers a practical way to use AI for its most defensible patient-facing purpose: organizing information and preparing a better conversation with a licensed healthcare professional.

Human Health Strategies® (HHS) publishes this guide and operates an AI-assisted health-navigation platform discussed in a clearly labeled section below. That is a promotional relationship. Product descriptions are based on HHS's public pages and current implementation; they are not evidence that HHS improves clinical outcomes. The guide has not undergone independent clinical review.

Important: This guide and the HHS platform are educational. They do not diagnose, treat, prescribe, interpret a medical document clinically, or monitor a patient for deterioration. AI output can be wrong, incomplete, outdated, or falsely reassuring. Do not delay urgent care or professional advice because of an AI response. In the United States, call 911 for a medical emergency; elsewhere, use the local emergency number. [1]

Evidence Summary

  • “Healthcare AI” is not one intervention. A regulated tool that analyzes retinal images for one defined purpose, a hospital mortality-risk alert, an ambient note writer, a navigation platform, and a public general-purpose chatbot have different users, evidence, controls, and risks. Results from one cannot be transferred automatically to another. [2] [3]
  • Accuracy is not the same as a better health outcome. A model can classify images well without showing that patients live longer, feel better, avoid disability, or receive safer care. Process outcomes—such as completed screening or better documentation—can matter, but should be named as process outcomes.
  • One pragmatic randomized AI-ECG trial measured a hard outcome. In a patient-level randomized trial of 15,965 hospitalized patients at two Taiwan hospitals (8,001 intervention; 7,964 control), an AI risk alert plus clinician response was associated with 90-day all-cause mortality of 3.6%, versus 4.3% with usual care (hazard ratio 0.83, 95% CI 0.70–0.99; p=0.040). This was evidence for the complete alert-and-response workflow in that setting, not proof that an algorithm by itself saves lives or that every AI alert will do so. The trial did not report a comprehensive adverse-event comparison. [4]
  • The 2026 MASAI mammography analysis demonstrated noninferiority, not significant superiority, for its primary endpoint. Interval-cancer rates were 1.55 versus 1.76 per 1,000; the ratio was 0.88 (95% CI 0.65–1.18; p=0.41), meeting the trial's noninferiority criterion. Sensitivity was higher and specificity was the same, but mortality was not established and the primary comparison did not prove superiority. [5]02464-X/fulltext)
  • AI can improve access and workflow without yet proving less illness. In the ACCESS randomized trial, all 81 young people assigned to point-of-care autonomous diabetic-eye screening completed the exam, compared with 18 of 82 in the referral-and-education arm. That is a major screening-completion result, not 100% diagnostic accuracy and not proof that blindness was prevented. [6]
  • Expertise changes reliance, but it does not create immunity. In a 2026 online dermatology experiment, AI assistance improved average performance for both lay participants and primary care physicians. Lay participants were especially vulnerable to persuasive text explanations when the supplied AI prediction was wrong; presenting AI first also increased deference patterns. The study tested decisions on curated images, not real-world patient outcomes. [7]
  • Named stories can illuminate a pathway, not estimate benefit. In the public accounts of Alex Hofmann, Barbara, and Sheila Tooth, AI suggested or flagged something that clinicians then evaluated. The stories differ in source quality and follow-up, and none proves how often AI helps, harms, misses disease, or improves survival. [8] [9] [10]
  • Governance is part of safety. WHO emphasizes autonomy, human well-being and safety, transparency, accountability, inclusion and equity, and responsive, sustainable systems. Intended use, privacy, population-specific validation, monitoring, and a genuine ability for humans to challenge an output are not administrative extras. [11] [2]
  • General chatbots deserve special caution. A systematic review of 137 health-advice chatbot studies found pervasive model/version opacity and frequent subjective performance definitions. Fluent wording is not a reliability certificate, and a consumer prompt may reveal sensitive health information. [12]

1. First, separate three very different kinds of AI

The phrase “AI in healthcare” compresses too many things into one label. A safer mental model has three broad categories.

Targeted clinical or regulated tools

A targeted tool has a defined intended use: flag a particular finding on a mammogram, estimate deterioration risk from an ECG, detect diabetic retinopathy from retinal images, or help triage a specified set of studies. It may be a medical device or a component of one, depending on its function and jurisdiction. It can be tested against a reference standard, integrated into a clinical workflow, limited to trained users, audited, and monitored after release.

“Regulated” does not mean infallible, and “AI-enabled” does not itself mean superior. Performance may change with scanners, prevalence, demographics, clinical practice, image quality, or a software update. A tool can be excellent for one task and irrelevant to another. The right questions concern the exact version, intended population, comparator, failure modes, and action that follows its output. WHO's regulatory guidance accordingly stresses lifecycle documentation, external validation, intended use, and post-deployment oversight. [3]

Some targeted tools operate autonomously for a narrow task. In ACCESS, for example, a point-of-care autonomous system produced a diabetic-eye screening result without requiring a specialist to interpret every image first. That narrow autonomy is not equivalent to an AI practicing general medicine. The intervention was embedded in a pediatric diabetes center with a defined referral pathway. [6]

General-purpose chatbots

A general chatbot is built to generate language across many domains. It can explain terminology, help summarize notes, suggest questions, and compare concepts. It can also fabricate a citation, omit a dangerous possibility, misunderstand chronology, give a confident answer from incomplete data, or reinforce the way a user framed the problem.

A chatbot does not examine the patient, observe breathing or gait, palpate an abdomen, reconcile a complete medication list, verify a document's authenticity, or automatically know which facts were omitted. Even when it can analyze an uploaded image or file, its answer is not thereby a clinical interpretation. General-purpose fluency should not be mistaken for a defined diagnostic device.

The 2025 systematic review of chatbot health-advice studies shows why broad claims remain difficult. Of 137 included studies, 136 evaluated closed-source models without enough information to identify the tested version, 89 used subjective definitions of success, and fewer than one-third addressed ethical, regulatory, and patient-safety implications. The search ended in October 2023 and much of the research used hypothetical cases, so this is primarily evidence about a weak and opaque evaluation literature—not a pooled verdict on every current model. [12]

Navigation and preparation tools

A navigation tool has a different job. It can organize a condition summary, turn unfamiliar terms into questions, maintain a user-entered timeline, and produce material to review with a professional. Its value proposition is not autonomous diagnosis. It is reducing the cognitive burden between visits and helping a patient express goals, risks, priorities, and uncertainties.

That distinction matters. A question builder can be useful even if it has never been shown to improve mortality. A plain-language summary can make a conversation easier while still requiring verification. Navigation is not clinical monitoring: a log does not watch a patient, interpret a trend safely, or alert an emergency team unless a validated system is specifically designed and operated to do those things.

2. The evidence ladder: from a correct answer to a better life

Medical AI claims often climb an evidence ladder without acknowledging the missing rungs.

  1. Technical performance: Can the model process an input and generate an output?
  2. Accuracy: How often does it match a reference standard, and by which measure—sensitivity, specificity, calibration, positive predictive value, or something else?
  3. Human-AI performance: Does a clinician or patient make a better decision with the tool than without it?
  4. Workflow and access: Does it reduce reading burden, complete more screenings, improve documentation, shorten a delay, or reach people previously missed?
  5. Patient outcomes: Does it reduce symptoms, complications, disability, hospitalization, or death, or improve quality of life?
  6. Long-term system effects: Does benefit persist without inequity, alert fatigue, deskilling, privacy harm, excess testing, or unaffordable burden?

Each rung can matter. But they are not synonyms.

The AI-ECG trial: a rare hard-outcome result

Lin and colleagues conducted a pragmatic, patient-level randomized clinical trial involving 39 attending physicians and 15,965 hospitalized patients at two hospitals in Taiwan. The randomized groups included 8,001 intervention and 7,964 control patients. In the intervention, clinicians received an AI-generated ECG report and a one-time warning when the ECG indicated high mortality risk. The registered primary endpoint was 90-day all-cause mortality: 3.6% in the intervention group and 4.3% in usual care, corresponding to a hazard ratio of 0.83 (95% CI 0.70–0.99; p=0.040). In the prespecified high-risk strata—709 intervention and 688 control patients—the association was stronger (HR 0.69, 95% CI 0.53–0.90). [4]

This is stronger evidence than a retrospective accuracy comparison because patients were prospectively randomized and death was measured. Precision still matters: the overall confidence interval only narrowly excluded no difference. The trial did not register adverse events as an outcome or provide a comprehensive adverse-event comparison, so it cannot establish “no harms.” Among high-risk patients, alerts were associated with more ICU admission (HR 1.40, 95% CI 1.06–1.85), amiodarone treatment (HR 1.58, 1.19–2.10), echocardiography, and laboratory testing. Those actions may represent appropriate rescue care, but they are also where overtesting, treatment burden, cost, and iatrogenic harm could occur.

The tested intervention was a proprietary model inside an alert-and-response workflow; clinician attention and ensuing care were part of the intervention. ECGs were ordered for clinical reasons rather than at fixed intervals, and benefit may depend on the alert threshold, local staffing, rapid-response resources, and clinician behavior. The trial took place overwhelmingly at one academic center within a two-hospital, one-country setting. Model weights were unavailable, and the paper disclosed that the institution had licensed the algorithm and that multiple authors could benefit financially from some uses outside Taiwan's military hospitals. Replication and independent transportability testing matter. [4]

The defensible statement is: this particular AI alert plus clinician-response workflow reduced 90-day mortality in this trial population. “AI-ECG saves lives” is too broad.

MASAI: clinically important, but not a superiority result

The final primary analysis of the Swedish MASAI randomized trial included 105,934 women. AI triaged mammograms to single or double reading and provided detection support; the control used standard double radiologist reading. The protocol-defined primary endpoint was the rate of cancers diagnosed between screening rounds, assessed with a 20% noninferiority margin. [5]02464-X/fulltext)

Interval-cancer rates were 1.55 per 1,000 with AI-supported screening and 1.76 per 1,000 with standard double reading. The proportion ratio was 0.88, with a 95% confidence interval from 0.65 to 1.18 and p=0.41. Noninferiority was established because the interval's upper bound, 1.18, remained below the prespecified 1.20 margin. The p=0.41 result does not establish superiority; the observed 12% lower rate remains descriptive. Sensitivity was higher—80.5% versus 73.8%—and specificity was 98.5% in both groups. Some clinically concerning interval-cancer categories were descriptively lower, but the trial did not establish fewer breast-cancer deaths or fewer deaths overall. [5]02464-X/fulltext)

This distinction is not wordplay. A favorable point estimate can coexist with uncertainty that includes no difference. Higher sensitivity can find more cancer, but whether that becomes longer or better life depends on tumor biology, treatment, false positives, overdiagnosis, and follow-up. MASAI supports a specific Swedish screening workflow; it does not prove that every mammography AI, screening interval, or health system will reproduce the result.

ACCESS: closing a gap is not the same as preventing blindness

The ACCESS trial randomized young people ages 8 to 21 at a pediatric diabetes center. All 81 participants assigned to a point-of-care autonomous AI eye examination completed screening within six months; 18 of 82 participants in the referral-plus-education control pathway did so. Among 25 intervention participants with an abnormal AI result, 16 completed follow-up with an eye-care professional. [6]

That 78-percentage-point difference in completed screening is substantial. Bringing the examination to the diabetes visit removed steps that often break a referral pathway. But “100%” described completion in this sample—not diagnostic accuracy, treatment success, or prevention of vision loss. The study did not demonstrate less retinopathy progression or blindness. It was single-center and included a system not then cleared for people 21 and younger, a regulatory limitation the authors identified.

Better notes are not automatically better outcomes

A 2026 pragmatic cluster-randomized trial across 16 primary-care facilities in Nairobi studied generative-AI decision support in 9,691 patients managed by 103 clinical officers. Treatment failure within 14 days occurred in 2.2% of intervention patients and 2.0% of controls; the adjusted odds ratio was 0.77 (95% CI 0.55–1.08; p=0.13). The prespecified primary outcome did not significantly differ. No intervention-related serious adverse event or safety signal was identified, but this was not a prespecified noninferiority safety trial and could not precisely exclude rare harms. [13]

The intervention improved sampled documentation measures, including appropriate diagnosis documentation, comprehensive notes, and appropriate treatment plans. Those are useful process improvements. They should not be rewritten as proof that patients recovered more often. The study's 14-day horizon, one private urban network, high baseline quality, and single model also constrain generalization.

These trials show the mature way to discuss promise: identify the endpoint, preserve the denominator and uncertainty, and refuse to convert process or accuracy into an outcome that was never measured.

3. Three real stories—and the limits of what stories can prove

Stories can show how AI enters a family's life. They cannot provide a comparison group, reveal missed cases, or tell us how often the same strategy would mislead someone else. The following public accounts are valuable because the AI's role can be separated from the clinician's role.

Alex Hofmann: a chatbot-generated possibility, then specialist confirmation

Alex Hofmann's mother, Courtney Hofmann, has publicly described years of pain and a constellation of motor and other symptoms, with consultations involving 17 doctors but no integrating diagnosis. She entered symptoms and information from MRI reports into ChatGPT. The chatbot suggested tethered cord syndrome. She researched that possibility and brought it to a pediatric neurosurgeon, Dr. Holly Gilmer, who reviewed the imaging and identified spina bifida occulta and a tethered cord. [14] [8]

In the accessible NEJM AI podcast transcript, Hofmann says surgery occurred six weeks after the chatbot interaction and describes a marked improvement in Alex. The episode identifies Gilmer as the surgeon who confirmed and treated the condition. This is a named parent-and-clinician account with treatment follow-up, but not a peer-reviewed case report or standardized outcome assessment. [8]

The chatbot's contribution was navigational: it generated a hypothesis from selected information that helped a persistent parent formulate a possibility and reach an appropriate expert. A specialist reviewed the actual imaging, made the diagnosis, and provided treatment. The story cannot show how often chatbot suggestions are right, how many unhelpful possibilities it generated, whether the condition would otherwise have gone undiagnosed, or what would have happened without it. It also illustrates a privacy decision: entering a child's report details into a consumer model can disclose sensitive health information.

Barbara: an AI flag in a mammography pilot, then treatment

BBC reported that, during an NHS Grampian pilot, the Mia mammography tool flagged Barbara's scan after the initial radiologist reading had not called the lesion. Human review remained part of every pilot case. Clinicians confirmed a 6 mm cancer, and the report says Barbara underwent surgery and five days of radiotherapy. [9]

The account documents a meaningful sequence for Barbara—Mia flagged the mammogram for human review; clinicians confirmed a 6 mm cancer, followed by surgery and radiotherapy—but it remains journalism about a pilot, not peer-reviewed population evidence. It provides no pathology detail, recurrence follow-up, survival outcome, or full false-positive and missed-cancer rates. Her less-invasive treatment than family members experienced is meaningful to her but does not establish that AI caused a better long-term outcome; the claim that the tumor otherwise would have remained undetected until the next three-year screen is an unobservable counterfactual.

Sheila Tooth: detection documented, treatment follow-up not reported

Sheila Tooth, age 68 in the BBC report, had initially received an all-clear after routine mammography. In a University Hospitals Sussex project, AI reviewed mammograms considered normal and recommended a subset for panel re-reading. Of more than 12,000 mammograms, just under 10% were recommended for re-read; 11 women were recalled, and five were found to have breast cancer. Further investigation confirmed Tooth's cancer. [10]

This story usefully shows the escalation pathway: AI recommendation, clinician-panel re-read, recall, and clinical investigation. It does not provide enough information to calculate sensitivity, specificity, or the later cancer rate among people not re-read. The report gives no treatment, recurrence, or survival follow-up for Tooth. Her concern that the lesion might have become invasive is understandable, but it remains a counterfactual.

Placed together, these stories show three possible roles: generating a hypothesis, flagging an image, and prioritizing a re-read. They do not show autonomous diagnosis, and they do not establish that diagnosis would have been impossible without AI. Alex's account reaches treatment and family-reported improvement; Barbara's reaches treatment without long-term outcome data; Sheila's documents detection without reported treatment follow-up. That difference should remain visible.

4. Why convincing explanations can make errors more dangerous

People naturally look for reasons. A colorful heat map, a similar image, or a polished paragraph can feel like a window into a model's reasoning. Sometimes explanation helps. Sometimes it gives a wrong prediction a persuasive story.

Xu and colleagues tested this directly in two randomized online dermatology experiments published in Nature Medicine in 2026. After quality filtering, the studies included 623 lay people, 153 primary care physicians, and 320 medical students used for an expertise comparison. Each person assessed 12 curated images. Explanation formats included prediction plus confidence, a heat map, similar-image retrieval, and a GPT-4V-generated text rationale. The diagnosis itself came from a vision model; GPT-4V explained the supplied diagnosis rather than making it. [7]

The lay task was melanoma versus nevus. The physicians gave open-ended differential diagnoses across a deliberately difficult set of conditions. Because these tasks differed, their absolute scores should not be compared as though everyone sat the same test.

Average lay accuracy rose from 69.7% without assistance to 75.8% with it. But the text explanations produced the largest lay improvement when AI was right and the largest decline when it was wrong: experiment-specific changes of +13.4% and −21.1%, respectively. Primary care physicians improved substantially overall on their difficult task; simple prediction plus confidence produced the largest top-1 gain, and text explanations did not significantly outperform other explanation formats for final accuracy. Wrong predictions had minimal measured effect on physicians' final choices in the human-first condition. Medical students deferred more than physicians, supporting—but not proving—a protective role for expertise. [7]

Presenting AI first increased deference patterns, although final accuracy did not differ by sequence. The study therefore supports a practical habit: form an independent view before revealing the AI answer when possible. For a patient, that might mean writing down symptoms, chronology, goals, and the question for the clinician before asking a chatbot for possibilities. For a clinician, it may mean documenting an initial interpretation before opening a decision-support result.

The experiment does not show that experts cannot be biased, that patients should never use AI, or that text explanations are always harmful. It used 12 images per participant, selected models, curated prevalence, limited context, and no real clinical outcomes. Its deeper lesson is that average improvement can coexist with increased vulnerability when the system is wrong.

This helps explain why the question “Did the AI explain itself?” is insufficient. Ask instead:

  • Is the explanation evidence about the patient, or language generated to justify a prediction?
  • Does it reveal calibrated uncertainty and plausible alternatives?
  • Can the user inspect the underlying source?
  • Was the user encouraged to make an independent assessment first?
  • What happens when the explanation is coherent but wrong?

5. Bias, privacy, and accountability are clinical questions

WHO's ethical framework identifies six principles: protect autonomy; promote well-being, safety, and the public interest; ensure transparency and intelligibility; foster responsibility and accountability; ensure inclusion and equity; and promote responsive, sustainable AI. These are normative principles, not proof that any tool works. They describe the conditions under which evidence should be generated and a system should be governed. [11]

Bias is more than an unbalanced training set

Bias can enter through who is represented, how labels were created, what outcome was optimized, which language or disability needs were ignored, and where the tool is deployed. A model that looks equitable in one dataset can fail when disease prevalence, equipment, referral patterns, or patient mix changes.

The Xu study used a fairness-constrained vision model and reduced measured accuracy gaps between light and dark skin tones in its curated experiment. That is encouraging, not a declaration that skin-tone inequity has been solved. The paper itself warns that a less accurate system can worsen disparities. Subgroup evaluation must be clinically meaningful, intersectional where feasible, and repeated in the deployment population. [7]

Privacy starts before the answer

A health prompt may include diagnoses, medications, genetic information, mental-health history, family details, or an entire report. Before uploading it, ask:

  • Who operates the system, and is a clinician or health plan involved?
  • What data are sent to another AI provider?
  • Are prompts or files retained, and for how long?
  • Can they be used to train a model?
  • Can the user delete them?
  • Is the service a HIPAA covered entity or business associate, or is it a consumer product governed differently?

Do not infer confidentiality from a medical-looking interface. WHO's large multimodal model guidance identifies privacy loss, false statements, manipulation, reduced clinician interaction, and care delivered outside health systems among patient-guided-use risks. [2]

A human in the loop must be able to act

“A clinician reviews every result” can be meaningful—or ceremonial. The reviewer needs time, relevant expertise, access to source information, authority to disagree, and a clear escalation path. Organizations should record overrides and incidents, watch for performance drift, and be able to correct, suspend, or retire a tool.

Accountability also requires names for responsibilities. Who selected the tool? Who validates updates? Who responds after an incorrect alert? Who tells affected patients? Who can provide redress? Adding a person at the end of an automated chain does not settle those questions.

In the European Union, the AI Act and European Health Data Space are phased rather than instantly complete. The AI Omnibus, first proposed in November 2025, entered into force on July 27, 2026. The current official timeline places Annex III high-risk rules on December 2, 2027 and rules for high-risk AI embedded in Annex I regulated products on August 2, 2028. Classification still depends on intended use; not every health chatbot is automatically a high-risk medical device. A separate Commission healthcare overview retains an older “36 months” summary that implies August 2027, so it should not be used for current dates. The conflict demonstrates why “compliant with AI law” is too vague without a product, role, jurisdiction, legal text, and date. [15] [16] [17]

6. Better questions for an AI tool—and for the person selling it

A useful evaluation can begin with four words: task, evidence, workflow, recourse.

Task

  • What exact output does the system produce: a classification, risk score, summary, draft, educational answer, or treatment suggestion?
  • Who is intended to use it?
  • What uses are excluded?
  • What information does it not have that a clinician normally would?
  • Is the output advisory, or can it automatically trigger or withhold care?

Evidence

  • Was the exact model version tested?
  • Was it compared with usual care, a clinician alone, or another tool?
  • Was evaluation retrospective, prospective, randomized, external, and representative of real prevalence?
  • Are results reported as accuracy, workflow, patient-reported outcomes, complications, or mortality?
  • Do confidence intervals allow no benefit or meaningful harm?
  • Was subgroup performance tested in people like those who will use it?

Workflow

  • Does AI appear before or after an independent human assessment?
  • Who checks the output and has authority to reject it?
  • What happens after a positive, negative, uncertain, or failed result?
  • Could false alerts create unnecessary testing, or false reassurance delay care?
  • How are model updates, overrides, drift, and incidents monitored?

Recourse

  • How can a user report an error?
  • Can the decision and source data be reconstructed?
  • Who is responsible for correction and patient communication?
  • What happens to the user's data?
  • Can the system be paused when performance changes?

Institutional articles can help map use cases without proving benefit. Mayo Clinic Magazine, for example, describes predictive, generative, and agentic AI and emphasizes workflow fit, care experience, ethics, and safety. It is a useful view of one institution's approach, not a systematic review or a clinical-outcome trial. Bryant University's overview similarly raises sensible topics—privacy, bias, training, cost, overreliance, and consent—but is a staff-authored graduate-marketing blog and should not carry quantitative or causal claims. [18] [19]

7. Using AI without surrendering the conversation

The safest consumer use often begins by changing the goal. Instead of asking, “What do I have?” try asking:

  • “Help me organize this symptom timeline for a visit.”
  • “Which terms in this report should I ask the ordering clinician to explain?”
  • “List the assumptions in this answer and what information is missing.”
  • “Give me questions about benefits, burdens, alternatives, uncertainty, and what happens if I wait.”
  • “Separate established guidance from emerging research.”
  • “What urgent warning signs should I verify with an authoritative source?”

Then bring the output into a conversation:

  • “This tool suggested this possibility. What fits my history and examination, and what does not?”
  • “What other explanations deserve consideration?”
  • “Would this information change a test, treatment, or follow-up decision?”
  • “What result would make us change course?”
  • “What is the goal—symptom relief, prevention, cure, function, or learning more?”
  • “Which risks matter most in my situation?”

This approach preserves the clinician's examination and responsibility while making the patient's priorities more visible. It also resists a subtle trap: arriving with a single AI-generated diagnosis and asking only for confirmation. A better conversation makes room for alternatives and disconfirming evidence.

8. Human Health Strategies®: an educational navigation platform

Disclosure: HHS publishes this guide. The following section explains its own platform. It is not independent evidence and should not be read as a clinical-effectiveness claim.

HHS is designed to simplify complex healthcare conversations after a serious or chronic diagnosis. Its aim is to help a person organize information and discuss goals, risks, alternatives, and priorities with licensed healthcare professionals—not to replace them.

The website can generate a source-cited AI summary of the standard-of-care baseline and a separate summary of evidence-backed alternatives. “Separate” matters: the presence of an alternative in a report does not mean it has evidence equal to standard care, that it is safe for a particular person, or that HHS recommends it as therapy. Evidence strength, interactions, delay, and applicability belong in the clinician conversation. HHS also offers user-entered progress logs, a visit-question builder, and ways to export or share reports. The website includes plain-language explanations for uploaded lab and other medical documents and, under the Family plan, separate member profiles. Availability varies by subscription plan and platform. [20] [21]

For active subscribers, the AI Health Adviser adds a conversational preparation space on both the website and mobile app. It can use the selected member's tracked conditions, profile details, recent analyzed diagnostic-document context, and recent conversation history to make educational responses more relevant. Conversations can be saved and shared: the website provides a print-ready “Share with Doctor” view, while mobile exports conversation text through the device share sheet. The website can optionally use browser speech recognition to dictate a question; the mobile Adviser currently uses text input rather than voice. [22] [23] [24]

The website Adviser can invoke a web-search tool when it needs recent information, but users should not assume that every chat response was searched, is current, or includes inspectable citations. Its output remains provisional and should be checked against primary sources and discussed with a licensed professional before any health decision. [22]

The mobile app also implements condition reports, progress logging, appointment questions, and report sharing. It does not implement every website feature; users should not assume that website document explanations, Family-profile management, browser voice dictation, or every other web capability is present on mobile. Feature availability can change. [25] [26]

HHS does not claim that these features have demonstrated better clinical outcomes, diagnostic accuracy, or clinical validation. A progress log is a record of what the user entered, not clinical monitoring. A generated question is a preparation aid, not a recommendation. An exported report may help a user share context, but a clinician must decide what is relevant and verify it.

HHS's public Terms say that the platform is informational and that nothing on it constitutes medical advice, diagnosis, or treatment. They also warn that AI-generated content can contain errors, outdated information, or inaccuracies. The Diagnostic Tests Explainer sends uploaded documents to an AI provider; the original file is retained on HHS servers to support the “Check for conditions” re-check feature until the report is deleted, according to the Terms. [1]

The Privacy Policy says HHS is not a Covered Entity under HIPAA and is not intended as an electronic health record or storage system for protected health information used for treatment. It describes data sent to its AI provider and notes that the provider may retain API inputs under its own policies. Users should read the current Terms and Privacy Policy before entering health information; no HIPAA-compliance claim is made here. [27]

A clearly hypothetical preparation workflow

Consider a hypothetical person preparing for a follow-up after receiving a diagnosis. This is an example of organization, not a claim about a real patient or outcome:

  1. The person creates the condition in HHS and reads the standard-of-care summary to learn the usual vocabulary and baseline options.
  2. They review the separate alternatives summary as a list of topics to investigate—not as equivalent evidence or a treatment instruction.
  3. They enter their own symptom notes and measurements, checking dates and units against their records.
  4. They ask the Adviser to help turn the material into a short list of uncertainties and questions, then independently verify consequential claims rather than treating the chat as a recommendation.
  5. They use the question builder and edit the list down to three priorities: the treatment goal, the most important risk, and what would trigger a change in plan.
  6. They export or share the report or Adviser conversation with a trusted family member or bring it to the visit, taking care because it contains health information.
  7. At the appointment, they ask the licensed clinician to correct inaccuracies, connect the information to examination and history, and document the agreed next step.

No diagnosis or outcome is assumed. The potential value is a less fragmented conversation and a clearer record of questions.

“The right questions can lead [to] the best outcomes.” — Joe Carvalho, HHS founder

The statement expresses HHS's aspiration: make it easier for patients to enter consequential conversations organized, informed, and ready to ask what matters. It is not a guarantee that a question—or use of the platform—will produce a particular clinical outcome.

Further viewing: “Quick Take: In Focus #12 — The YoJoeShow Podcast: Human Health Strategies: Help with your Journey”, from The YoJoeShow Podcast. Only the creator-supplied title and description were reviewed; no reliable transcript was obtained, so the video is offered for product context and not as evidence for medical claims. [28]

9. A practical preparation card

Before a visit, write one page—not an encyclopedia.

What changed

  • Main symptom or concern, onset, pattern, and severity
  • Measurements with dates, units, and device or laboratory source
  • New medicines, supplements, allergies, or side effects
  • Emergency visits, hospital stays, or new test results

What matters

  • The activity or function you most want to preserve
  • The risk or burden you most want to avoid
  • Cost, travel, caregiving, fertility, work, faith, or quality-of-life priorities
  • Who you want involved in decisions

What needs an answer

  • What is known, and what remains uncertain?
  • What is the goal of the proposed plan?
  • What are the reasonable alternatives, including doing nothing now?
  • What are the likely benefits and important harms in people like me?
  • How will we know whether it is working?
  • What symptoms require urgent help?

AI can help format this page. It cannot decide which finding is clinically decisive.

10. What the evidence does—and does not—justify

The optimistic case for medical AI is no longer based only on laboratory benchmarks. Randomized evidence now includes a mortality result in an AI-ECG alert workflow, noninferior interval-cancer performance with higher sensitivity in a large mammography trial, dramatically improved screening completion in diabetic eye care, and better documentation in a primary-care decision-support trial. [4] [5]02464-X/fulltext) [6] [13]

The cautious case is equally evidence-based. Effects belong to specific systems and workflows. Confidence intervals, comparators, populations, follow-up, and implementation matter. Consumer-chatbot evaluations have often been opaque. Persuasive explanations can increase deference to wrong answers. Bias and privacy are not solved by accuracy alone. Patient stories show possibilities but not rates or counterfactual outcomes. [12] [7] [2]

The resulting position is neither rejection nor surrender. Use AI to extend attention, organize complexity, find a question, or close a workflow gap. Require stronger evidence as the output moves closer to diagnosis, treatment, or autonomous action. Preserve a route to a qualified human. And judge promise by what was actually measured.

Frequently Asked Questions

Can a chatbot diagnose me?

A general-purpose chatbot can suggest possibilities, but that is not the same as a diagnosis based on a complete history, examination, validated testing, and professional responsibility. It may omit a dangerous condition or sound certain from incomplete information. Use it to organize questions, not to rule a condition in or out or delay care. Alex Hofmann's story illustrates the distinction: the chatbot suggested tethered cord, and a pediatric neurosurgeon reviewed imaging and made the diagnosis. [8]

Does an FDA-cleared or otherwise regulated AI tool guarantee a better outcome?

No. Regulation and clearance address a defined product and intended use under a legal framework; they do not make a tool error-free or prove every outcome a patient values. Ask what evidence supported the exact version, which population was studied, what comparator was used, and what post-deployment monitoring exists. [3]

If an AI is more sensitive, does that mean it saves more lives?

Not necessarily. Higher sensitivity means fewer target cases were missed by a specified test in a specified study. Whether this reduces death or disability depends on follow-up, treatment effectiveness, tumor or disease biology, overdiagnosis, and harms. In MASAI, sensitivity was higher, but the primary interval-cancer outcome established noninferiority rather than significant superiority, and mortality was not demonstrated. [5]02464-X/fulltext)

Did AI save the lives of Barbara or Sheila Tooth?

The public reports support narrower statements. AI flagged Barbara's mammogram; clinicians confirmed a 6 mm cancer, and she received surgery and radiotherapy. AI prompted re-reading of Sheila Tooth's mammogram; further investigation confirmed cancer, but the report provided no treatment or long-term outcome. Neither account can establish a survival counterfactual. [9] [10]

Are doctors protected from automation bias?

No. Expertise can help a person challenge a wrong answer, but clinicians are not immune to anchoring, workflow pressure, or persuasive explanations. In the 2026 dermatology experiment, primary care physicians resisted wrong advice better than less-expert groups under particular conditions, while AI-first presentation changed deference patterns. It was one online experiment, not proof of universal immunity. [7]

Should I paste my medical record into a public chatbot?

First read the product's current privacy terms, retention rules, data-sharing practices, and deletion controls. Remove unnecessary identifiers when possible and consider whether the task can be completed with less information. Do not assume a consumer chatbot is a confidential clinical record or HIPAA-covered service. WHO identifies privacy loss as a material risk of patient-guided large-model use. [2]

Is HHS a diagnostic or monitoring service?

No. HHS is an educational navigation platform. Its reports, document explanations, questions, and user-entered logs do not diagnose, treat, prescribe, clinically interpret a report, or monitor a patient for deterioration. Its Terms direct users to verify AI output and discuss health decisions with a licensed provider. [1]

Are HHS alternatives equivalent to standard care?

No. HHS places them in a separate summary for research and discussion. Inclusion does not mean equal evidence, suitability, safety, or a recommendation to replace established care. A licensed clinician should help assess evidence strength, interactions, contraindications, and the risk of delay. [20]

Does HHS claim HIPAA compliance?

No claim is made here. HHS's public Privacy Policy says the platform is not a HIPAA Covered Entity and is not intended as an electronic health record or a place to store protected health information for treatment purposes. Its Terms and Privacy Policy also describe transmission of document content to an AI provider and server retention of uploaded originals for a re-check feature until deletion. [27] [1]

What is the single best habit when using health AI?

Keep the output provisional. Write your own observations first, ask what information is missing, verify important claims in current authoritative sources, and bring consequential questions to a licensed healthcare professional who can connect them to your history, examination, goals, and local care options.

Sources

  1. Human Health Strategies — Terms and Conditions — Human Health Strategies / ROARANGE Business Strategies, LLC; current production page; code reviewed 2026-09-23; Publisher-owned public terms and medical disclaimer.
  1. Ethics and governance of artificial intelligence for health: Guidance on large multi-modal models — World Health Organization; 2024-01-18; International normative guidance for large multimodal models.
  1. Regulatory considerations on artificial intelligence for health — World Health Organization; 2023; Official regulatory guidance.
  1. AI-enabled electrocardiography alert intervention and all-cause mortality: a pragmatic randomized clinical trial — Nature Medicine; 2024; Peer-reviewed pragmatic randomized clinical trial.
  1. Interval cancer, sensitivity, and specificity comparing AI-supported mammography screening with standard double reading without AI in the MASAI study02464-X/fulltext) — The Lancet; 2026; Peer-reviewed randomized noninferiority screening trial.
  1. Autonomous artificial intelligence increases screening and follow-up for diabetic retinopathy in youth: the ACCESS randomized control trial — Nature Communications; 2024; Peer-reviewed randomized controlled trial.
  1. Divergent impacts of explainable AI for dermatological diagnosis on clinicians versus lay people — Nature Medicine; 2026-08-04; Peer-reviewed randomized online experiments.
  1. Partners in Diagnosis: ChatGPT, a Mother's Intuition, and a Doctor's Expertise — NEJM AI Grand Rounds; 2024-11-20; Named parent-and-clinician podcast interview with accessible transcript.
  1. AI breast screening tool may have saved woman's life — BBC News; 2024-03-21; Named public patient story about an NHS pilot.
  1. AI detects woman's cancer after mammogram given all-clear — BBC News; 2024-11-07; Named public patient story about an NHS re-read project.
  1. Ethics and governance of artificial intelligence for health — World Health Organization; 2021-06-28; International normative guidance.
  1. Large Language Models for Chatbot Health Advice Studies: A Systematic Review — JAMA Network Open; 2025-02-03; Peer-reviewed systematic review.
  1. Generative AI-enabled clinical decision support system in primary care: a pragmatic, cluster-randomized trial — Nature Medicine; 2026; Peer-reviewed pragmatic cluster-randomized trial.
  1. A boy saw 17 doctors over 3 years for chronic pain. ChatGPT found the diagnosis — TODAY; 2023-09-18; Named patient and family media interview.
  1. AI Omnibus enters into force — European Commission; 2026-07-27; Official entry-into-force notice linked to enacted text OJ L 2026/1744.
  1. EU AI Act implementation timeline — European Commission AI Act Service Desk; accessed 2026-09-23; Official dynamic implementation timeline.
  1. Artificial Intelligence in healthcare — European Commission; accessed 2026-09-23; Official sector policy overview.
  1. The Growing Role of Artificial Intelligence in Healthcare — Mayo Clinic Magazine; 2026-04; Institutional magazine overview.
  1. Pros and Cons of AI in Healthcare — Bryant University; 2026-03-20; Staff-authored graduate-marketing blog.
  1. Human Health Strategies — platform features — Human Health Strategies; current production page; code reviewed 2026-09-23; Publisher-owned public product page.
  1. Human Health Strategies — plans and feature availability — Human Health Strategies; current production page; code reviewed 2026-09-23; Publisher-owned public plans page.
  1. HHS AI Health Adviser — subscriber access and contextual response implementation — Human Health Strategies; implementation reviewed 2026-09-23; Publisher-owned current API implementation evidence.
  1. HHS AI Health Adviser — website chat, print sharing, and optional browser dictation — Human Health Strategies; implementation reviewed 2026-09-23; Publisher-owned current website implementation evidence.
  1. HHS AI Health Adviser — mobile chat and conversation sharing implementation — Human Health Strategies; implementation reviewed 2026-09-23; Publisher-owned current mobile implementation evidence.
  1. HHS Mobile condition report, progress, and question implementation reviewed — Human Health Strategies; implementation reviewed 2026-09-23; Publisher-owned current mobile implementation evidence.
  1. HHS Mobile report-sharing implementation reviewed — Human Health Strategies; implementation reviewed 2026-09-23; Publisher-owned current mobile implementation evidence.
  1. Human Health Strategies — Privacy Policy — Human Health Strategies / ROARANGE Business Strategies, LLC; current production page; code reviewed 2026-09-23; Publisher-owned public privacy disclosure.
  1. Quick Take: In Focus #12 — The YoJoeShow Podcast: Human Health Strategies: Help with your Journey — The YoJoeShow Podcast; accessed 2026-09-23; Creator-supplied promotional/interview video metadata.

Frequently Asked Questions

Can a chatbot diagnose me?
A general-purpose chatbot can suggest possibilities, but that is not the same as a diagnosis based on a complete history, examination, validated testing, and professional responsibility. It may omit a dangerous condition or sound certain from incomplete information. Use it to organize questions, not to rule a condition in or out or delay care. Alex Hofmann's story illustrates the distinction: the chatbot suggested tethered cord, and a pediatric neurosurgeon reviewed imaging and made the diagnosis. [8]
Does an FDA-cleared or otherwise regulated AI tool guarantee a better outcome?
No. Regulation and clearance address a defined product and intended use under a legal framework; they do not make a tool error-free or prove every outcome a patient values. Ask what evidence supported the exact version, which population was studied, what comparator was used, and what post-deployment monitoring exists. [3]
If an AI is more sensitive, does that mean it saves more lives?
Not necessarily. Higher sensitivity means fewer target cases were missed by a specified test in a specified study. Whether this reduces death or disability depends on follow-up, treatment effectiveness, tumor or disease biology, overdiagnosis, and harms. In MASAI, sensitivity was higher, but the primary interval-cancer outcome established noninferiority rather than significant superiority, and mortality was not demonstrated. [5]02464-X/fulltext)
Did AI save the lives of Barbara or Sheila Tooth?
The public reports support narrower statements. AI flagged Barbara's mammogram; clinicians confirmed a 6 mm cancer, and she received surgery and radiotherapy. AI prompted re-reading of Sheila Tooth's mammogram; further investigation confirmed cancer, but the report provided no treatment or long-term outcome. Neither account can establish a survival counterfactual. [9] [10]
Are doctors protected from automation bias?
No. Expertise can help a person challenge a wrong answer, but clinicians are not immune to anchoring, workflow pressure, or persuasive explanations. In the 2026 dermatology experiment, primary care physicians resisted wrong advice better than less-expert groups under particular conditions, while AI-first presentation changed deference patterns. It was one online experiment, not proof of universal immunity. [7]
Should I paste my medical record into a public chatbot?
First read the product's current privacy terms, retention rules, data-sharing practices, and deletion controls. Remove unnecessary identifiers when possible and consider whether the task can be completed with less information. Do not assume a consumer chatbot is a confidential clinical record or HIPAA-covered service. WHO identifies privacy loss as a material risk of patient-guided large-model use. [2]
Is HHS a diagnostic or monitoring service?
No. HHS is an educational navigation platform. Its reports, document explanations, questions, and user-entered logs do not diagnose, treat, prescribe, clinically interpret a report, or monitor a patient for deterioration. Its Terms direct users to verify AI output and discuss health decisions with a licensed provider. [1]
Are HHS alternatives equivalent to standard care?
No. HHS places them in a separate summary for research and discussion. Inclusion does not mean equal evidence, suitability, safety, or a recommendation to replace established care. A licensed clinician should help assess evidence strength, interactions, contraindications, and the risk of delay. [20]
Does HHS claim HIPAA compliance?
No claim is made here. HHS's public Privacy Policy says the platform is not a HIPAA Covered Entity and is not intended as an electronic health record or a place to store protected health information for treatment purposes. Its Terms and Privacy Policy also describe transmission of document content to an AI provider and server retention of uploaded originals for a re-check feature until deletion. [27] [1]
What is the single best habit when using health AI?
Keep the output provisional. Write your own observations first, ask what information is missing, verify important claims in current authoritative sources, and bring consequential questions to a licensed healthcare professional who can connect them to your history, examination, goals, and local care options.

Download the PDF guide