MedRise MedicineAI in medicine

AI in medicine: what students and residents need to know

Where AI is already used in patient care, how the FDA treats it, what the evidence shows when tools are tested outside the lab, how to use AI safely while you train, and the real routes into clinical informatics and health AI research, with the conferences and deadlines worth knowing.

The landscape

Where AI shows up in care today

"AI" covers very different tools. Knowing which kind you're looking at tells you how it was tested and who is responsible for it.

FDA devices

Imaging and diagnostics

  • Software that flags findings on CT, X-ray, mammography or ECG, or triages a worklist
  • This is where most FDA-listed AI devices are: analyses of the FDA list put radiology at about three in four
  • Usually cleared as medical devices for a specific, narrow use
EHR tools

Prediction and alerts

  • Risk scores for sepsis, deterioration, readmission or no-shows built into the EHR
  • Many are built by EHR vendors or hospitals and are not reviewed by the FDA as devices
  • Performance can drop sharply at a new hospital (see the evidence below)
Clinician signs

Documentation and inbox

  • Ambient tools that draft a visit note from the conversation
  • Drafted replies to patient portal messages and chart summaries
  • The clinician still reviews, edits and signs, and owns what is in the chart
Use with care

Large language models

  • General chat assistants and medical question-answering tools
  • An independent review of the FDA's September 2026 list found no authorized device that uses generative AI or a large language model
  • Fluent answers can still be wrong or cite sources that don't exist

Regulation

How the FDA handles AI

It regulates devices, not "AI"

The FDA's own position is that it does not regulate AI as such; it regulates medical devices, including AI-enabled ones. So the question is always what a product is intended to do. Software that analyzes an image to detect disease is a device; much of the AI used for scheduling, billing or general writing is not.

More than 1,600 AI-enabled devices

The FDA says it had authorized over 1,600 AI-enabled medical devices for the U.S. market as of September 2026, and it cautions that its public list is not a complete record of every AI-enabled device. An analysis of the list found about 96% reached the market through the 510(k) pathway, which compares a device with one already on the market.

Planned updates: PCCPs

In December 2024 the FDA finalized guidance on predetermined change control plans. A maker can describe, at the time of review, the model updates it plans and how it will test them, then make those changes without a new submission each time. The final version covers all AI-enabled device software, not just machine learning.

What that means at the bedside

A cleared device was shown to work for a specific intended use, population and setting. It does not mean it works for every patient, at every hospital, or for questions it was never cleared to answer. Read the intended use before you trust the output.

Evidence

What happens when tools leave the lab

Two studies every trainee should know, because they show the two most common failure modes.

A sepsis alert that missed most sepsis

Researchers at Michigan Medicine tested a widely used proprietary sepsis model on 38,455 hospitalizations. It reached an area under the curve of 0.63, missed 67% of patients who developed sepsis, and still alerted on 18% of all hospitalized patients. Lesson: a model can be deployed widely without strong external validation, and poor accuracy also creates alert fatigue.

A cost proxy that hid illness

A commercial algorithm used to pick patients for extra care predicted future health care costs rather than illness. Because less money is spent on Black patients at the same level of need, Black patients were considerably sicker than White patients at the same risk score. Fixing the bias would have raised the share of Black patients flagged for extra help from 17.7% to 46.5%. Lesson: check what the model actually predicts, not what it is called.

Critical appraisal

Seven questions to ask about any clinical AI tool

  1. What exactly does it predict or detect?The real outcome it was trained on, not the marketing name. A proxy (cost, a billing code) can hide bias.
  2. Who was it trained and tested on?Age, sex, race and ethnicity, care setting, scanner or EHR vendor. Ask whether patients like yours were included.
  3. Was it validated somewhere else?External validation at a different hospital, ideally prospective, is far stronger than a split of the developer's own data.
  4. How does it perform in subgroups?Overall accuracy can hide poor performance in children, older adults, pregnancy, or underrepresented groups.
  5. Did it change patient outcomes?Better accuracy is not the same as fewer deaths, faster treatment or fewer unnecessary tests.
  6. What is the regulatory status and intended use?FDA-cleared for this use, cleared for something narrower, or not a device at all.
  7. Who monitors it after go-live?Performance drifts as patients, practice and data change. Someone should be measuring it and able to switch it off.

Medical education

Using AI safely while you train

What the AAMC says

The AAMC has published Principles for the Responsible Use of Artificial Intelligence in and for Medical Education (seven principles, released January 2025), with workshop materials for faculty, and separate principles for AI in medical school and residency selection, which say any use of AI in selection should be balanced with human judgment. Expect your school to have its own policy built on them.

Practical rules for students and residents

  • Never paste patient-identifiable information into a public chatbot. Use only tools your institution has approved for patient data.
  • Check your school's or program's policy before using AI for graded work, and disclose its use when the policy asks you to.
  • Verify every clinical fact, dose and reference against a primary source or guideline. Treat AI output as a draft.
  • Use AI to quiz yourself and explain concepts, not to skip the retrieval practice that builds exam memory.

Careers

Paths into clinical informatics and health AI

Clinical informatics, the board-certified route

Clinical informatics became a subspecialty open to diplomates of all ABMS member boards in 2010, and the first physicians were certified in 2014. Certification is offered jointly by the American Board of Preventive Medicine and the American Board of Pathology. Today the only route to the initial exam is a 24-month ACGME-accredited clinical informatics fellowship after residency: the practice pathway closed after the 2025 application cycle.

Other routes

  • Research careers in machine learning for health, often with a master's or PhD in biomedical informatics or an MD-PhD.
  • Imaging and pathology AI through radiology, pathology and their informatics societies.
  • Health system roles that evaluate, deploy and monitor AI tools, which grow out of informatics fellowships and quality work.
  • Industry and startups, where clinicians help design tools and run validation studies.

Start now

What a student or resident can do this year

Get PhysioNet credentialed

MIMIC and many other de-identified clinical datasets need PhysioNet credentialing: an account, your affiliation, the CITI course “Data or Specimens Only Research” (upload the completion report, not just the certificate) and a data use agreement for each dataset. PhysioNet says approval typically takes 1 to 2 weeks.

Do a validation project, not a new model

Testing how an existing, published score or model performs in a new population is publishable, teaches you the methods, and answers the question clinicians actually care about.

Learn the basics that last

Biostatistics (sensitivity, calibration, ROC curves), a little Python or R, and how EHR data are recorded. These outlast any single tool.

Join the communities

AMIA for clinical informatics, SIIM for imaging informatics, and the machine learning for health research community (ML4H and CHIL). Ask each society about student membership and student registration rates.

Submit an abstract

Imaging and applied informatics projects fit SIIM's abstract calls; AMIA's spring and fall meetings take informatics research and student papers. Deadlines are listed below.

Learn to publish a paper without a lab

Conferences

AI and informatics conferences and deadlines

From the MedRise conference list, which is re-checked against each organizer's own page every week.

  • Submit by Dec 14, 2026SIIM27 call for abstractsSociety for Imaging Informatics in Medicine · Jun 17–19, 2027 · Nashville, TNTwo abstract calls for SIIM27: applied informatics (projects, workflow and quality work) and scientific research (hypothesis-driven, reproducible studies). A good fit for imaging AI projects.
  • RSNA 2026Radiological Society of North America · Nov 29, 2026 – Dec 3, 2026 · Chicago, ILThe world's largest annual radiology meeting, open for registration. Its AI Showcase has more than 100 companies demonstrating imaging AI and machine learning tools.
  • ViVE 2027HLTH Inc. · Mar 14–17, 2027 · Nashville, TNA digital health industry meeting for health system leaders and companies, with sessions on putting AI into clinical and operational work.
  • AMIA 2027 Amplify Informatics ConferenceAmerican Medical Informatics Association · Apr 12–15, 2027 · Atlanta, GAAMIA's spring meeting, which joins the Informatics Summit and the Clinical Informatics Conference. Sessions cover clinical informatics, data science and AI in care.
  • HLTH 2027HLTH Inc. · Oct 17–20, 2027 · Las Vegas, NVA large health innovation meeting where health systems, payers, startups and investors discuss digital health and AI.
  • AMIA 2027 Annual SymposiumAmerican Medical Informatics Association · Nov 6–10, 2027 · San Diego, CAAMIA's largest yearly meeting on biomedical and health informatics, including clinical AI research.

See every AI and clinical informatics listing

Planning an AI or informatics CV?

MedRise helps students and IMGs choose a project, get it published and present it at the right meeting.

Sources

Where this comes from

Sources last checked November 14, 2026. Device counts, guidance and certification rules change: open the official page before you rely on a detail.