A 13-week pilot at Morristown Emergency Medicine Residency shows that repeated case-based practice builds meaningful clinical confidence and that the programs benefiting most from DDx are the ones catching gaps before they compound.

The unsolved resident remediation problem

Every residency program has residents who struggle. That's not a failure of selection; it's the reality of training physicians across a wide spectrum of clinical experience. The challenge isn't identifying that a resident is struggling. It's figuring out exactly why and targeting the right intervention in a timely manner.

Today, that process is almost always resource-intensive. Individualized improvement plans require faculty to diagnose the root cause of every deficiency in medical knowledge, professionalism, and clinical skills, and to tailor feedback for each resident. ACGME standards require detailed, legally defensible documentation of every concern, intervention, and outcome. And all of it — the check-ins, the progress monitoring, the plan construction — sits on top of normal clinical and administrative duties.

It is evident programs need a tool that can identify gaps earlier, deliver consistent, cased-based practice, and generate longitudinal evidence of improvement without adding hours to every faculty member's week. That's exactly what DDx was built for.

The Morristown pilot: 13 weeks, 30 residents, real results

At Morristown Medical Center's Emergency Medicine Residency Program, faculty piloted DDx — Sketchy's AI-powered clinical reasoning platform that simulates real-world patient encounters — as a supplemental tool for targeted skills development and oral board preparation, running from March through June 2025.

  • The study enrolled 30 EM residents (PGY-1 through PGY-3). 
  • Participants were assigned two DDx cases per week over 13 weeks (26 total), working alongside three traditional in-person oral board sessions over the same period. Residents were surveyed before and after on confidence, comfort, engagement, cognitive load, usability, and study habits.

The results suggest DDx adds meaningful value alongside traditional clinical education and board prep workflows:

+0.6  improvement in confidence managing undifferentiated cases (5-pt scale; moderate, educationally meaningful effect)

87%  of residents said AI-based educational tools would be a useful supplement to their training

80%  of residents rated DDx engaging or very engaging

Stress levels were also lower with DDx compared to traditional oral board review — an important finding for a remediation context where performance anxiety often compounds the underlying clinical gap.

PGY-1s showed the largest gains — consistent with building foundational clinical reasoning skills where there's more room to grow. Senior residents also showed meaningful improvements from a higher baseline, suggesting DDx has utility across all training levels.

Why DDx works: scalable practice without faculty overhead

Traditional remediation is high-touch by necessity. Faculty have to create cases, observe performance, diagnose reasoning gaps, and design individualized improvement plans — work that is essential but difficult to scale.

DDx doesn't replace that clinical mentorship relationship. It handles the practice and assessment side of remediation so faculty can focus on what only they can do. That means residents completing cases asynchronously on their own schedule, without dedicated simulation lab time or faculty presence. Longitudinal performance tracked across every case, automatically. Rubric-based assessment that surfaces not just whether a learner got the answer right, but how they approached the problem. And a documented, continuous record of reasoning over time that creates objective evidence of both the gap and the improvement, without periodic check-ins or manual review.

When those patterns are visible, the individualized remediation plan becomes much easier to construct. Faculty are no longer starting from zero trying to diagnose the deficiency. The data has already identified where reasoning diverges: whether a resident's differential is breaking down, whether they're ordering the right studies for the right reasons, whether they're managing undifferentiated presentations effectively.

And because the data shows that repetition is what drives improvement, dramatically lowering the barrier to consistent, frequent practice isn't a convenience — it's the mechanism.

Visibility into resident readiness changes everything

The Morristown pilot focused on residents already in training. But the programs getting the most from DDx are also deploying it at the very start of residency and the early identification benefit is perhaps the most valuable of all.

At Indiana Ascension St. Vincent, where DDx was deployed during intern orientation, faculty described the platform as a 'gap analysis' tool at the program level, surfacing broad patterns across the cohort, not just struggling individuals.

"Without a tool like this, we'd only discover those deficits later in the year. This lets us capture them early and tailor our teaching from day one."

When you identify a reasoning gap in Week 1 of residency instead of month 6, the intervention is more targeted, less intensive, and more likely to succeed before the stakes get higher and the gap has had time to compound.

DDx's longitudinal analytics and centralized dashboards give faculty visibility into individual and cohort performance over time, so remediation doesn't have to wait for a struggling resident to become visible through patient care.

The bottom line

Remediation will always require faculty attention. DDx doesn't change that. What it changes is how efficiently and how early faculty can act with objective data, and scalable practice, that reduces administrative burden without reducing rigor.

For programs looking to strengthen their remediation workflow, identify gaps before they compound, and demonstrate documented improvement to accreditors, DDx provides a practical, scalable, and evidence-backed path forward.

See what DDx can do for your program

Whether you're looking to strengthen your remediation workflow or identify gaps earlier in training, we'd love to walk you through how DDx works.

Schedule a demo today.

Sources: Morristown Emergency Medicine Residency Program Case Study — DDx for Oral Board Prep (DDx by Sketchy, August 2025); Indiana Ascension St. Vincent Internal Medicine Residency Program Case Study (DDx by Sketchy, 2025)

Explore how AI-enabled clinical simulation can benefit your institution. Schedule a demo of DDx today.

Schedule  Demo