Assess ACGME competenciesin a simulated decision making environment

Participating in the Assessment, will give an initial impression of interns’ clinical skills and knowledge in the following areas:

Patient Care 2:

Physical Examinations

Patient Care 3:

Clinical Reasoning

Medical Knowledge 3:

Diagnostic Testing

Basic Reports

Individual results

of each of your intern

image
image

Interns’ ranking

So that you can compare your interns current clinical skill set.

Advanced Reports

Full Group Analytics

incl.: diagnostic accuracy, missed medical examinations, typical misdiagnoses, optimal cost & time

image
image

IM Program Comparison Report

This report offers a side-by-side view of your cohort’s performance compared to all participating IM programs, based on diagnostic accuracy and score points.

Learn more about how the assessment works

How do we measure your interns performance?

Based on 2 factors:
– their diagnostic accuracy, and
– XP score points

Diagnostic Accuracy

    In InSimu, The Virtual Patient Platform, we differentiate the following diagnosis categories: 

    • Perfect diagnosis
    • Overspecified diagnosis
    • Nearly good diagnosis
    • Not specific enough
    • Wrong diagnosis
    • Gave up

    For each patient, you will see the diagnostic accuracy of your interns, as well as an overall summary of your interns’ diagnostic accuracy.

    The ``Total XP`` consists of

    • Diagnosis Score (max 200 points): all diagnoses are associated with a correctness rate between (0-1) for each disease
    • Pathway Score (max 150 points): determined by the order of diagnostic tests requested
    • Time Score (max 50 points): determined by the cumulate time of the requested diagnostic test(s) compared to the optimal time
    • Cost Score (max 100 points): determined by the cumulate cost of the requested diagnostic test(s) compared to the optimal cost

      Examples: The top difficulty patient solved perfectly results in 500 XP points.
      An average difficulty patient solved perfectly results in 250 XP points.

      Before the Assessment

      • Download InSimu Patient from the App store, or from Google Play
      • Create your account
      • No special practice is required, however we advise you to practice the offered 3 cases within your Challenges to get familiar with its logic (after your program signs up for the Big Internal Medicine Intern Assessment, you will receive a promo code)

      Until then, check the following video to watch how the app works in practice

      Assessment Day

      • The total assessment time will be 120 minutes
      • The Assessment will have 15 pre-selected clinical scenarios within Internal Medicine
      • Your task will be to find the perfect diagnosis of your virtual patient and follow the optimal diagnostic pathway
      • In order to move forward to your next virtual patient, you cannot skip any clinical scenarios, you have to find (or guess) a diagnosis to move forward
      • The assessment cannot be failed
      • You must complete the Assessment in one sitting, so find a comfy spot and start diagnosing!

      Before the Assessment

      • Results will be made available online roughly 3-4 weeks after October 31, 2021
      • Programs will receive a report that shows the percent of diagnostic accuracy and score points for each intern
      • Report will also include a list of tips and educational objectives based on your diagnostic performance

      Assessment Plans

      Basic for FREE*

      15 virtual patients
      120 minutes
      Report 1: Individual results
      Report 2: Educational objectives
      Report 3: Interns’ ranking

      Advanced

      15 virtual patients
      120 minutes
      Report 1: Individual results
      Report 2: Educational objectives
      Report 3: Interns’ ranking
      Report 4: Full group analytics
      Report 5: Program’s ranking

      *Why is it free?

      We are committed to contribute to the highest level of clinical knowledge of residents and future doctors. Our aim is to offer a unique, free assessment opportunity to Internal Medicine Residents worldwide, especially interns’ diagnostic skills who just started their residency program. The results of this Assessment will help guide our team towards the most needed learning topics and inform our future development.

      FAQ

      What sources and guidelines are used in InSimu?

      We use WHO guidelines if available. If not, official US or EU guidelines are the basis for optimal diagnostic pathways.As an example, for endocarditis, two guidelines are used by InSimu:

      Endocarditis:

      • 2015 ESG Guideline for the management of infective endocarditis –  The Task Force for the Management of Infective Endocarditis of the European Society of Cardiology (ESC)
      • American Heart Association current guideline:Infective endocarditis in adults: diagnosis, antimicrobial therapy, and management of complications: a scientific statement for healthcare professionals from the American Heart Association

      We also use UpToDate, MedScape, publicly available articles from prestigious medical journals and gold-standard medical books such as Harrison’s Principles of Internal Medicine and Bates’ Guide to Physical Examination and History Taking. These are  all referenced in the app.

      What kind of data will be shared of my performance, and who can see it?

      Only your Program Director will see interns’ personal performance, including the following: 

      • a ranking list of all the interns of your program:
        • your registered name in the application
        • the number of virtual patients you diagnosed
        • the amount of time (hours:minutes:seconds) you spent on diagnosing
        • your score points (XP)
        • your diagnostic accuracy 
      • your case by case performance, including: 
        • your submitted diagnosis
        • your ordered and missed tests

      After the assessment period, you can access the following results in your application:

      • Your diagnosis vs. the perfect diagnosis
      • Your performed medical examinations vs. the missed ones
        • Feedback on the correctness of your performed examinations
        • Results of your missed medical examinations
      • Your Performance compared to other interns in your program

      To review further details on how we handle your data, please check our privacy policy.

      How do you measure my performance?

      Based on 2 factors:

      • your diagnostic accuracy, and
      • your XP score points

      Diagnostic accuracy:

      In InSimu, The Virtual Patient Platform, we differentiate the following diagnosis categories:

      • Perfect diagnosis
      • Overspecified diagnosis
      • Nearly good diagnosis
      • Not specific enough
      • Wrong diagnosis
      • Gave up

      For each patient, you will be able to see your diagnostic accuracy in the results 3-4 weeks after the Assessment period has closed.

      The “Total XP” consist of:

      • Diagnosis Score (max 200 points): all diagnoses are associated with a correctness rate between (0-1) for each disease
      • Pathway Score (max 150 points)
      • Time Score (max 50 points): determined by the cumulate time of the ordered diagnostic test compared to the optimal time
      • Cost Score (max 100 points): determined by the cumulate cost of the ordered diagnostic test compared to the optimal cost

      What kind of questions will I have in the Big IM Intern Assessment?

      InSimu’s Virtual Patient Platform offers individual clinical cases. For the Big Assessment, our expert team has pre-selected 15 clinical cases within Internal Medicine.

      For each virtual patient, you will be presented with the following information:

          • Full name, age, gender
          • Chief complaints

      Based on this brief, you will begin examining your patient. You can select from 500+ medical tests in the following categories:

          • History
          • Physical
          • Laboratory
          • Imaging
          • Others

      You will receive the results of each requested examination right away, and based on that, you have to follow to the next point of your diagnostic process. Your goal is to follow the optimal diagnostic pathway: request all the necessary tests to find your diagnosis, but be aware of not calling for unnecessary examinations because it will “cost” you extra money and time, which can lower your final score points.

      To see how it works, watch the following video: https://www.youtube.com/watch?v=2eVbkcNYNHQ&t=61s

      How is the Big IM Intern Assessment aligned with the ACGME?

      Participating in the Assessment, will give an initial impression of interns’ clinical skills and knowledge in the following areas:

          • Patient Care 1: History
          • Patient Care 2: Physical Examination
          • Patient Care 3: Clinical Reasoning
          • Medical Knowledge 3: Knowledge of Diagnostic Testing

      Our users report improved confidence in their diagnostic abilities and regularly use InSimu to prepare for their STEP1 tests. We hope you find the same value in your experience!

      What are the technical requirements to participate in the Big IM Intern Assessment?

      You can access InSimu The Virtual Patient Platform from your smartphone or laptop:

          • Download it from your App store, or from Google Play
          • If you prefer to use your PC, create your account at the app.insimu.com page
          • You will receive a dedicated promo code and a link where you can use the web application of InSimu

      Join the Assessment

      Back to Top