Assess diagnostic competenciesin a simulated decision-making environment

Participating in the Assessment will provide program leaders with an insight into the clinical skills and knowledge of residents in the following areas:

Basic Reports

Individual results

of each residents performance.

image
image

Residents’ ranking

to compare current clinical skill sets.

Advanced Reports

Full Group Analytics

Including; diagnostic accuracy, missed medical examinations, typical misdiagnoses,
optimal cost & time

image
image

Residency Program Comparison Report

This report offers a side-by-side view of the cohort’s performance compared to other programs, based on diagnostic accuracy and score points.

Learn more about how the assessment platform works

How do we measure performance?

Based on 2 factors:
Diagnostic accuracy
XP score points

Diagnostic Accuracy

InSimu differentiates diagnostic accuracy into the following categories:

  • Perfect diagnosis
  • Overspecified diagnosis (Why is this a bad thing?)
  • Almost perfect diagnosis
  • Not specific enough
  • Wrong diagnosis
  • Gave up

For each patient, you will see analytics on your residents’ diagnostic accuracy.

The ``Total XP`` consists of

  • Diagnosis Score (max 200 points): all diagnoses are associated with an
    accuracy rating of between (0-1) for each disease
  • Pathway Score (max 150 points): determined by the order of diagnostic
    tests requested
  • Time Score (max 50 points): determined by the total time spent
    requesting diagnostic test(s) compared to the optimal time
  • Cost Score (max 100 points): determined by the total cost of requested
    diagnostic test(s) compared to the optimal cost


Examples: Solving the patient with the highest difficulty will result in a score of 500 XP points if solved perfectly. An average-difficulty patient solved perfectly will result in 250 XP points.

Before the Assessment

  • Download InSimu Patient from the App store, or from Google Play
  • Create your account
  • Although not mandatory, it is  advised that you practice the offered 3 cases within the Challenges section of the app to gain familiarity  with the logic (after your program signs up for the Assessment, you will receive a promo code)

Until then, be sure to check out the following demo video illustrating how the app works in practice.

Assessment Day

  • You will have  120 minutes to complete the assessment. 
  • The Assessment will have 15 pre-selected clinical scenarios within your specialization.
  • Your task will be to find the perfect diagnosis for  each virtual patient, and follow the optimal diagnostic pathway.
  • You cannot skip any clinical scenarios, so if you are unsure of a diagnosis, make an educated guess and progress onto the next case. 
  • The assessment cannot be failed.
  • You must complete the Assessment in one sitting, so find a comfy spot and start diagnosing!

Before the Assessment

  • Results will be made available 2-3 weeks after your Assessment.
  • Programs will receive a report illustrating the percent of diagnostic accuracy and score points for each resident.
  • The Report will also include a list of tips and educational objectives based on your diagnostic performance.

Assessment Plans

Basic

15 virtual patients
120 minutes
Report 1: Individual results
Report 2: Educational objectives
Report 3: Residents’ ranking

Advanced

15 virtual patients
120 minutes
Report 1: Individual results
Report 2: Educational objectives
Report 3: Residents’ ranking
Report 4: Full group analytics
Report 5: Program’s ranking

FAQ

What sources and guidelines are used in InSimu?

We use WHO guidelines if available. If not, official US or EU guidelines are the basis for optimal diagnostic pathways.As an example, for endocarditis, two guidelines are used by InSimu:

Endocarditis:

    • 2015 ESG Guideline for the management of infective endocarditis –  The Task Force for the Management of Infective Endocarditis of the European Society of Cardiology (ESC)
    • American Heart Association current guideline:Infective endocarditis in adults: diagnosis, antimicrobial therapy, and management of complications: a scientific statement for healthcare professionals from the American Heart Association

We also use UpToDate, MedScape, publicly available articles from prestigious medical journals and gold-standard medical books such as Harrison’s Principles of Internal Medicine and Bates’ Guide to Physical Examination and History Taking. These are  all referenced in the app.

What kind of data will be shared from my performance, and who can see it?

Only Program Directors will see residents’ personal performance, including:

  • a ranking of all participating residents in the program:
      • your registered name in the application
      • the number of virtual patients you diagnosed
      • the amount of time (hours:minutes:seconds) you spent diagnosing
      • your score points (XP)
      • your diagnostic accuracy
  • your case by case performance, including:
        • submitted diagnosis
        • ordered and missed tests

After the assessment period, you can gain access to the following:

  • Your diagnosis vs. the perfect diagnosis
  • Your performed medical examinations vs. the missed ones
    • Feedback on the correctness of your performed examinations
    • Results of your missed medical examinations
  • Your Performance compared to other interns in your program

To review further details on how we handle your data, please check our privacy policy.

How do you measure my performance?

Based on 2 factors:

  • your diagnostic accuracy, and
  • your XP score points

Diagnostic accuracy:

In InSimu, The Virtual Patient Platform, we differentiate the following diagnosis categories:

  • Perfect diagnosis
  • Overspecified diagnosis
  • Nearly good diagnosis
  • Not specific enough
  • Wrong diagnosis
  • Gave up

For each patient, you will be able to see your diagnostic accuracy in the results 3-4 weeks after the Assessment period has closed.

The “Total XP” consist of:

  • Diagnosis Score (max 200 points): all diagnoses are associated with a correctness rate between (0-1) for each disease
  • Pathway Score (max 150 points)
  • Time Score (max 50 points): determined by the cumulate time of the ordered diagnostic test compared to the optimal time
  • Cost Score (max 100 points): determined by the cumulate cost of the ordered diagnostic test compared to the optimal cost

What kinds of questions will be asked in the Assessment?

InSimu’s Virtual Patient Platform offers individual clinical cases. For the Assessment, our expert team pre-selected 15 clinical cases within 16 specializations.

For each virtual patient, you will be presented with the following information:

    • Full name, age, gender
    • Chief complaints

Based on this information, you will begin the examination of the  patient. You can select from 500+ medical tests in the following categories:

    • History
    • Physical
    • Laboratory
    • Imaging
    • Others

You will receive the results of each requested examination immediately. Based on these results,  you should  be able to determine the next stage  in your diagnostic pathway. Your goal is to follow the optimal diagnostic pathway, requesting only essential  tests. Requesting unnecessary examinations will ultimately jeopardise both your money and time, thus impacting your final score.

To see how it works, watch the following video:
https://www.youtube.com/watch?v=2eVbkcNYNHQ&t=61s

What are the technical requirements to participate in the Assessment?

You can access InSimu The Virtual Patient Platform from your smartphone or laptop:

      • Download it from your App store, or from Google Play
      • If you prefer to use your PC, create your account at the app.insimu.com page
      • You will receive a dedicated promo code and a link where you can use the web application of InSimu

Join the Assessment

Back to Top