Multiple Mini Interviews

 

 

Applicants who are eligible for the current assessment cycle will be invited to participate in the MMI. All candidates who wish to compete for CaRMS R-1 positions for IMGs in Alberta must take the MMI.

The Multiple Mini Interviews (MMI) are designed to assess personal qualities through the seven CanMEDS competencies, developed by the Royal College of Physicians and Surgeons of Canada (RCPSC) and the College of Family Physicians of Canada (CFPC).

The MMI has been modeled on the Objective Structured Clinical Examination that is commonly used by Health Sciences Programs to evaluate student competence. It consists of a series of short carefully timed interview stations in an attempt to draw multiple samples of a candidate’s ability to think on their feet, critically appraise information, effectively communicate their ideas, and demonstrate their insight into unique and complex clinical scenarios.

The MMI is offered in Calgary once a year in the fall.

As the performance of an individual is highly variable across situations, an evaluation that uses multiple scenarios is a more sound psychometric approach with a strong basis in educational and evaluation theory. This is advantageous for the candidate. If a candidate has trouble in one scenario they can recover with an excellent performance in another situation. Also, individuals with diverse backgrounds have a more equitable opportunity to demonstrate the quality of their educational and personal backgrounds. Candidates have reached this stage of the process because they have completed a number of assessments testing their clinical knowledge.  The MMI assesses the candidate’s ability to apply general knowledge to issues relevant to the culture and society in which they will be practicing.

Equally important, is the candidate’s ability to communicate and defend their personal opinions. Recognize that there are no right answers for many of the scenarios that candidates will see. They are simply asked to adopt a position and defend any ideas they put forward, or discuss the issues raised in the scenarios. Interviewers will challenge the candidate to express their ideas clearly and rigorously.

Candidates will be presented with nine scenarios and asked what they would do in that situation. Each scenario or station is 8 minutes in total, with 2 minutes to review the scenario and 6 minutes to discuss the scenario with an interviewer. Each mini-interview takes place in a different room with the interviewer present in the room. When there is 1 minute remaining in the station, there will be an audible signal.

Each scenario will focus on one or more of the CanMEDS competencies or roles:

  • Medical Expert
  • Communicator
  • Collaborator
  • Manager or Leader
  • Health Advocate
  • Scholar
  • Professional

Prepare your response:

  • consider how the scenario relates to current issues and events relevant in Canadian culture and society and demonstrate this knowledge during the interview.
  • do not summarize the scenario, the Interviewer is well acquainted with the scenario and is more interested in your response.
  • do not focus on the definitions of the CanMEDS roles, but rather their applicability in the context of the station.
  • take your time, take deep breaths and maintain your composure.

When it is time to move to the next station, please close the door behind you when you leave the station.

There may be rest stations (stations without a scenario) during the MMI. When in a rest station, the candidate shall sit quietly and wait for the signal to move to the next station.

Just prior to the exam there will be an orientation to the process with an opportunity to ask questions.

NOTE: For the 2019 Cycle MMI there will be 10 stations where one of the stations will consist of a panel of two interviewers. They will ask set questions, to be related to the candidate's own life experiences. The duration of the panel station will be double that of a traditional scenarios station.

Sample Station #1

Candidate Information

You are taking care of an inpatient with progressive interstitial fibrosis who is admitted with escalating oxygen requirements and shortness of breath. He had quit smoking recently but requires 6 months of abstinence from smoking to be considered for transplantation. When you meet with him, he returns from being off unit and smells of smoke. On gentle probing, he admits to smoking.

How would you proceed with this situation? 

Sample Station #2

Candidate Information

A 24 year old single mother gave birth to a male infant at 25 weeks gestation. The infant’s neonatal medical issues are now resolved, apart from being sent home on oxygen, expensive medications, and specialized formula. The infant also requires frequent visits to specialty clinics, the family doctor and pediatrician.

At the most recent visit with the family doctor, the mother expressed concerns that she is struggling financially to cover the cost of the formula, transportation costs to her appointments, and purchasing medications, and is also having difficulty coping with the care required for her infant.

How would you help this parent? 

Interviewers will score three domains:

  1. Communication skills displayed during this station.
  2. Candidate’s ability to address the objectives of this station.
  3. Overall rating.

The score reported to the candidate will be the standardized score for all stations, reported as a Z-score or variance from the mean. In other words, a candidate’s score will be a signed number, either positive or negative, indicating how many standard deviations the candidate’s performance was either above or below their cohort’s mean. 

Candidates will be evaluated at the level of a recent medical graduate from a Canadian medical school.

MMI results are sent to those on the final list of candidates eligible to apply for Alberta IMG-designated positions through CaRMS. The candidate is responsible for the timely upload of their result report into their CaRMS Extra documents portfolio for residency program review and verification. The candidate must then assign their MMI result to their individual residency program applications prior to the CaRMS online application close. Refer to Important Dates and Deadlines.

The result is valid only for the cycle in which it was taken.

Understanding Your Results

In 2015, the AIMG Program changed its method of reporting MMI results to help residency programs more easily compare an applicant’s results to that of others in the same cycle (cohort). AIMG applicants must participate in the MMI annually in order for their results to be compared to their current cohort’s results.

MMI results are provided as a “standardized score” or z-score to reflect how an applicant performed in comparison to the mean (or average) score of all the applicants in that year’s MMI.  A z-score more clearly indicates how an individual compares to their cohorts than a raw test score.

If an individual’s raw score was above the mean, their z-score will be positive.  If an individual’s raw score was below the mean, their z-score will be negative.

Standard deviation is used to quantify the amount of variation in the MMI results. Typically 68% of individuals will have a score between -1 and 1.

Example:

Cohort mean score = 100

Standard deviation = 8

  • A z-score of 1 indicates that a raw score is 1 standard deviation (8) greater than the mean (100 + 8 = raw score of 108)

  • A z-score of 2 is 2 standard deviations (2 X 8 = 16) greater than the mean (100 + 16 = raw score of 116)

  • A z-score of -1 indicates that a raw score is 1 standard deviation less than the mean (100 – 8 = raw score of 92)

Attire

Business attire (no lab coat). Wear what you would wear to a residency interview. Please do not wear any scented products.

Washroom Breaks

Candidates are encouraged to use the washroom prior to registering. There are no scheduled washroom breaks once you have been signed-in. Do let an MMI staff member know if you have an urgent need to use the washroom at any point during the MMI.

Arrival and Departure

Candidates should allow time to find parking however, do not present yourself at the registration area more than 15 minutes prior to the start of your registration time. No late admissions will be allowed. You should plan to be at the examination site for approximately three hours. If you need to arrange post-exam travel, please allow adequate time to get to your destination from the exam site. Do not return to the premises once you have been signed-out.

Available seats

Candidates must confirm participation for the MMI in the invitation that is emailed approximately 2-4 weeks prior to exam dates. The AIMG Program will make every effort to accommodate all candidates for the MMI. However, in the event that the number of candidates eligible to take the MMI is greater than the number of seats available, candidates will be ranked by their MCCQE Part 1 score and higher ranked candidates will be invited to participate in the MMI.

Preparing for MMI

The AIMG Program does not assist candidates with MMI preparation. Other agencies may provide these services.

Rescore Request

Candidates who wish to have their MMI examination rescored must:

  • Submit a message through aimg@ucalgary.ca  within seven days of the results release date indicated on the Statement of Results. The request should include an explanation for the rescore request, the candidate’s name, AIMG Program ID, address and phone number.
  • Follow the written request with payment of the rescore request fee of C$100.00 to the AIMG Program office.  We can only accept funds in the form of a bank draft or money order. Please ensure the payee is “The University of Calgary”.

A rescore includes the following steps:

  • Authentication of all parts of your examination, including a complete file review (incident reports and assessor comments).
  • Verification of the computer-scanned answer sheets for anomalies (torn sheets, stray marks, ink marks, etc.).
  • Verification of raw computer data against assessor-completed answer sheets.
  • Verification of the computer file scores against those reported in the results letter.

A rescore does NOT include a re-evaluation of the candidate’s performance by additional assessors.

Rescores are processed within four to six weeks from the date the rescore request fee is received in the AIMG Program office. Please note that the new score could be higher, lower or the same as the original score received.

Candidates must still assign their current MMI result to the programs they are applying through CaRMS.  Should the rescore prove a different result, the AIMG Program will ensure this new result is available to Alberta residency programs.