Navigation

Overall Performance Chart

Percentile Chart

Category Performance Chart

Improvement Chart

Usage Chart


Chart Explanations

Overall Performance Chart

The Overall Performance graph displays your performance over time, in a moving average and with data points for specific exams. You can select the time range displayed in the chart moving the sliders at the bottom of the chart. The bottom of the chart displays your moving average and bars representing the number of questions taken each day.

Overall Performance Chart

Key Chart Features:

Select Time: This graph displays data about your performance based on a time window that you set. You can see your performance from the entire length of your subscription, or "zoom in" to just last week. You can change what window of time is being displayed by a) dragging the left or right handles in the time selection panel, or b) clicking the quick select buttons to jump to a certain window of time like "Last Month". when you change the time window, you'll notice that the labels on the X-axis update.

Score & Question Volume: See your score and volume of questions taken at each point in time. The top portion of the graph shows performance in percent, and the bottom portion shows bars proportional to how many questions were taken.

Mouse-Over & Click Tooltips: Mouse over a 'My Tests' data point or a question count bar and a tooltip will display what data range is summarized by the data point, how many questions were taken, and the score on those tests. Click on the data point or in the tooltip to open more information about that data point's tests.

Toggle Data Series On or Off: Click on the name of a data series like "National 20th percentile" to toggle that data series on or off.


Data Definitions:

Moving Average: Your moving average includes the last 100 question you've taken, and is calculated at the end of each day that you take questions. This score includes timed exams, untimed exams, and tutor mode exams, and includes questions whether or not it is the first time you have seen a particular question.

My Tests: The My Tests data series aggregates all tests taken on a specific day or set of days and displays a question count and score inclusive of that set of tests. When zoomed in to a "narrow" time window such as a single week of data, one My Tests data point will summarize each day's performance. When zoomed out to a larger time window such as several months, on My Tests data point will summarize multiple days' worth of tests. Mouse over a My Tests data point to see which days are being summarized, the number of questions taken, and score in percent.
Each My Tests data point is accompanied by a corresponding Question Volume bar, with a height proportional to how many questions were taken on the day or set of days. Mousing over the Question Volume bar will bring up the same tooltip as mousing over the corresponding data point.

Clicking a My Tests data point or within an opened tooltip will display further information about the individual tests summarized by a single data point. Move your mouse outside of the graph area to close the tooltip.

Tests are grouped into My Tests data points based on their completion date. The percent score includes questions from timed, untimed, and tutor modes, and includes questions whether or not it is the first time you have seen a particular question.

National Average: The National Average line includes the average scores of all users on a specific day - including tests taken in timed, untimed, and tutor modes. The National Average is calculated only considering the first time that each user sees a question. This data is smoothed with a 30-day moving average to reduce day-to-day fluctuation.

National 20th and 80th Percentile: The National 20th/80th Percentile line plots the score required to be included in the 20th or 80th percentile of users, respectively. These are calculated including tests taken in timed, untimed, and tutor modes. The percentiles are calculated by looking at active user's performance on their last 100 questions. This data is smoothed with a 30-day moving average to reduce day-to-day fluctuation.

Return to Top


Percentiles Chart

The Percentile Chart shows how you stand relative to your peers based on either your all time performance or your last 100 questions. You can see what percentile you are in, and what score you would need to attain to reach a higher percentile.

Percentile Chart

Key Chart Features:

See Where you Stand: Your percentile relative to your peers is shown as a black bar with a label on the top.

Score vs Percentile: The color-coded percentile bars are aligned in increasing order along the x-axis, and the height of each bar corresponds to the score required to reach that specific percentile. Mouse over a bar to see a tooltip showing what percentile is selected and what score would be required to reach that percentile.

All Time or Last 100: You can see how you stand based on your all time performance during a subscription. This compares you to your peer's all time performance. Or, you can see how your last 100 questions stack up to your peer's last 100 questions. Toggle this setting by clicking the buttons below the chart.


Data Definitions:

Overall Scores & Percentiles: Your Overall Score is calculated based on all questions taken in any mode (includes timed, untimed, and tutor), and includes questions whether or not it is the first time you've seen the question. Your peer's scores are similarly calculated including all modes and regardless of whether a question was taken multiple times. Once all active user's scores were calculated, percentiles are calculated by breaking up those users into 100 equal-sized groups.

Last 100 Scores & Percentiles: Your Last 100 Score is calculated based on the Last 100 questions taken in any mode (includes timed, untimed, and tutor), and includes questions whether or not it is the first time you've seen the question. Note that your Last 100 score only updates every 20 questions. This Last 100 score matches your Moving Average from other graphs and tables in the system. Your peer's scores are similarly calculated including all modes and regardless of whether a question was taken multiple times, and considering only each user's last 100 questions. Once all active users' Last 100 scores were calculated, percentiles are calculated by breaking up those users into 100 equal-sized groups.

Return to Top


Category Performance Chart

The Category Performance Chart displays how you are performing in each content category relative to your peers. This chart also helps you see how many questions you've taken in each category, how many unique questions are remaining, and the "weight" of each category for your exam.

Category Performance Chart

Key Chart Features:

Strengths & Weaknesses: The Category Performance Chart is sorted from your weakest category to your strongest, defined by performance in the category relative to your peers.

Change your Category Axes: For exams with Exam Blueprints containing multiple categorization axes (for instance, a "Physician Tasks" axis of categories and a "Patient Presentations" axis of categories) you can change category axis by using the dropdown. If your exam only has one categorization axis, the dropdown will not be displayed.

Performance, Completion, Importance: Each category displays information about how many questions you've taken, how your performance compares to your nationwide peers, and how "important" the category is weighted on the exam.


Data Definitions:

Completion: Completion is calculated for each category, based on how many questions are available to you and how many you've taken at least once. If you've taken half of the questions at least once, the pie chart corresponding to that category will be half full. You can mouse over the completion pie chart to see how many questions are available, how many you've taken at least once, and a count of how many questions you've taken in the category (includes duplicate times taking the same question).

Importance: Importance displays the weight of each category as described in the exam blueprint. Our content and author teams strive to ensure that our question quantities in each category reflect the distribution of questions on the actual exam. The larger the Importance bar for a given category, and the more questions from that category you should expect to see on your exam.

Q / C / I: Q/C/I displays the count of Questions (Q) you've taken in the category, the number of Correct (C) responses provided for those questions, and the number of Incorrect (I) responses. I + C will always equal Q for each category. Q/C/I are calculated using all modes, considering questions from all time during the subscription, and include questions whether or not it is the first time you've seen the question.

Overall, National, Difference: Your Overall % is simply your # of Correct answers in the category divided by the total # of Questions taken in the cateogry, or C/Q. The National average for the category is the score your peers have attained on the questions in the category in all modes. Difference is the calculated by subtracting your Overall performance for a category from the National average for that category. If your score in the category is below the national average, the Difference will show a negative red bar. Conversely, categories in which you are scoring above the national average will show positive green bars. Mouse over each Difference bar to see the numerical Difference value.

History: History shows a trendline of your performance in the category at various points throughout your subscription.

Return to Top


Improvement Chart

This chart displays your moving average performance as a function of the number of questions taken - either counting only the first time you've seen a question ('Unique Questions Only') or counting all questions including duplicates ('All Questions'). By seeing your score either increase or decrease as you take more questions, you can see your average rate of improvement and see how this compares to the National Average performance and rate of improvement.

Improvement Chart

Key Chart Features:

Visualize your Improvement: See your Moving Average calculated as you progress through the available practice questions. A Best Fit line will show your Improvement Rate trend. Note: taking randomized exams throughout your preparation will result in clearer improvement; jumping from one category to the next will obscure the improvement pattern. Your chart will 'blink' indicating your current data point.

Compare to the National Average: The National Average for your peer's as they take more and more questions is calculated, with a best fit line representing the National Average at each question count and the slope representing the National Improvement Rate.

Toggle between First Time Taken & All Questions: Switch to All Questions to see how your performance is affected by taking questions multiple times, or keep the setting on First Time Taken to only consider the first time you've seen each question for a purer assessment of improvement. Note: a National Improvement Rate is not calculated for the All Questions setting since multiple passes through the questions would skew the statistics.


Data Definitions:

My Moving Average: Your Moving Average is calculated every 20 questions and considers your prior 100 questions from that point. Your first data point will reflect questions 1-100, and the 2nd data point will consider questions 21-120, and onward. This calculation includes questions from all testing modes. Whether or not the calculation includes duplicate questions or only considers the first time each question was taken depends on whether you have First Time Taken or All Questions selected.

My Improvement Rate: The Improvement Rate is a linear best fit line through your Moving Average data. The slope is expressed in % per 1000 questions. If you've taken 500 questions and your moving average is currently at 50% with an Improvement Rate of 10% per 1000 questions, then the assumption would be that you could expect to improve your performance by 5% by taking a further 500 questions, assuming that your rate of improvement held constant. Your Improvement Rate may differ depending on whether you've selected First Time Taken or All Questions.

National Improvement Rate: National Improvement Rate is calculated by averaging your peers' moving average at each question count. This data is then fit with a Best Fit line to show a National Improvement Rate. This calculation is only performed for First Time Taken; considering other users' performance when repeating questions would likely inflate the Improvement Rate, so it is not calculated for All Questions.

Return to Top


Usage Chart

The Usage Chart shows your count of questions at different times during your subscription, and also summarizes how you are taking questions in terms of test mode and whether you are duplicating questions.

Usage Chart

Key Chart Features:

Track your Study Plan: Make a study plan for how many questions you want to complete as you prepare for your exam, and see how your actual studying tracks to your plan.

See your Testing Habits: Have you been taking more timed, untimed, or tutor mode practice questions?

Plan Multiple Passes: See how many questions you have never taken, how many you've taken exactly once, and how many you've duplicated by taking multiple times.


Data Definitions:

My Question Count: The My Question Count graph displays the count of unique questions by date. The count is cumulative, so the graph's Question Count value is always increasing or remaining flat. This graph only includes Unique Questions. Since taking questions multiple times does not increase the Unique Question Count, the count will cap out at the number of questions available for your exam.

My Questions by Test Mode: This pie chart displays the portion of all questions taken, including questions taken multiple times, that you've taken in each test mode of Timed, Untimed, or Tutor Mode. You can mouse over each section of the pie chart to see the count of questions taken in each mode.

My Question Repetition: Of all the available questions for your exam, this pie chart shows the portion that you've never taken, the portion you've taken exactly once, and the portion you've taken two or more times. You can mouse over each section of the pie chart to see the count of questions that are untaken, taken once, or taken more than once.

Return to Top


Questions, Comments, or Suggestions? Email your feedback to info@truelearn.com