What is an AI Assessment?

An AI Assessment is a conversational assessment tied to a Smart Skill. It evaluates the individual outcomes that make up the skill, the specific competencies you need to demonstrate proficiency.

You work through questions with an AI character, responding in natural language to scenarios and follow-ups that adapt based on what you say. The assessment doesn't just check whether your answer is correct. It looks at how you reason through realistic workplace situations and gives you detailed qualitative feedback on your strengths, gaps, and development opportunities.

How it works

When you start an AI Assessment, you work through one skill outcome at a time. The AI character asks questions in a conversational flow, and the direction adapts based on how you respond.

Responses stream in real time.

A progress bar at the top shows where you are in the session. Each segment represents one skill outcome, and the name of the outcome you're currently on is always displayed, so you know what's in scope. You can scroll back through earlier exchanges at any time.

Question format

AI Assessments mainly use open-ended, conversational questions.

You respond in natural language to a scenario or question. The AI follows up based on what you say, probing your reasoning, decision-making, and ability to justify your choices. Questions stay within the scope of the outcome being assessed and adapt to what you've said so far.

More formats are coming soon:

• Multiple choice - a fixed set of options with one or more correct answers. Tests recognition of concepts, facts, and distinctions.
• Sequencing - you order a set of items such as steps in a process, priorities, or dependencies. Tests structural understanding of how things relate to or follow from each other.
• Comparative A–B - two closely related options. You identify the stronger one and explain why. Tests the ability to discriminate between plausible alternatives.

An assessment can use a single format or a mix, depending on what best suits the outcome being tested.

The question format for each outcome is set during the assessment creation process. As a learner, you can’t change the format.

Scoring and results

At the end of the session, you receive:

• An overall score reflecting your performance across all outcomes.
• A qualitative summary that explains what your responses demonstrated, not just a number.
• A per-outcome breakdown showing which outcomes you passed and where there's a gap.
• The full conversation history, so you can review exactly what was asked and what you said.

Because results are outcome-level, you get a clear picture of exactly where you stand, not just an aggregate pass/fail.

You can retake an AI Assessment at any time to close a gap or improve your score.

Important: AI Assessments are scoped to the outcomes being assessed. If you respond outside that scope, the answer is scored as zero.

What makes it different

Questions are dynamically generated and adapt to your responses, so the experience adjusts to how you're thinking.

The AI evaluates reasoning quality, not just correctness. A well-explained answer scores higher than a technically right one that lacks depth.

Note: The outcomes being assessed are never generated by AI. Every outcome is defined by a QA subject matter expert, so the competencies you're tested on are accurate, relevant, and grounded in real job requirements.

Tips for a strong result

• Show your thinking. The AI is evaluating how you reason, not just what you conclude.
• Be specific. Grounding your answer in the actual scenario or skill context will always score better than a generic response.
• Stay on topic. Questions are scoped to the outcome being assessed. Responses outside that scope or comments are scored as zero.
• Treat follow-ups as an opening. If the AI asks you to go deeper, that's your chance to demonstrate more.

Feedback and issue reporting

You can share feedback directly from the assessment experience.

During the session, use the report button to flag an issue with a specific question, for example, if something is unclear or seems incorrect.

On the results page, you can leave feedback on the overall experience. This helps the content team continuously improve the quality of assessments!

Your skill profile

AI Assessment results contribute to your skill profile. At any stage, you can get a snapshot of your current proficiency level and track progress across skills.

View your skill profile