Skip to main content

Reviewing Role Play sessions, evaluations and feedback

After a role play is created, the Role Play Details page lets you review its design and every session learners have run, with the full conversations and evaluation results.

Reviewing Role Play sessions, evaluations and feedback

After a role play is created, the Role Play Details page lets you review its design and every session learners have run, with the full conversations and evaluation results.

Open the role play

  1. Go to Learn > Learn Content and open the content item.

  2. Select the Content Management tab.

  3. Open the Role Play row (it shows Active, or Draft if it is not published yet). The Role Play Details page opens.

Role Play Details: Overview

The Overview tab shows the role play design:

  • Persona and Character: who the AI plays and their description.

  • Language, Expected duration and Status (Draft, Live or Archived).

  • Skills: the skills the role play exercises.

  • Milestones: the stages of the scenario, each with a name, an optional duration and a description.

  • Evaluation Metrics: the rubric criteria, each with the skills it maps to and a description.

From this page you can also Preview (test) the role play, Edit it with the Role-Play Coach Agent, Publish it if it is still a draft, or Delete it. See Testing and publishing a Role Play.

The Sessions list

The Sessions tab lists every learner attempt with User, Status (Completed, In progress or Abandoned), Score, Turns, Duration and Started.

Session details, evaluation and feedback

Click a session to open its details:

  • The Conversation between the learner and the persona.

  • The Evaluation: the overall result (Passed or Did not pass), the score as a percentage and in points, each criterion's score with its feedback note, and the overall Feedback.

If a session was not evaluated, the details show "This session was not evaluated."

From sessions to validated skills

Each evaluated session records evidence for the skills its criteria map to, and that evidence accumulates for each user over time. For the full model, including when a skill counts as validated, see How role-play sessions feed the skills engine.

Did this answer your question?