Tutorial: Creating Training Sessions with the Training Toolbar

Overview

This tutorial presents the usage of the Metacog Training Toolbar to record and playback Training Sessions, on an already instrumented widget, and in the context of a particular Learning Task. Please refer to Tutorial 02: Training and Playback Instrumentation for details about what changes are required in a widget in order to be used along with the Training Toolbar.

Target Audience

Learning experts who want to create Training Sessions for a Learning Tasks, in order to train the system with the goal of produce automated real-time scorings from Learner Sessions.

Introduction to the Training Toolbar

In a properly playback-enabled instrumented widget, you can turn on the Training Toolbar by passing mode: "training" to the Metacog.init options, and then invoking Metacog.TrainingToolbar.init(true)to initialize and display the toolbar:

As you can see in the above screenshot, in order to use the Toolbar you need to provide an authentication token. You can create as many tokens as you want, by using the proper API endpoint. For the purpouse of this tutorial, we are going to use the following auth. token:

52edbedaaffb5bd012bf71e56acdd5664296e498ca80f607ab25379c01e2089c

Once the authentication Token had been validated, the Toolbar will present the main menu:

  • Record: Create new Training Sessions by recording all the events instead of logging them to the default Learners data stream.
  • Playback: Replay an existing Training Session.
  • Score: Allows the creation of Scored Training Sessions by associating rubrics to Training Sessions. Includes the Playback toolbar.

Record a new Training Session

In order to record a new Training Session, you should provide a name, that will be associated to the authentication token you provided at the first step. It means that you may create sessions with the same name under different authentication token contexts.

Once you had defined the name, the Toolbar will enter in recording mode. A blinking red light will serve as indicator that all the events that you produce while interacting with the widget are not going to be stored as a Learner Session, but as the Training Session you are working with.

Once you are good with your recording, you can press the CLOSE button, and the recording of the Training Session will stop and the toolbar will display again the main menu (it may take a few seconds to close a session, depending on the quality of the network connection and the amount of events generated: those extra seconds are required to flush the local event queue.

In the following video you will be able to see the recording of a training session. We will use that same Training Session for the next steps: playback and scoring.

Playback an existing Training Session

The second button of the Toolbars' Main Menu is PLAYBACK. this functionality allows to browse the list of existing training sessions (again, filtered by authentication token) and make the widget to reproduce the steps while it reads the stored events from the Metacog Platform.

Playback Toolbar will offer you standard pause, play, reset and stop buttons, along with an option to change the speed of execution (use 1.0 for original speed, greater than 1 for accelerated playback and less than 1 for slow-down execution).

Scoring an existing Training Session

To Playback a Training Session is a nice feature per-se, because it can be used to show others the proper way to solve a problem or what kind of pitfalls to avoid; but it is also a fundamental tool for the SCORE mode: the traineer needs to see the recorded session in order to score it.

The Score toolbar includes both the Playback toolbar and also a new set of UI controls and panels related to scoring. But before going into the usage of those controls, you will have to make a couple of desitions about which Training Session you want to Score, and with which Rubric (Please refer to the Rubrics tutorial for more information about design and register Rubrics).

Similar to Training Sessions, Scores are identified by name. A Score associates a particular Training Session with a specific Rubric. You can create as many Scores as you want, even for the same Training Session- Rubric pair.

Scores can also be retrieved later, so you can enter the score toolbar and instead of creating a new Score you may use the search functionality to find an existing one an resume your work with it; we are going to open an existing Score and explore the options of the Scoring toolbar in the next tutorial.

Summary

We presented the three main use cases of the Training Toolbar: record, playback and score. Record can be used to create new Training Sessions, Playback is used to recover existing training sessions and performs automatic execution. Score is the most advanced functionality, that allow us to create a new kind of object (The Score) that pairs rubrics and training sessions. In the next tutorial we will use the Scoring Toolbar to retrieve a score and see how it interacts with the Rubric, by using the Score toolbar and the indicators panel.