The series is in six short webinars (workshops) that range from 60 to 90 minutes plus time for Q & A.  Participants will receive a digital workbook for each session plus a Quick Start Quality Control Guide with job-aids.  The cost for the whole series is $394, a $30 savings.  The cost for ISPI members is $364 and the cost for Hale Center Professional Members is $334

Workshop 1: Testing Basics

You will be able to explain to others:

• What a test is
• What the different types of tests are
• What makes a test valid, fair, reliable, and equitable

Workshop 2: What to Test and How

You will be able to:

• Explain the process for deciding what to test and how to test it
• Design a job study
• Create operational definitions
• Create and use a test blueprint

Workshop 3: How to Develop Multiple-Choice Questions that Measure Higher Level Skills

You will be able to:

• Write questions (also called stems or items) that comply with best practices
• Write responses (correct and wrong answers) that are parallel in construction and lack specific determiners (cues)
• Develop multiple-choice questions that measure the knowledge and skills your situation requires

Workshop 4: How to Build Effective Performance Tests

You will be able to:

• Choose the best type of performance-based test given your situation
• Decide what type of scoring tool to use
• Design your performance-based test so it complies with the guidelines

Workshop 5: How to Build Effective Checklists for Scoring Performance Items

You will be able to:

• Create performance checklists for judging
• • People’s ability to execute a procedure fairly and consistently
    
  • If a work product possesses the desired attributes
    
• Qualify Evaluators (Judges)
• Calibrate the scoring of the performance checklists

Workshop 6: How to Build Effective Rubrics for Performance Items

You will be able to:

• Create rubrics to fairly and consistently judge people’s ability to perform a cognitive or physical task, procedure, or process
• Calibrate ratings across evaluators

Mini-Series:

How to Get Valid Data

The series is in six short webinars (workshops) that range from 60 to 90 minutes plus time for Q & A. Participants will receive a digital workbook containing the presentation, job aids, and reference materials.  You will be able to design and conduct the data gathering method and analyze the results.  The cost for the whole series is $404, a $30 savings.   The cost for ISPI members is $374 and the cost for Hale Center Professional members is $344.

Workshop 1: How to Conduct Observational & Cognitive Interviews and Interpret the Results

This is a key skill for anyone who has been charged with finding out how experts do their work and why they make the decisions they do.  You will get a set of questions you can adapt and a protocol for setting up and conducting the process. You will find out how to avoid common mistakes.  You will be able to extract information from an interview to create Performance Statements, Course Content, and Assessments.

Workshop 2: How to Conduct Critical Incident Interviews and Interpret the Results

Ever wonder why some people are better at work than other people?  This data gathering method is specifically designed to surface the attributes that discriminate those who do well from those who do average.  You get guidelines and questions for conducting the interview that you can refine for your own situation, as well as guidelines on how to interpret the results.

Workshop 3: How to Conduct a Nominal Group and Interpret the Results

The NGT is a proven technique for managing groups, especially when members differ in communication skills, personality, and levels of authority.  The NGT can be used to identify skills and knowledge as well as what distinguishes people who are effective in their work.  

Workshop 4: How to Conduct a Sociogram and Interpret the Results

This technique is used to graphically display a group’s communication patterns, specifically who members choose to ask for guidance, information, and recognition.  It is used with intact work groups to identify leaders and social cliques, measure group cohesiveness, and find out who is really in charge.

Workshop 5: How to Conduct a Flanders Interaction Analysis and Interpret the Results

This technique is used to capture communication patterns between members of a work group. It tracks who initiates, responds, passes judgment, acknowledges, and the like. The results are used to help groups communicate more effectively.

Workshop 4: How to Develop Effective Surveys and Interpret the Results

Surveys are the most used method for getting information. Their results support marketing decisions and job task analyses.  Surveys can validate data from other sources.  This session covers the rules for constructing surveys so you can interpret the results.

Mini-Series:

Practical Psychometrics & Analytics

The series is in six short webinars (workshops) that range from 60 to 90 minutes plus time for Q & A.  Participants will receive a digital workbook for each session containing copies of the presentation, job aids, and resources.   The cost for the whole series is $414, a $30 savings.  The cost for ISPI members is $384 and the cost for Hale Center Professional members is $354.

Workshop 1: Psychometric Basics

This session explains: 1) measurement, evaluation, psychometrics, analytics, and pragmatics and what each perspective has to offer; 2) the difference between quantitative and qualitative data, 3) what makes data hard compared to soft and why it matters, 4) the typical data sources, and 5) common data gathering and analysis methods.

Workshop 2: How to Control the Four Sources of Bias (Sampling, Construct, Content, and Administrative)

Bias is a part of every study; however, it can be managed, even mitigated with the proper steps.  Otherwise, bias can lead to bad decisions.  The focus of this session is on how to manage bias.

Workshop 3: Methods for Analyzing Quantitative Data using Excel and the Questions they Answer (Standard Deviation, ANOVA, Correlations, Two-Tailed t-tests, Chi Square Goodness of Fit, T and Z Scores)

Psychometrics and data analytics use different statistical formula to answer questions and guide decisions.  Test administrators also rely on the use of quantitative analyses to evaluate the validity and reliability of their tests.  This session explains the more frequently used statistical methods and the questions they are designed to answer.

Workshop 4: How to Analyze Qualitative Data

This session is about how to code and weight qualitative data so you can apply statistical methods to analyze the data.  The methods apply to survey, interview, observation, and focus group data whether the data are recorded using rubrics, checklists, or lists.

Workshop 5: Guidelines for Standard Setting and Establishing a Pass Scores

One of the more politically charged questions is, what is good enough?  Standard setting is about answering this question.  There are numerous methods, and each has its tradeoffs.  This session explains and compares seven of the more frequently used methods.

Workshop 6: How to Do Item Analyses and Determine the Equivalency of Test Forms

This session is about how to determine if multiple tests forms are equivalent and confirm they measure the same things at the same level of difficulty.  The session also describes how to conduct item analyses it identify underperforming items.