FAQ: 2023 Norm and Scoring Upgrade
Question
Response
How did the scoring change for the HPI and HDS and what makes this scoring approach better?
The HPI and HDS both originally used a two-point True/False response scale. In September 2018 Hogan started collecting responses on the HPI and HDS using a four-point response scale (Strongly Agree, Agree, Disagree, and Strongly Disagree). The upgrade to a four-point response scale increases the range of possible responses, which allows participants to choose answers that better reflect how they feel about each HPI and HDS item. This approach allows for more precise scoring of the main scales and subscales, which further enhances the already considerable interpretive power of the assessments.
What is a norm? How is it used?
A norm is a set of data collected from people who have completed the Hogan assessments. We use these norms to convert a person’s raw scores into more meaningful percentile scores, which tell us how that person’s scores compare to the scores of other people in the norm.
For example, if a person has a percentile score of 45, that person scored the same as or higher than 45% of the norm group.
With the move to a four-point response scale, a new data set was required in order to provide the appropriate corresponding percentile scores. We started collecting these norm data in 2018 and finalized this new global norm in late 2022.
What are the benefits of using the upgraded scoring and norm?
By moving from a two-point to a four-point response scale, we are increasing the precision with which we can measure and generate main scale and subscale scores. Think of this as adding more degrees on a thermometer, more marks on a ruler, or more notches on a belt.
Primarily, we expect this increased precision will result in an improved feedback experience for participants. Because we can now make finer distinctions in how people score, participants should find their results to be even more “on target,” particularly at the subscale level.
Additionally, there are multiple benefits in using the related upgraded norm. Because this norm is based on the latest data gathered by Hogan, it provides better representation of work-relevant demographic groups, including age, gender, job, industry, and assessment language. Some notable changes are:
Gender representation improved by 8 points
- Previous Norm: 42% women/58% men
- New Norm: 46% women/54% men
Number of countries/territories increased by 11
- Previous Norm: 179
- New Norm: 190
Number of languages and dialects up to 48 total, with Lithuanian, Montenegrin, and Slovene being new additions
Should I change how I interpret the results?
No. You can interpret main scale percentile scores and subscale “brick” counts in the exact same way you currently do. We are changing nothing about the underlying dimensions or constructs that our assessments measure or predict.
When will the new scoring and norms become available?
Starting June 1, 2023, the new norms will be in place for clients who use off-the-shelf reports and those clients whose custom report scoring was not meaningfully affected by the upgrade.
How do I start using the new scoring and norms?
The move to the new scoring and norms will be automatic for most clients, so it’s likely you won’t have to do anything!
For a small set of clients whose custom report scoring is affected by the upgrade, Hogan will make scoring recommendations and will implement the changes once approved by the client. Any clients using a web service integration should also confirm with Hogan that they are using the latest norm ID.
Is there an additional cost for using the new scoring and norms?
No.
Where can I find more information?
Your Hogan representative can provide you with the full technical documentation for the upgraded scoring and norm.