Crosstab Analysis + Updating The Order Rank Formula
Crosstab Analysis
The Segments Tab now lets you cross-tabulate results from Multiple Choice and Rating Scale questions. This means that OpinionX now offers automated crosstab analysis as well as segmentation analysis.
There's no setup required to use these features — if your survey has any Multiple Choice or Rating Scale questions, then the crosstab tables will appear automatically on your Segments Tab. All you have to do is pick which participant segments you want to include and the crosstab will calculate itself in seconds.
Crosstabs on OpinionX should be read vertically where each column adds up to 100%, whereas the rows act as the analysis variable. For example in the screenshot above, 58% of managers that only have 1 direct report have been with the company for less than 1 year.
--
Order Rank Scoring Update
We rolled out a minor update to the formula used to calculate Order Rank results this morning, so some users may notice small changes to the scores on their Order Rank surveys. The short explanation is that the Dowdall Count formula now includes unranked positions when calculating the average score for each option. If you want to know more about this change, I've included a more detailed explanation below :)
OpinionX uses a formula called the "Dowdall Count" to turn ranked choice voting into numerical scores. Each time an option is ranked, it gets points using the formula 100/rank, for example ranking an option as 4th will give it 100/4 = 25 points. The benefit of the Dowdall Count method is that it allows each participant to rank a different amount of options without any negative impact on their influence over the final results, so survey creators can give participants flexibility to only include options that are relevant to them without setting a hard limit or forcing participants to rank all the options (unlikely almost all other Borda Count scoring methods used on other survey tools). When we moved to the Dowdall Count method for calculating Order Rank results back in April 2023, we decided that the scoring formula should only include ranked positions when calculating the average score and not any exclusions. Today's update to the scoring formula changes this by including any instances where an option is "unranked" in the calculation of its average score (ie. zeros from unranked submissions are now counted towards the option's average score). The main benefit of this is for surveys that limit ranking to a subset of the total options, like saying "Rank only your top 5 from the list below". We've rolled this update out to all past and future surveys using the Dowdall Count formula on OpinionX, so some users might notice minor changes to the scores of their previous surveys which may now appear to have slightly lower numbers than previously. Overall, our analysis has found that few Order Rank surveys created in the past year will see actual changes to their ranked results due to this update.