Call of Duty’s multiplayer matchmaking relies heavily on a custom SBMM (skill-based matchmaking) system, which has garnered both praise and criticism. Critics argue that SBMM creates a predictable and monotonous experience, where players consistently face opponents of similar skill, leading to a lack of surprise and challenge. SBMM’s core function is to pair players with others of comparable ability, ensuring fair and competitive matches.
However, in an in-depth report exploring the intricacies of Call of Duty’s matchmaking, Activision revealed a secret experiment conducted in early 2024. This experiment, dubbed ‘Deprioritize Skill Test in Call of Duty: Modern Warfare III,’ involved removing the standard skill-based matching for a portion of the North American player base. Roughly 50% of players were placed into random matches without the usual skill check and grouping, while the remaining 50% continued with the standard SBMM configuration.
This experiment ran for a month, and the results were startling. Outside of the top 10% of players, the player retention rate plummeted by a staggering 90%. While the difference was marginal for the top tier players, Activision believes that this drop would compound over time. The report concludes that completely removing skill-based matching would lead to a rapid decline in the player population, ultimately harming the overall experience for everyone.
The report sheds light on the meticulous attention to detail that goes into creating the world’s most popular videogame franchise. Activision’s ‘Player First’ philosophy extends to even the most intricate aspects of the game, including the matchmaking system. To determine a player’s skill and assign them to a ‘Skill Bucket,’ Activision meticulously analyzes their performance across various metrics like kills, kill/death ratio, and kill assists. Despite popular belief, intentionally sabotaging your performance won’t lower your skill ranking.
Ultimately, Activision’s focus is on keeping players engaged and returning for more. This report serves as a testament to their mastery in creating a gaming environment that fosters player retention, highlighting the critical role that SBMM plays in this delicate balance.
