{"id":3517,"date":"2022-10-06T13:56:33","date_gmt":"2022-10-06T13:56:33","guid":{"rendered":"https:\/\/www.gamebench.net\/?p=3517"},"modified":"2022-11-17T16:53:42","modified_gmt":"2022-11-17T16:53:42","slug":"a-step-change-in-gaming-qa","status":"publish","type":"post","link":"https:\/\/www.gamebench.net\/a-step-change-in-gaming-qa\/","title":{"rendered":"A Step Change in Gaming QA"},"content":{"rendered":"

Transforming Performance Management for Confident and Rapid Release<\/h2>\n

On Thursday 13th October \u2013 5PM GMT \/ 12PM EST \/ 9AM PST \u2013 GameBench is running the second of our free-to-attend Performance IQ<\/em> webinars<\/a> focused on the transformative potential of scale and automation in game performance management. In advance, we summarize below the implications of our latest developments.<\/br>
\nThe Studio SDK<\/a> – our embedded performance monitoring solution – has revolutionised the effectiveness and efficiency of game performance management. Further recent developments in the SDK, along with a radical evolution in the associated Web Dashboard, have dramatically moved the needle for devops and QA.<\/strong><\/p>\n

\"GameExponential scale in testing and analysis<\/h2>\n

GameBench\u2019s current development path is dedicated to the systematic automation of all possible aspects of performance testing and analysis. The goal is to both simplify and accelerate the route to release, by significantly reducing the traditional manual back-and-forth between new versions and device performance issues.<\/br>
\nHere\u2019s our Studio SDK Product Manager, Andrew Fester:<\/br>
\n\"Andrew\u201cBefore these latest changes, users could see the data and individually assess each testing session. We could compare two or three data points, which was useful, but didn\u2019t realize the full potential of our tools. Now, within a single day, instead of running say five sessions, we can feasibly run 200-300 sessions.<\/br>
\nBut to inspect each one of these multiple sessions, and find a problem, would be a huge amount of manual work. So to achieve economies of scale, we\u2019ve built out from what started as a raw data point system, to create an evolved analytics platform.<\/em>\u201d<\/br>
\nRight from the homepage of the dashboard, users now have immediate visualization of the most critical performance issues. From there, they can navigate directly to rich comparative analysis of the relative performance of multiple devices, with anomalies identified and isolated against the developer\u2019s own device tiering. <\/p>\n

\"\"
The new GameBench Web Dashboard homepage immediately displays critical test results<\/em><\/center><\/figcaption><\/figure>\n

\"NetworkRapid and flexible device tiering<\/h2>\n

Identifying and grouping mobile devices into performance tiers, based on realistic thresholds, is a long-standing challenge to game developers. It\u2019s both technically and commercially critical, because it frames the performance trade-offs that balance the optimum gamer experience on higher-end devices, with maximum market penetration – i.e. playability – through mid- and lower spec devices.<\/br>
\nHere\u2019s GameBench founder and CTO Karthik Hariharakrishnan:<\/br>
\n\"Karthik\u201cDevelopers naturally want to introduce performance improvements with reduced failures. This means understanding poorly-performing devices according to easy-to-set thresholds, and isolating devices that are not performing well over builds. So these latest features across the SDK and the dashboard now provide a much easier method to track the performance of a group of devices that belong to different tiers.<\/em>“<\/p>\n

\"\"
Users can now intuitively drill down to filtered sessions displaying failed metrics.<\/em><\/center><\/figcaption><\/figure>\n

“We\u2019re giving our users \u2018go \/ no-go confidence\u2019, enabling them to create their own device tiers and pinpoint problematic devices. In other words, what was previously more of an educated guess, becomes a far more rapid and well-informed decision.<\/em>“<\/br>
\nThe preceding Performance IQ<\/em> webinar on Game Performance Automation can be viewed here<\/a>. And the related PIQ bulletin is here<\/a>.<\/br>
\nRegister now<\/a> to join the in-depth discussion on October 13th! We look forward to seeing you then and there.<\/strong><\/p>\n

\n

\"\"<\/p>\n

Performance IQ<\/em> by GameBench is a hassle-free, one-minute read that keeps you abreast of precisely what you need to know. Every two weeks, right to your inbox. Here\u2019s a quick and easy sign up for your personal invite to the sharp end of great gamer experience.<\/p>\n


\n