{"id":3620,"date":"2022-11-30T18:04:24","date_gmt":"2022-11-30T18:04:24","guid":{"rendered":"https:\/\/www.gamebench.net\/?p=3620"},"modified":"2023-01-06T03:00:30","modified_gmt":"2023-01-06T03:00:30","slug":"preempting-negative-reviews-with-next-gen-game-performance-tools","status":"publish","type":"post","link":"https:\/\/www.gamebench.net\/preempting-negative-reviews-with-next-gen-game-performance-tools\/","title":{"rendered":"Preempting Negative Reviews with Next-Gen Game Performance Tools"},"content":{"rendered":"<h2 style=\"line-height: 40px; font-size: 40px;\">Part One &#8211; Visual Experience<\/h2>\n<p style=\"line-height: 110%; font-size: 18px; margin-bottom: 0;\"><strong>Game development and commercial teams may live on different planets a lot of the time. But they do share one universal pet hate: negative reviews. Complaints mean that gamers don\u2019t want to play the game anymore. They\u2019ll be telling their friends, as well as posting those damning scores and comments. For a new game, this is worse than just money left on the table \u2026 it\u2019s swept off the table altogether. Inspired by our new and radically updated <!--HubSpot Call-to-Action Code --><span id=\"hs-cta-wrapper-e941f71e-6606-4c7b-b58f-4b33c27643c3\" class=\"hs-cta-wrapper\"><span id=\"hs-cta-e941f71e-6606-4c7b-b58f-4b33c27643c3\" class=\"hs-cta-node hs-cta-e941f71e-6606-4c7b-b58f-4b33c27643c3\"><!-- [if lte IE 8]>\n\n\n<div id=\"hs-cta-ie-element\"><\/div>\n\n\n<![endif]--><a href=\"https:\/\/cta-redirect.hubspot.com\/cta\/redirect\/2891910\/e941f71e-6606-4c7b-b58f-4b33c27643c3\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" id=\"hs-cta-img-e941f71e-6606-4c7b-b58f-4b33c27643c3\" class=\"hs-cta-img\" style=\"border-width: 0px;\" src=\"https:\/\/no-cache.hubspot.com\/cta\/default\/2891910\/e941f71e-6606-4c7b-b58f-4b33c27643c3.png\" alt=\"SDK and Web Dashboard\" \/><\/a><\/span><script charset=\"utf-8\" src=\"https:\/\/js.hscta.net\/cta\/current.js\"><\/script><script type=\"text\/javascript\"> hbspt.cta.load(2891910, 'e941f71e-6606-4c7b-b58f-4b33c27643c3', {\"useNewLoader\":\"true\",\"region\":\"na1\"}); <\/script><\/span><!-- end HubSpot Call-to-Action Code -->, in this new PIQ bulletin series we focus on minimizing &#8211; wherever possible, preventing altogether &#8211; the most common App Store performance complaints from mobile gamers.<\/strong> Four critical factors &#8211; putting aside for now the worst case of game crash &#8211; make up the \u201cexperience &gt; &lt; performance\u201d dynamic: 1. Visual experience 2. Device feel (primarily temperature) 3. Device power (duration of play) 4. Network What are the dimensions of experience quality? How do performance issues impact those? And which particular metrics do we need to understand to uncover the causes, and execute the necessary game optimisations? We start the series with a deep dive into visual experience.<\/p>\n<h2 style=\"line-height: 40px; font-size: 35px;\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-1954 alignright\" style=\"vertical-align: middle;\" src=\"https:\/\/www.gamebench.net\/wp-content\/uploads\/2021\/09\/GB_evaluation_icon-1.png\" alt=\"\" width=\"55\" height=\"55\" \/>The make or breaks<\/h2>\n<p style=\"line-height: 110%; font-size: 18px; margin-bottom: 0;\">What makes for a good, bad &#8211; or just \u201cmeh \u2026\u201d &#8211; visual experience? Of course, different game formats dictate widely different aesthetic expectations. While the gamer\u2019s requirements of a typical FPS &#8211; such as the eternally popular Call of Duty &#8211; revolve predominantly around speed of action and reaction, here we focus on the more nuanced demands of the MMORPG.<\/p>\n<figure id=\"attachment_3440\" aria-describedby=\"caption-attachment-3440\" style=\"width: 640px\" class=\"wp-caption aligncenter\"><img decoding=\"async\" class=\"wp-image-3440 size-large\" src=\"https:\/\/www.gamebench.net\/wp-content\/uploads\/2022\/11\/GB-MMORPG-Black-Desert-Mobile.png\" alt=\"\" width=\"640\" \/><figcaption id=\"caption-attachment-3440\" class=\"wp-caption-text\"><center><em>The hugely successful MMORPG \u2018Black Desert Mobile<\/em><\/center><\/figcaption><\/figure>\n<p style=\"line-height: 110%; font-size: 18px; margin-bottom: 0;\">The player of an RPG is looking above all for an experience that is immersive. The game\u2019s creators are, in effect, developing a \u201ccoherent and cohesive world\u201d. While these games will normally be played with lots of other players who typically like to <a href=\"https:\/\/joywallet.com\/article\/rewarded-play-app-review\/\">play games earn gift cards<\/a> &#8211; which naturally creates its own performance challenges &#8211; certain elements not being in perfect sync is generally forgivable. That said, the essential immersiveness of the MMORPG experience is severely compromised by, for example, delays in speaking to another character. Problems with poorly-designed assets, levels not loading, and smoothness of character movement will send gamers straight to the App Store to vent their frustrations.<\/p>\n<h2 style=\"line-height: 40px; font-size: 35px;\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-1954 alignright\" style=\"vertical-align: middle;\" src=\"https:\/\/www.gamebench.net\/wp-content\/uploads\/2021\/08\/net_icon.png\" alt=\"Network Expectations\" width=\"55\" height=\"55\" \/>The back and forth<\/h2>\n<p style=\"line-height: 110%; font-size: 18px; margin-bottom: 0;\">When QA identifies an experience problem, a series of formal test stages are initiated. The basics of this iterative process are Replication, Diagnosis, and back to Development.<\/p>\n<figure id=\"attachment_3440\" aria-describedby=\"caption-attachment-3440\" style=\"width: 640px\" class=\"wp-caption aligncenter\"><img decoding=\"async\" class=\"wp-image-3440 size-large\" src=\"https:\/\/www.gamebench.net\/wp-content\/uploads\/2022\/11\/GB-PIQ-10-Process-trans-.png\" alt=\"\" width=\"640\" \/><figcaption id=\"caption-attachment-3440\" class=\"wp-caption-text\"><center><\/center><\/figcaption><\/figure>\n<p style=\"line-height: 110%; font-size: 18px; margin-bottom: 0; margin-top: 0;\">First, the issue is replicated by QA, and the results sent back to the development team, so they can start looking at possible optimizations. It\u2019s not for GameBench to dictate how to optimize the game. But we\u2019ll provide analytics to detect and analyze further using metrics such as framerate, CPU and GPU utilization and network interference. Visual experiences are normally highlighted through the traditional FPS measurement. Once we have detected a problem, there may be possible causes requiring further data collection. For example, if CPU utilization is high, but network and GPU are low, we need to look at more physics or computation issues in the game. If we see high GPU utilization, but low network and CPU, we look into assets and rendering issues. Network is always worth considering, since downloaded data needs processing, involving the CPU. If the CPU falls behind in physics work, then visual experience will falter. Now we know that we need to collect FPS, CPU, GPU and network. We can establish a predefined test, to set a performance threshold and to check the effect on frame rate, while observing changes in the other metrics. Importantly, each collection of valid and useful test data reduces the number of cycles between replication, diagnosis and development.<\/p>\n<h2 style=\"line-height: 40px; font-size: 35px;\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-1954 alignright\" style=\"vertical-align: middle;\" src=\"https:\/\/www.gamebench.net\/wp-content\/uploads\/2021\/08\/GB_GPM_monitor_icon.png\" alt=\"next-gen game performance tools\" width=\"55\" height=\"55\" \/>The next-gen tools<\/h2>\n<p style=\"line-height: 110%; font-size: 18px; margin-bottom: 0;\">Let\u2019s put this into practice using GameBench\u2019s <!--HubSpot Call-to-Action Code --><span id=\"hs-cta-wrapper-48b9c37b-d1c7-4dde-877e-8eb3f98942af\" class=\"hs-cta-wrapper\"><span id=\"hs-cta-48b9c37b-d1c7-4dde-877e-8eb3f98942af\" class=\"hs-cta-node hs-cta-48b9c37b-d1c7-4dde-877e-8eb3f98942af\"><!-- [if lte IE 8]>\n\n\n<div id=\"hs-cta-ie-element\"><\/div>\n\n\n<![endif]--><a href=\"https:\/\/cta-redirect.hubspot.com\/cta\/redirect\/2891910\/48b9c37b-d1c7-4dde-877e-8eb3f98942af\"><img decoding=\"async\" id=\"hs-cta-img-48b9c37b-d1c7-4dde-877e-8eb3f98942af\" class=\"hs-cta-img\" style=\"border-width: 0px;\" src=\"https:\/\/no-cache.hubspot.com\/cta\/default\/2891910\/48b9c37b-d1c7-4dde-877e-8eb3f98942af.png\" alt=\"Studio SDK\" \/><\/a><\/span><script charset=\"utf-8\" src=\"https:\/\/js.hscta.net\/cta\/current.js\"><\/script><script type=\"text\/javascript\"> hbspt.cta.load(2891910, '48b9c37b-d1c7-4dde-877e-8eb3f98942af', {\"useNewLoader\":\"true\",\"region\":\"na1\"}); <\/script><\/span><!-- end HubSpot Call-to-Action Code -->. You can integrate the package into your game engine as a library, or import into a Unity project via the package manager. That done, you can configure your collection, or just leave it to collect automatically.<\/p>\n<p><figure id=\"attachment_3440\" aria-describedby=\"caption-attachment-3440\" style=\"width: 640px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-3440 size-large\" src=\"https:\/\/www.gamebench.net\/wp-content\/uploads\/2022\/11\/GB-SDK-native-integration.png\" alt=\"\" width=\"640\" height=\"347\" \/><figcaption id=\"caption-attachment-3440\" class=\"wp-caption-text\"><center><em>SDK Native Integration<\/em><\/center><\/figcaption><\/figure> <figure id=\"attachment_3440\" aria-describedby=\"caption-attachment-3440\" style=\"width: 640px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-3440 size-large\" src=\"https:\/\/www.gamebench.net\/wp-content\/uploads\/2022\/11\/GB-unity-SDK-package-manager.png\" alt=\"\" width=\"640\" height=\"347\" \/><figcaption id=\"caption-attachment-3440\" class=\"wp-caption-text\"><center><em>Unity SDK package manager with simple configuration <\/em><\/center><\/figcaption><\/figure><\/p>\n<p style=\"line-height: 110%; font-size: 18px; margin-bottom: 0; margin-top: 0;\">All the data recorded in the SDK is sent to the GameBench Unified Web Dashboard. From here we can start to inspect each recording (or session as we call it). We should now be able to replicate all the relevant performance problems. On your Dashboard home page, select your package and apply your test thresholds, focusing on all the test data from a particular version.<\/p>\n<figure id=\"attachment_3440\" aria-describedby=\"caption-attachment-3440\" style=\"width: 640px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-3440 size-large\" src=\"https:\/\/www.gamebench.net\/wp-content\/uploads\/2022\/11\/GB-dashboard-metric-thresholds.png\" alt=\"\" width=\"640\" height=\"347\" \/><figcaption id=\"caption-attachment-3440\" class=\"wp-caption-text\"><center><em>Metric thresholds for rapid and confident release decisions <\/em><\/center><\/figcaption><\/figure>\n<p style=\"line-height: 110%; font-size: 18px; margin-bottom: 0; margin-top: 0;\">Start by defining the target FPS &#8211; in this case, for a MMORPG 60 FPS is a standard goal. Tweak your thresholds for the CPU and GPU to highlight sessions that are failing. From here, you immediately isolate the problem devices, so a reliable decision can be made on the severity of the experience problem. Finally, share these views with your development team, and\/or raise a Jira against the most important sessions.<\/p>\n<h2 style=\"line-height: 40px; font-size: 35px;\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-1954 alignright\" style=\"vertical-align: middle;\" src=\"https:\/\/www.gamebench.net\/wp-content\/uploads\/2021\/08\/radial_icon.png\" alt=\"\" width=\"55\" height=\"55\" \/>Conclusion<\/h2>\n<p style=\"line-height: 110%; font-size: 18px; margin-bottom: 0;\"><strong>All of the work we\u2019ve done this year on the GameBench Studio tools has been focused on both enriching and accelerating this back and forth between testing and development. While these are the day-to-day outcomes we\u2019re targeting, the bigger prize &#8211; where technology and commercial concerns really connect &#8211; is the rapid and confident release of a game that suffers as few negative App Store reviews as possible.<\/strong><\/p>\n<blockquote class=\"blockquote\">\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-1961 size-large\" src=\"https:\/\/www.gamebench.net\/wp-content\/uploads\/2021\/08\/GB-PIQ_V2-768x164-1.png\" alt=\"\" width=\"640\" height=\"137\" \/><\/p>\n<p><em>Performance IQ<\/em> by GameBench is a hassle-free, one-minute read that keeps you abreast of precisely what you need to know. Every two weeks, right to your inbox. Here\u2019s a quick and easy sign up for your personal invite to the sharp end of great gamer experience.<\/p>\n<p><!-- [if lte IE 8]><br \/>\n<script charset=\"utf-8\" type=\"text\/javascript\" src=\"\/\/js.hsforms.net\/forms\/v2-legacy.js\"><\/script><br \/>\n<![endif]--><br \/>\n<script charset=\"utf-8\" type=\"text\/javascript\" src=\"\/\/js.hsforms.net\/forms\/v2.js\"><\/script><br \/>\n<script>\n  hbspt.forms.create({\nregion: \"na1\",\nportalId: \"2891910\",\nformId: \"11fad1f6-ecfe-42ee-a907-04f3e8734ac3\"\n});\n<\/script><\/p>\n<p>And of course, <a href=\"https:\/\/www.gamebench.net\/get-in-touch\/\">get in touch anytime for an informal chat about your performance needs<\/a>.<\/p>\n<\/blockquote>\n<p>&nbsp;<\/p>\n<p style=\"text-align: center;\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1455 aligncenter\" src=\"https:\/\/www.gamebench.net\/wp-content\/uploads\/2021\/08\/GB-Logo_150w-1.png\" alt=\"The Intelligence Behind Oustanding Gaming, Streaming and Network Performance\" width=\"150\" height=\"19\" \/>The intelligence behind outstanding performance<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Part One &#8211; Visual Experience Game development and commercial teams may live on different planets a lot of the time. But they do share one universal pet hate: negative reviews. Complaints mean that gamers don\u2019t want to play the game anymore. They\u2019ll be telling their friends, as well as posting those damning scores and comments. [&#8230;]<\/p>\n<p><a class=\"btn btn-secondary understrap-read-more-link\" href=\"https:\/\/www.gamebench.net\/preempting-negative-reviews-with-next-gen-game-performance-tools\/\">Read More&#8230;<\/a><\/p>\n","protected":false},"author":6,"featured_media":3621,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"content-type":"","inline_featured_image":false,"footnotes":""},"categories":[57],"tags":[],"acf":[],"_links":{"self":[{"href":"https:\/\/www.gamebench.net\/wp-json\/wp\/v2\/posts\/3620"}],"collection":[{"href":"https:\/\/www.gamebench.net\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.gamebench.net\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.gamebench.net\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/www.gamebench.net\/wp-json\/wp\/v2\/comments?post=3620"}],"version-history":[{"count":4,"href":"https:\/\/www.gamebench.net\/wp-json\/wp\/v2\/posts\/3620\/revisions"}],"predecessor-version":[{"id":3654,"href":"https:\/\/www.gamebench.net\/wp-json\/wp\/v2\/posts\/3620\/revisions\/3654"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.gamebench.net\/wp-json\/wp\/v2\/media\/3621"}],"wp:attachment":[{"href":"https:\/\/www.gamebench.net\/wp-json\/wp\/v2\/media?parent=3620"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.gamebench.net\/wp-json\/wp\/v2\/categories?post=3620"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.gamebench.net\/wp-json\/wp\/v2\/tags?post=3620"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}