Bowen Chen

As your apps scale, testing can become repetitive, manual, and time-consuming, leading to slower release cycles and lower-quality code. Sofy is a SaaS platform that enables you to create and run automated tests on your mobile apps without writing any code. Sofy will automatically test your mobile apps on real iOS and Android devices, so you can optimize their performance and debug end-user experiences without setting up or maintaining your own test infrastructure.

To get deeper insights into your Sofy mobile app test results, you can now install the Datadog Sofy integration and purchase a subscription to Sofy in the Datadog Marketplace. In addition to exploring Sofy mobile test performance metrics in an out-of-the-box dashboard, you can also use these metrics to configure Datadog monitors and SLOs that can help you proactively improve the performance of your mobile apps.

In this post, we’ll cover how to use the Sofy dashboard to monitor your mobile app’s response to test executions. We’ll also show you how to configure alerts to detect issues affecting your mobile app.

Visualize performance metrics from Sofy mobile app tests

After you’ve installed the Sofy integration, you’ll need to configure Sofy to begin sending your mobile app testing performance data to Datadog. You can do this by navigating to the App Manager in Sofy and selecting the mobile apps you’d like to monitor with Datadog, as shown below.

Your mobile app test results will now be available in the out-of-the-box Sofy dashboard. Using the dashboard, you can visualize key metrics, such as CPU, memory, and network utilization, along with the load time of user displays. The dashboard makes it easy to filter by test name, execution ID, and status (pass/fail), so you can scope your metrics to suit the needs of your investigation. For example, you can filter the dashboard by test run status to only view metrics from failed test runs, as shown below. If you’re experiencing application crashes or issues that are ending your tests prematurely, you can track your mobile app’s CPU, memory, and network utilization to see if any of these metrics spiked prior to a crash.

The dashboard also enables you to correlate trends in device resource utilization with performance metrics. As your users navigate through your mobile app, you’ll want to ensure that user-display load time falls within reasonable bounds. If you notice spikes in CPU alongside high user-display load time, you can navigate to the Sofy platform to review the step-by-step test execution and identify the exact user actions that encountered issues.

Debug mobile app performance issues faster

Once you’ve integrated Sofy with Datadog, you can configure monitors that alert you when your mobile app’s utilization metrics cross a defined threshold during test executions. You can also create SLO alerts that help you ensure that your mobile applications are delivering a positive experience to customers.

Automated alerts can help you identify performance regressions or bugs that are causing your application to crash. For example, you can configure monitors to alert you to high CPU load (as shown below) or excessive user-display load times that are visibly affecting end-user experience. When you get alerted, you can continue your investigation in the Sofy platform by inspecting crash logs and other additional context that can help you further debug.

If an alert notifies you to an issue that requires an immediate response, you can use Datadog Incident Management to create an incident. This creates a central hub where you can assign remediation items to team members and monitor incident-related Slack communications as well as a timeline of critical events. After you’ve addressed an incident of degrading test performance, you can launch another test execution in Sofy. By filtering the dashboard by TestName, you can then compare your tests’ resource performance and utilization before and after changes were made. Doing so can help you determine whether your changes successfully resolved the issues at hand and resolved customer impact.

Get started with Sofy and Datadog today

The Datadog Sofy integration enables you to visualize and alert on key performance metrics from your mobile apps as they undergo testing. You can get started by purchasing a subscription to Sofy in the Datadog Marketplace. If you don’t already have a Datadog account, you can sign up for a free 14-day trial today.

The ability to promote branded marketing tools is a membership benefit offered through the Datadog Partner Network. If you’re interested in developing an integration or application that you’d like to promote, you can contact us at marketplace@datadog.com.