Digital Transformation has changed the way that businesses interact with their customers and that relationship is constantly evolving. Customer interactions are no longer confined to a brick and mortar store, or even a service line or a website. The main ways customers and businesses interact these days is by using web and mobile applications.
From shopping, to baking, to investment management and trip planning, customers expect to be able to complete all of these tasks from their mobile phones.
This drives businesses worldwide to release applications at an ever growing pace. Some basic statistical analysis tells us that in 2017 almost 2,500 new apps were released every day. That is a staggering number.
Nothing is static however and as quickly as new apps are released new technology changes the digital view of these applications. New hardware (Alexa), new devices and smartwatches and new operating systems and updates are released sometimes as quickly as every two weeks. This year alone Apple released three new phone models (iPhone 8, iPhones 8+, iPhone X).
All of these factors serve to make application development and testing much more complex. Not only must you develop an app that stands out from the millions of other applications but it also must function across a huge matrix of devices, OS versions, and browser versions. Organizations must also take updates into account as web app updates happen almost daily, and mobile apps are updated every 1-2 weeks. This is to say nothing of the fact that the apps and updates need to function well or they will be poorly rated by your users.
So what is a company to do?
To start, they need to test their applications across thousands of digital combinations to make sure their web and mobile apps perform correctly.
The most important thing is to be able to automate any feature or complex scenario or third-party application. Pulling back from manual dependencies is essential in helping to increase your test automation coverage and allow you to release high quality applications faster.
At Experitest, providers of the SeeTest Quality Assurance Platform for Web & Mobile Apps, are no different.
But first, for those of you who don’t know, the SeeTest Quality Assurance Platform for Web & Mobile Apps. allows developers and QA to continuously test and release mobile and web applications. You can integrate with industry open source tools such as Appium and Selenium and execute against a large inventory of mobile devices and web browsers for quick results.
Cross Browser testing
With digital transformation happening everywhere and more mobile and web applications being released than ever before, the main challenge is to ensure application quality across all possible platform combinations.
While native mobile apps need to be tested on dozens of iOS, and Android OS system versions, as well as device models, web apps need to be tested on all of the desktop browsers that a customer might be using. This includes over 1,100 versions of Chrome, Safari, IE, Firefox, and Edge browsers. Let’s not forget the need to test on different Windows and OS X versions as well.
Experitest has introduced Cross browser testing. Cross browser testing allows developers and QA to test their web apps to make sure that they run on any configuration of the device model, operating system, and browser type across mobile and desktop.
It allows users to run your automated tests for your web application in parallel on a near unlimited number of desktop browsers, real iOS and Android devices, simulators and emulators. You can run your existing Selenium tests written in any language (Ruby, Python, Java, Perl, C#, JS) using any IDE (Eclipse, IntelliJ Visual Studio) and testing framework (TestNG, JUnit).
With this new feature, you can use your Selenium based automated tests to trigger mass cross-platform testing on numerous devices and browsers all at once. This will increase your test coverage and accelerate your testing cycles. As with all of our testing solutions there are visual test reports that you will have access to at the end of every test execution so there will be no mystery when it comes to learning from the results of a cross-platform test run.
Parallel execution of XCTest and Espresso tests
The need for faster testing has increased the need for more automated testing coverage and a step back from manual testing.
The growth of automation testing pairs perfectly with Shift-Left methodology. The development process has changed drastically over the years with DevOps and CICD methods. In that same span however, testing has remained somewhat static and as a result has become a bottleneck. Shift-Left, is doing for testing what DevOps has done for development.
The Shift-Left methodology starts with a shift in mindset, Developers must realize that they are the gateway to a feature or application being released. This increase in ownership leads to a shift in responsibility. Developers will take more responsibility for their work when they know they are the gateway to a release. The next shift is in timing. Testing happens earlier and more often to help each step of the code.
Experitest released integrations with XCTest and Espresso. These integrations allow developers to run tests developed in Espresso (Android Studio test automation framework) and XCtest (Xcode test automation framework) in parallel across a large number of real mobile devices, simulators and emulators. These test suites are carried out on a robust cloud environment, the Digital Assurance Lab, that can be either hosted in your enterprise premises or at Experitest data centers (SaaS). This capability allows you to test earlier, and more often in the development process. Once your test suites have run you will receive detailed and visual test reports to help you analyze your faults. The quick feedback helps you fix errors in the code quickly, while the code is still in your mind. These short Dev-test feedback loop enable developers to push better quality code into the build process and eventually reduces the amount of bugs detected later on.
Grid Execution – Web & Mobile
The SeeTest Grid Execution – Web & Mobile capability provides developers and QA engineers with the ability to execute large-scale parallel execution of tests on an unlimited number of desktop browsers and mobile devices (real/emulated). These browsers and mobile devices are hosted in the SeeTest Digital Assurance lab (on-premise/SaaS) . Tests are executed based on predefined parameters such as browser type and version, device model, OS version, application version, network conditions, category, location and more. The Grid is able to distribute tests and schedule executions according to device availability and predefined priorities. While your automated tests are being executed you can view the tests in the Live View as they are being carried out simultaneously or click on any job to open a live session for analysis or debugging.
The SeeTest Grid Execution – Web & Mobile capability can also be integrated with any CI environment (e.g. Jenkins, HP ALM, TeamCity) for a 24/7 “hands-free” continuous testing.
Test Analytics (SeeTest Reporter)
These days analytics are used to measure everything. From the speed and distance of a home run to the performance of a stock during a company’s IPO, it is all statistics and analytics. SeeTest Test Analytics capability (SeeTestReporter) consolidates all of your digital test results for mobile and web to gain end-to-end quality insights and drive improvements. It provides developers and QA with a single snapshot containing key information on all of their web & mobile applications, including test execution status and test coverage rate.
You can monitor and analyze your entire QA program from a single place. Consolidate web and mobile application test results from any framework or any type: unit, smoke, sanity, functional, non-functional, etc.
The Test Analytics capability streamlines the fault investigation process for better decision making and faster resolution by allowing you to centrally manage fault status, including investigation results and action items.
What it adds up to is a highly effective way to view your test results and it is all contained within the SeeTest Quality Assurance Platform.
Appium Studio for Eclipse
Many Java developers would like to automate mobile applications tests on both Android and iOS platforms.
Now they can with the Eclipse Plugin for Mobile testing a tool for developing Appium/Selenium mobile tests and automation frameworks. The lightweight automation framework is easily integrated into JUnit, TestNG or any other automation framework.
With this tool, you will be able to easily develop, automate, analyze and debug your mobile tests right in Eclipse, on remote physical devices.
Performance Monitoring (CPU, Battery, Memory)
When you test a new app or update, first and foremost it has to work. Customer expectations are at an all time high when using web or mobile applications. The expectation is that customers will be able to do anything they need to online, quickly and on the move. Slow applications that often time out and consume a large amount of device resources are not tolerated.
The solutions is performance testing in addition to the ever important functional testing. The ability to test device vitals is crucial.
At Experitest, filter our apps through various testing and QA software in order to make sure that users enjoy a crystal clear experience.