Those who continuously follow my blogs and webinars, know that i constantly follow the market trends, to recommend best coverage requirements.

The mobile landscape fragmentation isn’t new, and continuously presents a challenge to mobile application developers and testers.

In this post, I’ll reflect the most up to date coverage recommendation for mobile and web.

Coverage Within the DevOps Pipeline and Continuous Testing

While in this blog, I’ll provide the top mobile devices and tablets for iOS and Android, not all of them should be tested in each stage of the DevOps pipeline. As you progress your development, and do E2E and regression testing, your coverage from both test scenarios and target devices will obviously need to scale compared to few representative devices that you’d typically use for unit testing and basic build acceptance testing.

 

iOS and Android Landscape Overview

As the market is pending the GA of Android P, and next week the announcement and perhaps 1st dev preview of iOS12, it’s important to be on top of the updated market stats. iOS market share is fully dominated by iOS11, followed by nearly 20% of devices and tablets that are running iOS10.3.3. About 5% are running mostly on iOS9.3.5.

As iOS12 starts to roll out with dev previews and beta versions, it’s highly recommended to start catching up, understand the new features and changes to the platforms, as well as try and upgrade at least one device to the new iOS12 and validate the compatibility of your test automation code within and outside of your CI.

Android OS landscape is also divided between 4-5 major OS versions, with the new Android P that is just around the corner. ~30% of the Android devices are running android 7.x, 25.5% are on Android 6.x, 21% of the devices are on Android 5.x. While Android 8.x is only ~5% of the market, it is a must to cover as the latest GA OS version. Regarding Android 4.x (KitKat) that holds a bit more than 10% of the market share, it depends on your specific app, the geography in which your end users operate in, and of course the usage and analytics that your app/web is showing regarding this OS.

As mentioned above regarding iOS12, same goes for Android P. For Android P, google is making this version available for the first time to leading device vendors other than Nexus/Pixel.

A recent article that was published, also shows the varying reasons for iOS vs. Android application crashes (there are few debates regarding the objectiveness of the data, especially around iOS performance)

Top Android and IOS Devices to Test On (Globally)

Each geography has its own mobile usage patterns, and popular devices. For that I release almost each 1-2 quarters the Factors magazine referenced above, to guide the coverage across 17 different countries.

Globally, these are the most popular smartphones and tablets to include in your test lab.

iOS Devices OS Version Android Devices OS Version
Apple iPhone 7 iOS 11.4 Samsung Galaxy S7 Android 7.0
Apple iPhone 7 Plus iOS 11.4 Samsung Galaxy S8 Android 8.0
Apple iPhone 6S iOS 11.4 Samsung Galaxy S8 Plus Android 8.0
Apple iPhone 8 iOS 11.4 Samsung Galaxy S7 Edge Android 7.0
Apple iPhone X iOS 11.4 Huawei P9 lite Android 7.0
Apple iPhone 5C iOS 10.3.3 Samsung Galaxy Note 8 Android 7.1.1
Apple iPad 4 iOS 11.4 Samsung S9 Android 8.0
Apple iPad Air 2 iOS 11.4 Google Pixel 2 Android 8.1
Apple iPad Pro 9.7 iOS 11.4 LG G6 Android 8.0
Apple iPad Mini iOS 9.3.5 Samsung Galaxy Tab S3, 9.7’’ Android 8.0
Apple iPad Pro 12.9 iOS 11.4 Xiaomi Redmi Note 4 Android 7.0
Apple iPhone SE iOS 11.4 Oppo F1S Android 6.0
Apple iPhone 5S iOS 10.3.3 Motorola Moto G5 Android 7.0
Sony Xperia XA1 Android 8.0
Huawei P10 Android 8.0
Pixel XL Android P Beta
OnePlus 6 Android 8.1
Nokia 6 (NEW!) Android 8.1

Summary

As the market evolves, it is very important for dev and test teams to follow the above trends, and validate that their lab is fully aligned with the market from both devices and OS versions.

Get ready for Android P and iOS 12 today.