There are several services available for testing mobile apps in the cloud on real devices:
Sauce Labs is the veteran and was co-founded by Jason Huggins, the original creator of Selenium. Sauce Labs also works on development of Appium.
BrowserStack is an economical choice for testing in the cloud, but while the offer “Live” mobile devices (manual testing only), it does not appear that they offer devices for test automation.
Xamarin is a pretty good contender, but focuses their tooling around Microsoft .NET / Visual Studio developers. It does not appear that Appium is supported (directly) Still, they have a big selection of devices for those willing to stick to Microsoft tooling. It is also nice that their metering is a soft limit.
Perfecto Mobile has been around for a while as a service for Enterprises. It is proprietary, but also supports Appium. It comes with an Enterprise level price though. You have to call and talk to a salesperson for any plan beyond proof of concept.
Keynote Mobile Testing used to be called Device Anywhere and their experience dates back to the days before smart phones. I don’t have recent experience with them, but they used to offer only pixel based automation. It appears they support Appium now. But automation is not supported outside their enterprise sales channel.
Amazon Device Farm is the most recent entry in the field. But it is not only quite expensive, but requires a lot of do-it-yourself. Perhaps it will be more practical once tooling for recipes becomes available.
Price Comparision of Sauce Labs, Xamarin Test Cloud, Perfecto Mobile, & Amazon Device Cloud
|Service||Price||Device time||Concurrent Devices|
|Sauce Labs||$129/month*||1000 minutes||4|
|Xamarin Test Cloud||$99/month**||1 hour/day||1|
|Perfecto Mobile||$399/month*||20 hours||1|
|Amazon Device Farm||$0.17/minute||1|
|Amazon Device Farm||$250/month||unlimited||1|
* 25% annual discount available
** 15% annual discount available