All posts by farahabbasi

Testing Android with Computer Vision

This week lab members Farah and Gina will be talking about how to setup and tweek Sikuli tests for Android at GDG Android Montreal. In this talk they show how you can test image heavy, and/or legacy/hybrid android apps using OpenCV (computer vision) and Sikuli.

Sikuli is a framework which automates anything you see on the screen. It uses image recognition to identify and control GUI components. It is useful when there is no easy access to a GUI’s internal or source code, or writing tests crosses layers of technologies ie in a Cordova/HTML5 app running in a webview.

Sikuli is an open source project started at MIT which has grown to be used by developers for diverse types of clicker testing.


Here is a video showing how Farah used Sikuli to test a Cordova/HTML5 app running in an Android webview.




Curious about the code? You can take a look at Farah’s Sikuli tests on GitHub.