During my three years at Socialtext, I helped maintain a test tooling system through a user interface that was advanced for its time. O'Reilly took it as a case study in the book Beautiful Testing. The team at Socialtext uses the same framework today, although it now has several tests running at one time on Amazon's Electric Compute Cloud. Although we had a great deal of GUI-driving tests, we also had developer-facing (unit) and web services (integration) tests, a visual slideshow that testers could watch for every browser, and a strategy to explore by hand for each release. This combination of methods to reduce risk meant we found problems early.
In our automated testing starter kit, we provide a variety of resources and tools for you to use to get the ball rolling. You will learn how to efficiently roadmap your efforts, build scalable and easily-maintainable automation frameworks, and how to compare and choose the right tool based on your needs. Don’t worry, we’ve also included tips regarding what testing types should remain manual. Not all tests can or should be automated, and to reiterate our previous statement, it’s essential for your success that some testing types, like exploratory testing, are performed manually.
Automated testing is, well, automated. This differs from manual testing where a human being is responsible for single-handedly testing the functionality of the software in the way a user would. Because automated testing is done through an automation tool, less time is needed in exploratory tests and more time is needed in maintaining test scripts while increasing overall test coverage.
Angie Jones is a Consulting Automation Engineer who advises several Scrum teams on automation strategies and has developed automation frameworks for many software products. Angie speaks and teaches internationally at software conferences, serving as an Adjunct College Professor of Computer Programming, and also teaches tech workshops to young girls through TechGirlz and Black Girls Code. Find out more on LinkedIn and at angiejones.tech
Robotium android automated testing can be performed on several different devices simultaneously, and the tests can run on either an emulator or the real thing. They are also renowned for being extremely robust, because Robotium recognises UI elements by their internal code reference; if you’ve built your product using Java, you can combine Robotium with the JUnit test framework for even stronger results. Yet perhaps the coolest thing of all is Robotium can simulate ordinary user behaviour, like touching, clicking and typing text.
The software automatically syncs business profiles to a single dashboards, where multiple users can view reports and corporate accounts. It is capable of generating profit and loss and trade sheets, invoices and billing, all which are accessible via mobile devices. Custom reports and feeds can likewise be created from the dashboard. Popular integrations include Quickbooks Online Payroll and Intuit GoPayment.
No one has jumped into the desktop accounting software arena for over two decades. The survivors of what was once a crowded field have been around since the early 90s. They are QuickBooks (the desktop version), Sage 50c (which started its life as Peachtree Accounting), and AccountEdge Pro (formerly MYOB), the latter two of which are included in the table above.
The takeaway is that testing is a process requiring human intervention. Bas Dijkstra, an experienced test automation consultant, describes how even the term “test automation” is flawed unless you understand what is and isn’t automated. The actual “learning, exploring, and experimenting” involved in manual, human-performed testing cannot be automated, according to Dijkstra. He writes:
A subscription to Xero runs varies depending on the plan you choose. Xero will handle five invoices for you, pay five bills and reconcile up to 20 transactions a month with the starter version. You get unlimited reconciliations, invoices and bills with the Standard or Premium plans, and the Premium plan will also handle payroll for you. You’re not locked into the plan you choose — you can change at any time.
A variation on this type of tool is for testing of web sites. Here, the "interface" is the web page. However, such a framework utilizes entirely different techniques because it is rendering HTML and listening to DOM Events instead of operating system events. Headless browsers or solutions based on Selenium Web Driver are normally used for this purpose.
You can buy the QuickBooks disc for a “one-time” cost or download the super-duper version for some more dough, but you’ll probably end up footing the bill for upgrades in future years (and the upgrades cost almost as much as the original software). And some of the software’s features and reports just aren’t necessary for small businesses, so you might end up with a lot you can’t use. QuickBooks Pro accommodates up to three users, but the second two will cost you extra, too. It’s only compatible with Windows.
With so many options, it can be challenging for enterprise mobility teams to choose the right solution. Whether open-source or commercial, the top mobile testing tools each have their own strengths and overall benefits. But, depending on the size of the enterprise mobility team, overall skill set and available resources, some solutions may not be the right fit for all mobile developers, testers and quality assurance professionals.