Featured customer story:

MaestroQA Raises the Bar for Delivering Exceptional
Customer Experience with the Help of mabl
Challenges•

RainforestQA’s test writing
would take days to get back toMaestroQA’s team•RainforestQA tests required
extra work because of theirlack of understanding ofMaestroQA’s app•

Unable to scale testing in rapid
release cycle

Benefits
Test runs are
6X faster

70% cost savings

Increased average
number of functional
test runs by 150%

Safer and faster
deployments
to production

Reduced the time ittakes to deploy byover 50%

Catch more bugsin dev

over Rainforest QA

MaestroQA is a technology company based in New York City that is focused on helping a wide
variety of notable brands – like SeatGeek, Harry’s, and Spot Hero - deliver exceptional support andservice experiences to their customers. Part of being a fast-growing company and working with abroad range of customers, the MaestroQA team frequently uncovers new challenges to solve with
their quality assurance software, so being able to rapidly adapt to the market is essential for theiroverall business and team success.
Harrison Hunter, the company’s CTO and co-founder, knew that being able to adapt quickly to a
constantly evolving market meant that they would need to swiftly deploy new software releases.
His product team is made up of full-stack developers combined with others that heavily focus
on QA. Up until recently, they were using a combination of both manual in-house testing andRainforest QA. As the speed of development accelerated, Harrison and his team realized their
testing approach would not keep up with the demands of their customers.

mabl is a test automation solution that uses AI and SaaS technologies to helpsoftware teams test at the pace of rapid Agile and DevOps delivery practices.

Get Started Free

Manual Testing Was Too Slow and Unreliable
Testing in a continuous delivery environment is a growing challenge formany software teams. For MaestroQA, when using Rainforest QA it would
take days to write tests and, oftentimes, those tests were unreliablebecause the Rainforest QA test writers didn’t fully understand MaestroQA’sproduct. The time and money it took to create a usable test createda significant bottleneck for Hunter and his team. They were forced tosacrifice quality assurance tasks before every deployment at the risk ofreleasing more bugs into production.
Harrison and his team found themselves with a growing problem - theyneeded a new solution that would scale with them and allow innovation
while testing effectively. That’s when they decided to adopt mabl as thesolution to their testing woes. Since its implementation, mabl’s intuitive test
trainer has enabled the MaestroQA team to build tests in minutes insteadof days. Not only has this increased the team’s efficiency in test writing,
now they run tests before every deployment and easily maintain tests asthings change in the application - regardless of level of expertise. And to
top it all off, migrating away from RainforestQA and moving to mabl allowed
the MaestroQA team to cut direct costs and scale up significantly, resulting
in about 70% cost savings.

“Catching a bug once it’s in production is very expensive. Catchingthem before deployment allows you to have more control over yourown time, making it a lot cheaper and easier and without negatively
impacting customers. Testing with mabl has helped catch problems
Harrison Hunterco–founder, Maestro QA

earlier in our development process, which helps us deliver a betteroverall experience to our customers.”

Delivering a Better Customer Experience with theHelp of Automation
With the help of mabl, MaestroQA can now catch issues earlier and prevent
bugs from being released. To make the process seamless across the entire
workflow, they integrated mabl directly with CircleCI. Now they run mabl
QA tests both before merging a pull request into their master branch aswell as before deploying that master branch to their customers
mabl.com2

With the help of mabl, MaestroQA can now catch issues earlier
and prevent bugs from being released. To make the processseamless across the entire workflow, they integrated mabl
directly with CircleCI. Now they run mabl QA tests both before
merging a pull request into their master branch as well as
before deploying that master branch to their customers inproduction. By testing more frequently and faster with mabl, theteam merges large branches quickly and pushes updates into
production faster. As an added benefit, it also allows them tokeep a lean team without the need to hire extra QA talent.
Now, with mabl fully integrated into MaestroQA’s development
pipeline, test runs are six times faster and the average numberof functional test runs has increased by 150%. mabl has helped
them reduce the number of bugs being deployed into production,
resulting in fewer complaints about unreliability of the software
software unreliability and allowing them to rapidly grow theircustomer base while keeping support requests flat. mabl has
vastly improved MaestroQA’s testing strategy, improved businessefficiency, and scale, - all while reducing cost.

Expanding with an Evolving Development Team
Looking forward to the future, Harrison and his team are excited
to shift further left and testing earlier in development stages ofthe delivery pipeline. The team anticipates taking advantage offeatures in mabl like CLI and branching to extend their testing
coverage. They believe the mabl CLI will allow the team tointroduce QA testing earlier in the build process by running it on
a local branch before they even create a pull request - allowing
them to review already well-tested code right before delivery
to production.
mabl’s branching and versioning features will also allow theMaestroQA team to create tests for new features withoutchanging the original branch of that test. And it will also allow
them to go back and forth between versions of a test, so they
don’t need to commit to a change when testing, allowing them tomore easily maintain their mabl tests.
mabl.com3

mabl enables teams to shift quality to the left

Before:LOW COVERAGE

PROMOTEPROMOTE

Dev

Local

PROMOTEQAProdWith Rainforest QA,
test coverage was
low because tests
were slow to create.

After:HIGH COVERAGE

BRANCHTESTS

Run tests on a branch(Local & Preview)

MERGE
PROMOTE

Local

BRANCH
CODEDev

Open Pull Request

PROMOTEQA

CLOSE PR& MERGE

Prod

With mabl, theycan expand
test coveragethroughout theentire pipeline andCircleCI integration
and branchingcapabilities.

Companies like MaestroQA know that topnotch software quality is critical to delivering
the exceptional experience their customers
demand. Watch the full video here:

mablmabl.com

Get Started Free

4