APPLICATION DELIVERY MANAGEMENT

PerformanceEngineering
The LoadRunner FamilyImplement a proactive, continuous
performance engineering disciplinethat expands performance testing
to new roles, tightly integrates
into the CI/CD process, monitors
performance end-to-end, andfacilitates continuous improvement.
Combined, these elements
ensure that teams can engineer
performance early in the lifecycle
through the end-user experience.
Discover an approach that
goes beyond traditional
performance testing andextends into the end-userexperience. This approachengineers performance2

throughout the lifecyclewith extensive technology
coverage, seamless integration
with common tools for scripting,CI/CD, open source, and more.

3

Why Just Test Performance?
Engineer Software Quality
Meeting customer expectations is becoming harder, but these days it’s anecessity—especially now that customers can share their opinions on aproduct or service publicly. In fact, there is a direct correlation between
customer engagement and revenue. Technologies continue to evolve,
and an app cannot just work. It must consistently perform as expected on
every platform, device, and network. Performance engineering teams
must harness the speed of change and release software faster while
delivering a superior end-user experience. Performance testing can nolonger be an afterthought for your organization.
Now more than ever, it’s crucial to engineer quality testing earlier in theSDLC by building more realistic tests and enabling increased collaboration
across performance teams. The ultimate goal is to deliver high-performance
applications that delight and engage your customers.
Traditional Performance Testing Isn’t Enough
Performance testing is a non-functional software testingIn addition, finding a fundamental performance issue at thetechnique that determines the stability, speed, scalability,

last minute creates unacceptable delays in time-to-market.

and responsiveness of an application under a given

This wastes time, money, and resources and, worse,

workload. Performance testing is often a late addition, usedcreates pressure to fix the defect while simultaneously

in isolation, only deployed once functional testing is overstaying on schedule for the next release

and, in most cases, when the code is ready to release. Fromdeveloper to performance engineer and business analyst,
everyone must work in harmony to deliver a quality appthat meets customer expectations. Working in silos causes
communication gaps between specialist areas.

4

5

The Evolved Approach:
Performance Engineering
Performance engineering is aproactive, end-to-end performance
testing and monitoring disciplinethat works continuously throughout
the software development lifecycle(SDLC). It outperforms traditional
performance testing, whichmost regard as an addendum to
the QA process. Implementing aperformance engineering program
enables unprecedented, seamlesscollaboration among your teams
and enhances tools and processes.

Performance engineering has four key attributes:

Accurately test any application
Performance engineering demands an end-to-end, open

are dynamic and vary by provider, location, and time of day.

architecture solution that supports performance testing

So your test environment must accurately recreate multiple

across any application type and protocol and in any software

network scenarios to analyze application performance and thedevelopment environment and integrated development

effect of network conditions on different user populations.

environment (IDE). Web, mobile, and cloud network conditions

Accelerate development with virtualization
Composite app initiatives often create a “quality versus

Application teams create virtual services that replace targetedspeed” dilemma for development and testing teams.

services in a composite application or multi-step business

They can either meet the project deadline or deliverprocess. These services accurately simulate the behavior ofa high-quality product. The core issue is the growing

the actual component. Developers and testers can then startinterdependency among application components. More andparallel performance testing immediately. They can also test

more, your organization probably relies on resources fromwhen data access is restricted, when data is difficult to attain,

third-party vendors, requiring extra cycles and wait times.

or when the services are not suitable for the particular test.

You can resolve this dilemma with Service Virtualization.

The net result is the ability to ”shift left” and execute tests

It accelerates development by removing dependencies on

earlier in the delivery cycle. Testing earlier draws focus onservices or components that might not be ready when testing.

service quality attributes, such as performance, reliability,and scalability. In short, Service Virtualization delivers

Expands performance testing
responsibilities to new roles while
supporting the performance centerof excellence (PCoE).

Encapsulates shift-left and shift-rightpractices for end-to-end performance
testing and monitoring.

both faster delivery times and higher quality services.

Don’t standardize, harmonize
As the software development industry changes, so doprovides every application tester and optimizer withthe job descriptions. Designers, developers, coders,everything they need.

and QA testers are now all responsible for system andFacilitates continuous improvement via
constant feedback loops and real-time
analytics and insights.

Integrates into the CI/CD pipeline todeliver code changes more frequently
and reliably to promote collaboration andscale Enterprise DevOps.

application performance. With more people involved, more

To overcome these challenges, you need end-to-end

tools and technology are necessary. Why? It is difficult

collaboration and integration from left-to-right andto require teams to learn new tools, so allowing them toright-to-left, along with real-time analytics and insights.

optimize independently is necessary. Using their own

The ability to leverage the same sources of information,

tools and methodologies, these empowered teams canwith end-to-end visibility from test runs to analytics, helps

meet immediate needs and demands.

your teams make better business decisions. Traditional
performance testing vendors aren’t equipped to address

Harmonizing instead of standardizing sounds like it

all this potential chaos. However, companies that provide

could lead to complexity and an explosion of disparate

true performance engineering solutions are ready to turnenvironments. Nevertheless, permitting your teams totesting chaos into engineered order. That’s OpenText.

leverage their current environment and infrastructure

67The LoadRunner Familyof Performance
Engineering Solutions
You can start performance testing
earlier and with more accuracy withthe LoadRunner family. Our portfolioof performance engineering solutions
offers not only enterprise-grade
capabilities but also features
for any scale or set of demands.

The family leverages rich integrations,comprehensive analytics, real-world
simulations, and continuous feedback
loops. Using these capabilities,
your team can consistently deliver
high-quality applications thatmeet your users’ expectations.

Key Benefits:
Every member of the LoadRunner family shares the followingcapabilities and benefits, whether on-premises or in the cloud:

1

2

3

4

Delivers the industry’s
broadest technology
and protocol support.

Integrates with mostscripting, CI/CD,infrastructure, visualization,and monitoring tools.

Meets your demands without
increasing asset, license, orinfrastructure costs.

Helps you rapidly pinpoint
the root cause and quickly
identify bottlenecks,
using smart analytics andreal-time anomalies.

You won’t be held back by limited application support, poor

practice. The OpenText performance engineering approachreporting, or lack of scale. Tackle any project with broad

allows you to choose the right tool for the job while

coverage, innovative technologies, extensive integrations,leveraging a connected ecosystem that delivers smarterand powerful analytics. With the LoadRunner family, yourinsights, tighter collaboration, and reduced costs.

organization can build an effective performance engineering



8



9

1 Broad Technology and Protocol Support

2 Extensive Integrations Enable Continuous Testing

It doesn’t matter if you are testing the latest web and mobile technologies,
legacy applications, or off-the-shelf applications. LoadRunner solutions
support the widest range of technologies and protocols in the industry.
They also share innovative technologies that can reduce scripting time.

Your operations teams already rely on a wide variety of tools.
Therefore, incorporating performance testing in the CI/CD process
helps you balance and prioritize responsibilities across developers,
testers, and performance engineers.

Measuring performance on the server side is not enough.

and share them with performance engineers. These tests

The LoadRunner family enhances and unifies the solutions

Using data visualization and storage tools, your teams canTruClient is a browser-based tool your teams can use tofoster collaboration by using a language both developers andDevOps and Agile teams already use:leverage top-notch open source software to view real-timecreate scripts in real time for load testing or monitoring web

engineers can understand.

• IDE integrations accelerate shift-left testing.

results, manipulate data, and make smarter decisions.

and mobile applications. The tool records your actions as
you navigate through business processes.

Bringing all scripting capabilities together is Virtual User

• Source code management integrations and support forcommon open source tools improve coverage and help

Generator (VuGen). Emulate the behavior of real users
To help evaluate your web applications’ performance,accessing applications on your system by creating and testing

DevWeb focuses on communication at the HTTP transport

scripts with VuGen. Whether you are using VuGen scripts orlevel and over WebSockets, enabling testing against all web

open source scripts such as JMeter, Gatling, or Selenium, youtechnologies. LoadRunner Developer, powered by DevWeb,

can easily record, replay, and enhance the scripts for more

gives developers the power to create performance tests

effective load testing.

Figure 1 - Broad technology andprotocol support*Not all protocols are supported across all products.

10

overcome the tools’ limitations.
• Integration with the most common CI/CD tools to increaseautomation throughout the development lifecycle.
• Extensive application performance management (APM) andmonitoring integrations tie in server-side timing and provide
additional monitoring for richer analytics.

Figure 2 - Extensive integrations enable
continuous testing*Marks are proprietary of their respective owners.
Not all integrations are supported across all products.

113 Flexible and Scalable

4 Smart Analytics and Insights

A common concern for performance testing is the overall infrastructure,licensing, and maintenance cost. Fortunately, the LoadRunner family’s
flexible approach helps you minimize these expenses:

Given the explosion of different tools and personas participating in theperformance process, it is crucial to ensure alignment across your business.
Anyone involved in performance engineering must rely on the same
information sources to make better business decisions. This best practicerequires your teams to agree on the best set of metrics and collectively decide
how to use those results.

• Minimize the duplication of scripts and scenarios byreusing test assets.
• Gain flexibility with the OneLG installer package, andleverage it with any LoadRunner solution.
• Balance short- and long-term projects with multiple
license options.
• Minimize infrastructure needs with on-premises, virtual,

Along with being flexible, the portfolio easily scales. If you
need to scale quickly without adding infrastructure, you
can increase cloud capacity using your provider account.
You can easily distribute virtual users to multiple cloud
locations using Amazon Web Services (AWS), MicrosoftAzure, or Google Cloud Platform, as well as on-premisesload generators.

container, SaaS, and public cloud deployment options.

Understanding your test results can be challenging as

results and centrally archives historical data for trending

you examine data and try to decipher the outcome.

and automated comparisons. You can define a baseline andA centralized data-collection approach allows your testing

set up reports that show how the application performanceteams to connect the dots between the developer, CI, andtrends over subsequent iterations and performs against

end-to-end performance tests. For example, automateddefined SLAs. Leveraging data visualization, your team canfeedback mechanisms and real-time monitoring empower

then view and manipulate data to make smarter decisions.

teams to see and solve problems as they occur.

Graphical analysis can significantly reduce the time you
spend evaluating data. With detailed root cause analysis,

The correlation of data from telemetry, APM, LoadRunnerusers can display data in real time and offline, which aids

solutions, and third-party testing tools generates granulartrending and anomaly detection.

Figure 4 - Graphicalanalysis capabilities toeasily pinpoint root cause
and compare test results

12



13

Performance Engineeringwith the LoadRunner Family
This integrated set of enterprise-grade
performance engineering solutions
can work together or independently.
With any LoadRunner solution, you
can confidently test complex load,stress, and performance scenarios
across legacy, website, and mobile
applications—while benefitting fromshared capabilities and commontechnology. Ensuring that tools
are right-sized for different users,exploiting test reuse, and managing
or delivering shared infrastructure
helps you develop a performanceengineering ecosystem for success.

The LoadRunner family includes:

14

LoadRunner Professional ›LoadRunner Enterprise ›Versatile and comprehensive performance
testing for co-located teams.

Collaborative performance testing platform
for globally distributed teams.

LoadRunner Cloud ›LoadRunner Developer ›Cloud-based performance testing for 
extreme scale and flexibility.

Shift-left performance testing embedded
throughout the SDLC.

15

LoadRunner Professional

LoadRunner Enterprise

Co-located teams need to test performanceacross a wide range of application types,
different network conditions, and varying
service levels.

Key benefits:

LoadRunner Professional delivers an intuitive, versatile• Implement extensive and flexible test scenarios tosolution that saves you time, improves code coverage,• Gain an easy-to-use interface for performance testersof all levels.
• Test all types of web, mobile, and packaged
applications without heavy customization.
assess the impact on every application component.

and provides accurate results.

• Apply real-world workloads to any application with

LoadRunner Professional works for all types of enterprise• Obtain a single view of end-user response time,applications. Create scripts directly with the IDE, enabling
performance testing earlier in the application lifecycle. You’llalso save time and increase efficiency using automated andHandling transactions and serving yourcustomers are more complex, so yourapplications must support any scenario.

flexible hardware usage.

Globally distributed performance testing teams are responsiblefor driving quality across the enterprise while testing a broad
range of application types, managing costs, and deploying
applications that meet your business’s performance
testing platform that reduces complexity, centralizes resources,and leverages shared assets and licenses.

• Easily integrate continuous performance testing in theCI/CD process.

• Quickly deliver enterprise engineering capabilities andfacilitate asset sharing and collaboration.
• Reduce complexity and increase the use ofrequirements. LoadRunner Enterprise delivers a collaborative

infrastructure-level, and network breakdown.

Key benefits:

infrastructure and human resources.
• Get the big picture with cross-project reporting andindividual project drill-downs.
• Increase collaboration and consistency with unified
storage and access to all relevant assets.
• Reduce costs with centralized management and built-in
support of cloud-based load generation.
• Analyze end-to-end performance, including topology,

Designed as a collaborative performance testing platform,

infrastructure level, and advanced insights.

a performance center of excellence (PCoE), LoadRunnergraphical analysis tools. Easily manipulate data illustrated inEnterprise helps your team consistently deliver quality

these tools to solve performance issues.

applications across your enterprise. Your global teams share acommon infrastructure and can execute multiple performance
tests concurrently and continuously. Relevant test assets arealso shareable among teams, which increases collaboration.
Advantages abound: License management is easier, redundancyof hardware and software is eliminated, and resources are
more accessible to various teams with LoadRunner Enterprise.

Figure 5 - LoadRunner Professional

16

Figure 6 - LoadRunner Enterprise

17

LoadRunner Cloud
Whether you need to test performance ata massive scale or require a collaborative,
cloud-based solution for fast-moving Agile andDevOps teams, LoadRunner Cloud can help.

Key benefits:It gives you the simplicity and scale you need to test fast, rapidly

load generators.

• Scale to over five million virtual users for ultimate
test coverage.
• Reduce hardware maintenance with a flexible testing model.
• Run tests in multiple locations using public or on-premises

pinpoint issues, and deliver high-performing applications.

• Leverage any LoadRunner script and open source tool, orYour software delivery team has easy access to cloud-based• Help Agile and DevOps teams quickly understandperformance testing resources that are just a click away.
LoadRunner Cloud offers all the infrastructure, scale, andreporting you want, with no need to install updates forcreate a test using a REST API, CSV file, or HAR file.
performance issues with smart reports and dashboards.
• Foster collaboration with multi-user, multi-test execution,asset sharing, and project management.

on-premises components.

Figure 7 - LoadRunner Cloud

18

19

LoadRunner Developer
In the age of CI/CD pipelines, everyone
is responsible for quality. In other words,
anyone who can test should test.

Key benefits:• Leverage developer-friendly capabilities.
• Seamlessly integrate with any IDE and CI tools.
• Get free local execution with up to 50 virtual users.

Shift-left performance testing gets the developers anddevtesters invested in performance engineering earlier.
But your developers need the right testing tools, as wellas the ability to work in their IDEs.

• Foster collaboration between the PCoE,developers, and devtesters.
• Natively run scripts and reuse assets in all
LoadRunner family solutions.
• Scale directly from any IDE using LoadRunner

LoadRunner Developer delivers shift-left testing embedded

Cloud and LoadRunner Enterprise.

throughout the SDLC. Developers can quickly execute
performance tests, gain initial feedback, and add theseassets to the CI pipeline—all within their preferred tool.

Figure 8 - LoadRunner Developer20

21

By utilizing any of the LoadRunnerfamily solutions, your organization candevelop a performance engineering
methodology that scales. Simply
choose the right tool for the right job
and leverage a connected ecosystem
to gain smarter insights, tighter
collaboration, and better cost savings.
Learn more about the LoadRunnerfamily of Performance Engineeringsolutions.

LoadRunner Professional ›LoadRunner Enterprise ›LoadRunner Cloud ›LoadRunner Developer ›Service Virtualization ›

22



23

opentext.com
microfocus.com

263-000043-001  |  05.24

24