See how leaders and teams like yours are capturing up to 300% ROI. Explore the data now!

Login Enterprise 5.11: Compare 5 Load Test Results

July 11, 2024

With the release of Login Enterprise 5.11, we’re excited to introduce a powerful new feature that significantly enhances your ability to compare load tests. You can now compare up to five load tests simultaneously within our web interface, offering more flexibility and detailed analysis than ever before. Whether you’re making incremental changes, conducting periodic tests, or optimizing configurations for cost and performance, this new feature is designed to provide you with deeper insights and more efficient testing workflows. 

Business Benefits, Value, and Use Cases

  • Track Incremental Changes: The ability to track incremental changes, such as OS updates, security updates, and software installations and updates. By using detailed titles and comments in load test runs, you can easily document specific changes and test bed specifications. This enables accurate side-by-side comparisons, allowing for objective and faster decision-making and validation. Now you can quickly assess the impact of each change, streamlining the process and improving efficiency. 
  • Perform Long-Term Comparisons: Perform objective long-term comparisons. If updates occur quarterly, it can be easy to forget previous test outcomes. By comparing these results, you can identify performance trends over time, helping plan future updates more effectively. This ensures consistent performance evaluations and facilitates better long-term planning, maintaining a high standard of system performance year after year. 
  • Identify Cost-Effective Configurations: Identify the most cost-effective configurations by comparing different SKUs, hardware configurations, or software versions. By evaluating performance metrics like EUX score and VSImax, you can determine which configurations offer the best performance for the cost. Examples include comparing various versions of Microsoft Office or security software configurations to find the optimal setup. This approach ensures that your production environment remains efficient and compliant with security policies, delivering the best value for your investment. 

Setting up: 

Configuring Load Test Settings 

Setting up a load test begins with configuring the essential settings. Specify parameters such as the number of virtual users, test duration, and performance metrics. These configurations ensure that the test environment accurately simulates real-world conditions. 

Adding Applications to a Load Test 

Next, add the applications you need to test. This could include productivity suites like Microsoft Office, custom enterprise applications, or any other software critical to your business operations. Ensure all necessary applications are included to obtain comprehensive test results. 

Starting a Load Test 

Once everything is configured, initiate the load test. Our platform will simulate user interactions and system load, providing valuable data on performance, stability, and user experience under different conditions. 

Load Test Comparison and Results 

As of version 5.11, you can now select up to five load tests for comparison. This is a significant upgrade from the previous limit of two. Simply select the tests you want to compare and click the “Compare” button. 

In this example, I’ve chosen 5 load tests that are interesting and relevant to compare via the checkbox column. 

Click to View Details


Overview Page

The overview page displays all selected tests with options to designate a baseline test. By default, the oldest test is the baseline, but you can change this to any of the selected tests. The green header denotes the selected baseline test. Parenthetical percentage deviations indicate performance deviations for better or worse. The baseline test serves as the reference point, and the other tests are compared against it. 

Click to View Details

You can toggle the baseline test via the “Set as baseline” column by clicking the slider corresponding to the test you want to set as the baseline. Once toggled, the corresponding column headers in the tables for the new baseline test will be green. 

Click to View Details

Here’s a GIF showing an example 

Click to View Details

Results Page

The results page is divided into several sections: 

  • Top Table: Displays all selected tests, highlighting the baseline test and showing percentage differences. 
  • EUX Score/VSImax Table: Shows results for end-user experience and maximum virtual session index. 
  • Logon Times Table: Breaks down the login process into measurable stages, providing detailed metrics. 
  • Application Response Time Table: Displays application performance metrics, focusing on those present in the baseline test. 

Charts and Graphs

A dedicated charts tab allows you to visualize data across four expandable sections: End User Experience/VSImax metrics, Logins, Applications, and Session Metrics. You can customize the display to show one chart per row or two side-by-side, with interactive elements to highlight specific data points. 

Click on the Charts tab to show the graphs for that category: EUX Score/VSI Max metrics, Logins, Applications, and Session metrics. These can be collapsed and expanded on demand. 

Click to View Details

By default, the view in Charts will show a window-wide view of the graphs (note the “-“ icon that’s selected by default) 

Click to View Details

However, if the “=” icon is clicked, this will display the charts side-by-side. Data points are hoverable in either view and will show tooltips in real time on each graph while being hovered over. 

Click to View Details

Here’s a GIF showing an example 

Click to View Details

PDF Report

If the “Generate PDF Report” button is clicked, a popup will allow you to select the data you want in the PDF. Once selected, a PDF will be generated that can be saved, stored, reviewed, and archived for later review. This PDF can be distributed to stakeholders of the results and comparison. It is helpful to have a repository of Login Enterprise PDF load test comparison reports with filenames indicating what’s being compared.

Click to View Details

Review this GIF to see an example of the layout and format of the up-to-5 load test comparison generated PDF

Click to View Details

Additional Resources

For more information on how to effectively use these new features, check out our additional resources document to help you get the most out of your load testing and comparison capabilities.

Conclusion

By allowing the comparison of up to five load tests, this new feature in Login Enterprise 5.11 enhances your ability to analyze performance, make informed decisions, and optimize your IT infrastructure. Whether you’re testing for security updates, system configurations, or application performance, this tool will help you achieve more precise and actionable insights.

BenchmarksLogin Enterprise ReleaseProduct Release

Try Login Enterprise
for free

Related Resources

Epic Hyperspace vs. Hyperdrive: Performance Testing and Key Considerations from Login Enterprise 
BlogNovember 6, 2024

Epic Hyperspace vs. Hyperdrive: Performance Testing and Key Considerations from Login Enterprise 

Assess Your Current Endpoints Performance Testing Solution
BlogNovember 1, 2024

Assess Your Current Endpoints Performance Testing Solution

GPU Benchmarking with Login Enterprise: A Comprehensive Guide
BlogOctober 24, 2024

GPU Benchmarking with Login Enterprise: A Comprehensive Guide

Ready to see how you can transform with Login VSI?