login vsi company logo login vsi company logo 250x40

Best Practices in Virtualization Testing: Small-scale vs. full-scale testing

Best Practices in Virtualization Testing: Small-scale vs. full-scale testing

Deploying and maintaining VDI is a challenge for every company. There are so many decisions to make and the speed of change seems to be accelerating. Because we are all constantly trying to make the best use of constrained resources, a question we get regularly here at Login VSI has to do with scaling tests. It goes something like: "If I want to find out the number of servers I need, I simply test how many users I can put on one server then multiply by the number of users I need to support. Right?"

My answer to this is a definite "Njet, no way, negative." Your complete environment responds fundamentally differently than when you test on just one or two machines. The most obvious reason for this is your storage system. It’s very likely that you are using shared storage. Meaning, at some point you will be out of storage resources. And without storage optimization solutions, this might be sooner than you like.

People new to VDI might think that performance scales linearly with the number of servers. While this is typically true for the first 2 or 3 servers, after that scaling quickly becomes non-linear. The graph below illustrates this point. The blue line shows the expected number of desktops on the total number of servers. While performance of the desktops is fine at 400 users, we can clearly see that at 500 users simply adding an extra server won't satisfy our needs.

virtual desktop performance - vdi does not scale linearly

Beyond the question of storage, in complex environments there are more commonly shared components. Examples are:

  • Broker / Load balancers
  • Monitoring
  • Storage
  • Power
  • Networking
  • Cooling
  • Antivirus
  • Backend databases
  • Fileservers
  • Application servers or application virtualization techniques
  • Etc..

The only way you can truly validate that all of the above are working correctly together is by testing at full scale. These are some of the questions you might have that testing at capacity can help answer:

  • Is my environment stable and performing at the desired capacity
  • Are the backend systems handing the load?
  • Can my environment handle logon-storms?
  • What happens if one of my datacenters fails?
  • What happens if one of my servers (or racks) fails?

Through the years, we have seen plenty of examples where the environments that our customers designed looked great, but in practice and when testing at full scale they just didn’t work. For example, I witnessed an environment where too much power was being pulled from the grid during a Login VSI test. This caused the VDI Proof of Concept rack to be disconnected from power. While this was not a problem because it happened in a test environment, imagine the panic if this were to be discovered in production with thousands of real users.

A separate example was at another company where the storage device was misconfigured to only use a limited amount of CPU. Initial tests with few users indicated that there wasn't a problem. But as soon as we started to ramp up the tests to about 400 or 500 users, the environment came to a complete halt. After identifying and resolving the issue, we were able to host the desired number of users on the environment and move to the pilot phase.

My advice: When you start to do performance tests, of course it’s a good idea to start with just one machine. Make sure this works and you get the best performance out of it. Right after this initial test, start increasing the test size to full-scale. The same goes for environments that are already in production. At some point you are likely to make a change. When it comes to any of the components mentioned above, I highly recommended to test at scale so you know exactly what level of performance to expect.

About the author

Mark Plettenberg (@markplettenberg) is a product manager of Login VSI and has played a critical role in the development and growth of Login VSI. Ask Mark about motorcycle mechanics and breaking/repairing anything and everything that has a power plug.


Tags: How-to, Login VSI, Videos, Load Testing, Best Practices

Popular Blogs

Login VSI - Press Release - Login VSI Releases Login Enterprise 4.0

[Press Release] Login VSI Releases Login Enterprise 4.0

Login VSI Releases Login Enterprise 4.0 New Application Load Testing Functionality Maximizes End-User Experience Continue Reading
Login VSI and Ymor Form Partnership to Deliver Performance Improvement to Business-Critical Applications

[Press Release] Login VSI and Ymor Form Partnership to Deliver Performance Improvement to Business-Critical Applications

The partnership offers a total solution for enterprise organizations to monitor and test business-critical applications from end-to-end via VDI or in the Cloud. Ymor offers various monitoring solutions, used to test and monitor the performance of critical business chains from end-to-end. In VDI environments, Ymor can now offer the monitoring solutions of Login VSI. Continue Reading
Login VSI - Blog - Windows 10 1909 - Performance Results Windows 10 - 1909

Windows 10 – 1909 performance results and a look ahead at 2004

Is it just me or does Windows 10 2004 just not feel right as a name? Regardless of my opinion on that, Microsoft will release this 20H1 build in April of this year. But most organizations today are not going to implement this new version right away. Market research by VDI Like a Pro shows that most enterprises today are running Windows 10 1803, or 1809. Continue Reading
Login VSI Blog - Login VSI Results for HPE SimpliVity 325

Login VSI results for HPE SimpliVity 325

Congratulations to HPE SimpliVity for another successful validated by Login VSI achievement! This latest hyperconverged (HCI) result is based on the HPE SimpliVity 325 platform leveraging 2nd Gen AMD EPYC processors. Continue Reading
Login VSI - Validating Your Remote Infrastructure at Scale - Man at Desk

Enabling Your Remote Workforce

Given recent global events, a majority of my users may need to work remotely. Many of our customers have been asking us if we can help them test the user-experience for their remote workforce, as well as the infrastructure that delivers it. We have seen requests range from the quality of the remote user-experience to the ability of their VPN to handle the throughput of a large volume of concurrent connections. Continue Reading
Login VSI Releases Login Enterprise 4.1

[Press Release] Login VSI Releases Login Enterprise 4.1

Login VSI Releases Login Enterprise 4.1 Comprehensive Testing Platform Ensures Business Continuity Continue Reading