login vsi company logo login vsi company logo 250x40

 

Get the best possible VDI performance, density and availability with Login VSI
Our Solutions

  • Home
  • Blog
  • Login VSI
  • Best Practices in Virtualization Testing: Small-scale vs. full-scale testing

Best Practices in Virtualization Testing: Small-scale vs. full-scale testing

Best Practices in Virtualization Testing: Small-scale vs. full-scale testing

Deploying and maintaining VDI is a challenge for every company. There are so many decisions to make and the speed of change seems to be accelerating. Because we are all constantly trying to make the best use of constrained resources, a question we get regularly here at Login VSI has to do with scaling tests. It goes something like: "If I want to find out the number of servers I need, I simply test how many users I can put on one server then multiply by the number of users I need to support. Right?"

My answer to this is a definite "Njet, no way, negative." Your complete environment responds fundamentally differently than when you test on just one or two machines. The most obvious reason for this is your storage system. It’s very likely that you are using shared storage. Meaning, at some point you will be out of storage resources. And without storage optimization solutions, this might be sooner than you like.

People new to VDI might think that performance scales linearly with the number of servers. While this is typically true for the first 2 or 3 servers, after that scaling quickly becomes non-linear. The graph below illustrates this point. The blue line shows the expected number of desktops on the total number of servers. While performance of the desktops is fine at 400 users, we can clearly see that at 500 users simply adding an extra server won't satisfy our needs.

virtual desktop performance - vdi does not scale linearly

Beyond the question of storage, in complex environments there are more commonly shared components. Examples are:

  • Broker / Load balancers
  • Monitoring
  • Storage
  • Power
  • Networking
  • Cooling
  • Antivirus
  • Backend databases
  • Fileservers
  • Application servers or application virtualization techniques
  • Etc..

The only way you can truly validate that all of the above are working correctly together is by testing at full scale. These are some of the questions you might have that testing at capacity can help answer:

  • Is my environment stable and performing at the desired capacity
  • Are the backend systems handing the load?
  • Can my environment handle logon-storms?
  • What happens if one of my datacenters fails?
  • What happens if one of my servers (or racks) fails?

Through the years, we have seen plenty of examples where the environments that our customers designed looked great, but in practice and when testing at full scale they just didn’t work. For example, I witnessed an environment where too much power was being pulled from the grid during a Login VSI test. This caused the VDI Proof of Concept rack to be disconnected from power. While this was not a problem because it happened in a test environment, imagine the panic if this were to be discovered in production with thousands of real users.

A separate example was at another company where the storage device was misconfigured to only use a limited amount of CPU. Initial tests with few users indicated that there wasn't a problem. But as soon as we started to ramp up the tests to about 400 or 500 users, the environment came to a complete halt. After identifying and resolving the issue, we were able to host the desired number of users on the environment and move to the pilot phase.

My advice: When you start to do performance tests, of course it’s a good idea to start with just one machine. Make sure this works and you get the best performance out of it. Right after this initial test, start increasing the test size to full-scale. The same goes for environments that are already in production. At some point you are likely to make a change. When it comes to any of the components mentioned above, I highly recommended to test at scale so you know exactly what level of performance to expect.

 


 

Start using Login VSI today

Our industry-standard software is built to help you avoid problems, lower costs and improve performance. Request a Quote or get your free Trial below, and benefit from our award-winning services.

Free Price Request  Your Free Trial

 


About the company Login VSI

The company Login VSI provides end-user performance insights for virtualized desktop and server-based computing environments. Enterprise IT departments use flagship product Login VSI (for load testing) and Login PI (for continuity testing) in all phases of their virtual desktop deployment—from planning to deployment to change management—to build and safeguard a good performance, a high availability, and (as a result) a good and consistent end-user experience. For more information about Login VSI or for a free test license contact us.

About the author

Mark Plettenberg (@markplettenberg) is a product manager of Login VSI and has played a critical role in the development and growth of Login VSI. Ask Mark about motorcycle mechanics and breaking/repairing anything and everything that has a power plug.


Tags: How-to, Login VSI, Videos, Load Testing, Best Practices

Popular Blogs

Login VSI Blog - Ongoing Effects CPU Flaws

The Ongoing Effects of Intel CPU Flaws

The Ongoing Effects of Intel CPU Flaws Over the last year, we’ve seen many Intel CPU hardware flaws come to light and when news first broke about Meltdown & Spectre there was a lot of panic: "should we patch?", "What’s the performance impact?", "Can we still rely on this hardware?" Continue Reading
Login VSI Blog - Updating to Windows 10 1903? Make Sure to Test!

Updating to Windows 10 1903? Make Sure to Test!

Updating to Windows 10 1903? Make Sure to Test! It’s that time of the year again. Microsoft have released their spring update and the first IT-Pro’s are getting ready to move their VDI environment over. Continue Reading
Login AT Express offers Application Compatibility Testing for up to 50 applications for FREE

[Press Release] Login VSI introduces free license for award winning solution, Login AT

Login AT Express offers Application Compatibility Testing for up to 50 applications for FREE Atlanta, USA, May 22, 2019: Login VSI, the industry standard for VDI and SBC performance testing, announced today the availability of a new, free version of Login AT for Bulk Application Compatibility Testing. Continue Reading
Login VSI Blog - LVTE 2109 - Technology Advocates & Experts

Login VSI Technology Advocates and Experts 2019

About a year ago Login VSI, the industry standard in VDI performance testing, announced a new program Recognizing those individuals that have built and displayed extensive knowledge of the Login VSI software solutions, and visibly contribute to the End-User Computing (EUC) Community. Continue Reading
Introducing Login PI 3.4

Introducing Version 3.4 of Login PI

What’s New & Different - Introducing Version 3.4 of Login PI We've updated Login PI, the benchmark in unplanned-change and gradual-deterioration detection for VDI. New features include improving the way information is collected & distributed, the way customized workloads are created & the way actual tests are executed. Continue Reading
Login VSI Blog - What's New in Login PI 3.5

What's New in Login PI 3.5?

What's New in Login PI 3.5? Netscaler, SLA Reporting, Event Logging features and so much more! At the end of June, we released a new version of Login PI 3 bursting with new features and enhancements. There are so many that I could write pages of blog about it, but let’s just keep it simple and focus on some of the big items. Continue Reading
Cookie Settings