login vsi company logo login vsi company logo 250x40

Adventures in Creating a Common Storage Workload

Adventures in Creating a Common Storage Workload

With Login VSI’s role as the industry-standard in performance testing within centralized desktop virtualization, it’s no surprise that storage-related vendors would come to us to develop a workload specific to storage. Testing that requires less infrastructure is a specific requirement for storage vendors because it allows for larger-scale tests. The goal for the storage workload is simple: Increase the number of IOPs per user (while being gentle on CPU and memory).

A simple job?

On the surface this appeared to be a relatively straightforward assignment for Login VSI. And a useful one: Agreement on storage workloads would help make more sense of the rapidly changing storage market. There have been many new developments in storage capacity adding to confusion. What’s more, competing vendors each offer a slightly different interpretation of storage capacity or needs.

Not so fast

It turns out that creating a storage workload is not easy or straightforward at all (even for us—ha ha). We found that our general assumptions about workloads didn’t translate to the storage world. However, we were able to overcome many obstacles and developed a working Storage Workload beta that we been testing with several storage vendors.

Breakthroughs

Those familiar with Login VSI know about workloads. In creating the Storage Workload, we used the generic medium workload (Knowledge Worker) and replaced the low IPOs/high CPU applications and activities (like watching a video or typing a document) with more IOPS-intensive activities. Additionally, we:

  • Dramatically increased the speed of the virtual user/worker (to an unrealistic level)
  • Built in a mechanism to continuously empty the cache (so that apps cannot start from memory)
  • Allowed the Storage Workload to run in the so-called Direct Desktop mode, without the need for launchers. (This takes away the influence of the remoting protocol in the test which is less relevant for an IOPS-intensive storage test).

With these changes some things stayed the same: We still do everything with real data, real applications and virtual users.

IOPS max

We also learned an interesting fact: There is a maximum number of IOPS that can be reached with real data and real applications. Without “going synthetic” we are roughly reaching the 25 to 30 IOPS point, which is about 3 times the amount in our normal medium workload. These results will vary depending on performance tuning in your environment.

Is this enough? Do we need to add a volume knob to mix in synthetic workload and pump up the volume?

Most vendors claim that this is enough and that Login VSI should remain “the purist of performance testing.” There are enough synthetic workload providers. Real data with real applications are what truly make Login VSI different.

As more storage vendors experience the Storage Workload beta, we will collect and interpret feedback. Please be aware that the Storage Workload, once out of beta, will not be included in Login VSI Professional License offering, but will instead be an add-on with separate pricing.

If you are interested in testing the new Storage Workload beta, contact us for more information.

About the author

Pim Brouwer (@PimBrouwer) is VP Alliances at Login VSI where he manages all relationships with IT vendors and is responsible for Login VSI’s partner ecosystem. For fun, Pim runs the Netherlands America Foundation (NAF) Business & Innovation Zone (BIZ) in the SF Bay Area. He lives in beautiful Marin, CA, and loves both mountain and road cycling.


Tags: Features, Storage Workload

Popular Blogs

Login VSI - Blog - 4 Things to Consider when Running Office 365 in the Cloud

4 Things to Consider when Running Office 365 in the Cloud

Recently a customer decided to move their entire VDI infrastructure into the cloud. The VDI environment was approximately 20,000 users. As you can imagine there are a lot of design decisions necessary to ensure the success of this migration. Continue Reading
What's New in Login PI 3.6?

What's New in Login PI 3.6?

Public API, Enhanced support for Published applications, RDS Broker/Gateway and SQL Databases! Last month we released a new version of Login PI 3 (3.6), bringing more features and functions to the product. The biggest additions are a RESTful Public Web API, improved support for Citrix Virtual Apps (Published Applications), a connector for a RDS Broker and Gateway and the ability to now connect the virtual appliance to a Microsoft SQL Server database. Continue Reading
Login VSI and Ymor Form Partnership to Deliver Performance Improvement to Business-Critical Applications

[Press Release] Login VSI and Ymor Form Partnership to Deliver Performance Improvement to Business-Critical Applications

The partnership offers a total solution for enterprise organizations to monitor and test business-critical applications from end-to-end via VDI or in the Cloud. Ymor offers various monitoring solutions, used to test and monitor the performance of critical business chains from end-to-end. In VDI environments, Ymor can now offer the monitoring solutions of Login VSI. Continue Reading
[Press Release] IGEL Expands Alliance with Login VSI; Integrates Login Enterprise into IGEL OS 11.03

[Press Release] IGEL Expands Alliance with Login VSI

Integrating Login Enterprise into IGEL OS 11.03 The combined solution enables IT organizations to leverage their IGEL infrastructure to continuously test the performance and availability of virtual and cloud workspaces. Continue Reading
Windows Virtual Desktop - Update - December 2019

Windows Virtual Desktop Enhanced in the Latest Update

A lot has already been written about WVD in the last months. And while I had my initial concerns on this service many people are suggesting that they are willing to move to a platform like WVD in the next two years. Continue Reading
How Using a Virtual User can Quantify the Performance of SAP and Citrix

How Using a Virtual User can Quantify the Performance of SAP and Citrix

When interacting with enterprise applications, the user experience is important. Users must be able to smoothly and efficiently interact with the application to be productive and achieve the goals of the enterprise. The applications are expected to be responsive, dependable, and consistent in their presentation. Continue Reading