• English
  • Deutsch
  • Nederlands

Twitter!

YouTube

RSS

Banner

Performing Tests

PDF Print

1. Performing Benchmarks

After you have prepared Login VSI and the target platform, you can run the benchmark:

  • Pre-create the local profiles.
  • Run the Test sequence.
  • Use the analysis tool to determine the virtual session indexes.

 

1.1. Configuring the MMC

Start the “VSI Management Console”. The first time you start the launcher it will ask you to install a license. If you do not yet have a license file you can request one for free. You can also choose to continue without a license file but then you cannot initiate more than one user session. This way you can already start testing and setting up Login VSI while you wait for the license to be approved.

1.2. Prepare the first test - Create Profiles

When you configure Login VSI using the management console to prepare your target system or image, enable the option “Create Profiles” on the first run. The Launcher machine creates the profiles on the designated target server. This will not perform a benchmark, but quickly pre configure the local profiles required for testing. To pre-create local profiles, only a single Launcher is required as the amount of concurrent open connections is minimal.


Before the actual Load Tests are started, it is important to first create the local user profiles on the target machines. When you are using images for your target system, it is highly recommend to prepare and include the local profiles within the image. This will save you a lot of time, as you are not required to run the pre-create profile phase on each new system before you can benchmark.



All active launchers will start initiation sessions to the target devices now; when profiles are created sessions will automatically logoff. After preparing the user profiles reboot the Login VSI environment including all launcher and target machines. This preparation has to be executed only once.

CCThis video contains captions (subtitles)

1.3. Perform a benchmark

  • Before you start a benchmark run, ensure the “Create Profiles” box is unchecked. If the “Create profiles” checkbox is checked, no results will be logged.
  • It is recommended to configure the “Auto Logoff” option to automatically stop the benchmark after all sessions have been started. However, if a server is truly saturated it is very likely that not all sessions will be logged off because they hang.
  • Always reboot the target platform and launchers before starting a new test run. This ensures that the system has no locked files and sessions left that can impact the performance.

1.4. Starting the test

CCThis video contains captions (subtitles)

2. Advanced settings

This chapter describes how to configure the MMC If your test requires a more advanced configuration.

2.1. Sequential vs. parallel launching

Sequential:
By default Login VSI initiates sessions in “Sequential” mode, this mode is designed for small scale tests (or single host tests). Each launcher will initiate the assigned sessions before continuing to the next launcher as shown in the image below where each green arrow is representing a session.

Login VSI Sequential Launching

Parallel:
When performing large scale tests the sequential mode testing would take too much time or the interval in-between sessions might be too low for one launcher to handle. In this scenario use the parallel launch mode. When launching sessions in parallel mode the sessions are “Load balanced” over all launchers and all launchers will start initiating sessions immediately.

Login VSI Parallel Launching

2.2. Custom Command Line

The Login VSI launcher is platform and protocol independent with the introduction of the “Custom” and “Custom with CSV file” connection options. As long as the client allows the use of a command-line to automatically launch sessions, Login VSI will support that platform. The “Custom” function is really simple, you may use variables specified as setting in the Launcher: %input_servername%, %input_username%, %input_domain%, %input_password%, %count%. This example (dummy code) will connect multiple users to a broker:

Dummy Example:

ExampleClient.exe /user:%input_domain%\%$input_username%%Count% /Broker:%input_servername% /Password:%input_password%

RDP Example:
To setup a RDP connection Login VSI uses LaunchRDP.exe created by Remko Weijnen to setup remote RDP connections because the default MSTSC.exe provided by Microsoft does not allow passtrough off a password parameter.

LaunchRDP.exe %input_servername% 3389 %input_username% %input_domain% %input_password% 0 0 0

 

2.3. Custom Command Line with CSV

For added flexibility you can create CSV for input of your custom command line. There is no limitation on the amount of columns (variables) and the naming of the parameters. Use a comma “,” as a delimiter. The setup of the CSV is straightforward, the launcher will process the second row and use the name specified in the first row as variable name. Save the custom CSV file in the Login VSI share.

Workstation User Domain Password
Desktop1 User1 MyDomain 1234
Desktop2 User2 MyDomain 5431
Desktop3 User3 MyDomain 2342

RDP Example:
To setup a RDP connection Login VSI uses LaunchRDP.exe created by Remko Weijnen to setup remote RDP connections because the default MSTSC.exe provided by Microsoft does not allow passtrough off a password parameter.

LaunchRDP.exe %CSV_Workstation% 3389 %CSV_User% %CSV_Domain% %CSV_Password% 0 0 0

2.4. Starting a test unattended (command-line)

To start a test fully automatic start the Login VSI Management console with the "Silent" parameter, this will force the management console to start a test with the last updated configuration and the specified testname on the command-line. This scenario is usefull in enterprise environments where tests are executed fully automatic. To start a test commandline use the following commandline:

"VSI Management Console.exe" silent "Name of Test"

This approach still requires all of the VSI launcher agents to be running (and ready) before a test is started.

2.5. Using Multiple Launchers

When performing large scale tests, ploblable multiple launchers are required. Setting up mulitple launchers is easy.

  • First configure all setting in the Management Console Launcher and save the settings.
  • Reboot all launcher machines
  • Make sure the Login VSI-Agent is started on all launcher machines
  • Start a test in the Login VSI Management Console
  • The Login VSI-Launcher agents will start the test run. The Slave Launcher(s) will automatically wait until the session total has reached their starting point.

 

2.6. Launcher Considerations:

  • Before you start a new test run, always reboot or re-logon on each launcher, to fully reset the sessions
  • To stop a launcher while it is running, right-click the Login VSI system tray icon and choose “exit”.
  • Always start with session number 1 on the master launcher, any other starting number will skew the logging results.
  • To reset test settings, delete VSItarget.ini & VSIlauncher.ini located in the central Login VSI share.

If you did not tune GDI limits on Windows, do not configure more than 45 sessions per launcher to be safe.

2.7. Launcher Settings

Launcher Settings
Workload Select a workload representing the type of test you want to perform. The default workload for Login VSI is the “Medium” workload. Pro users can also select: Light, Medium, MediumNoFlash, Heavy, Multimedia, Core and Mashup.
Workload mashup When running the mashup workload different workloads can be combined. Add all the workloads you want to perform to activate them for all users within the test.
Auto start launcher When enabled the “Launcher-Agent” will automatically be executed when starting a test on the MMC machine.
Launch type Sequential:
Start all sessions from one launcher until the maximum capacity is reached then go to the next launcher. This scenario is recommended for small scale tests and single machine tests.
Parallell:
All launcher initiate sessions during the whole test. This scenario is recommended when performing large scale test.
Reset locked sessions BETA; Login VSI supports resetting stuck sessions. When enabled Login VSI will reset a session that is stuck and restart the session. Please note that when a large number of sessions is locked we recommend troubleshooting the problem instead of enabling this feature.
Auto Logoff When enabled sessions will automatically logoff when a test has been completed
Auto Logoff timeout (Seconds) When enabled sessions will continue running the configured time before starting the auto logoff process. Auto logoff has to be enabled.
Create Profiles This enables the pre-create profiles modus on the target platform. The session will end and logoff after all applications are started once. This prevents overhead of a new local profile.
Connection type Choose through which protocol you wish to start sessions on the target platform:
RDP
This will use the RDP client, both 5.x and 6.x are supported.
This setting will connect multiple users (e.g. LoginVSI_1- LoginVSI_50) to a single Terminal (configured in servername)
ICA
This will use an ICA client to start direct ICA connections.
This setting will connect multiple users (e.g. LoginVSI_1- LoginVSI_50) to a single Citrix server (configured in servername)
Custom
Here you can use any command line and use the parameters as variables you have entered as input.
Custom with CSV
Work the same as Custom mode, but now it is also possible to specify a CSV file. This is a very powerful feature, more is explained in the chapter “Using a CSV file”
Custom Commandline
Specify Custom Commandline The Login VSI launcher is platform and protocol independent with the introduction of the “Custom” and “Custom with CSV file” connection options. As long as the client allows the use of a command-line to automatically launch sessions
Specify CSV File To populate the Custom Commandline a CSV file can be used
Connection Settings
Servername Specify here the name or IP address of the target Windows server/computer you want to test:
Specify the full name if you will perform a test with multiple users on a single machine (typical in a SBC environment).
If you test multiple target machines with a single user (typical in a VDI environment), do not add the number, this will be automatically appended by the launcher.
Username Specify the name of the test account(s):
If you test a single target machines with a multiple users (typical in a SBC environment), do not add the number, this will be automatically appended by the launcher.
Specify the full name if you will perform a test with a single user on a multiple machine (typical in a VDI environment).
Password Specify the password of the test user(s).
The Login VSI launcher assumes you a single password is used for all test users. If you require more complexity regarding the passwords use the CSV option.
Domain Specify here the domain name of the test user created in AD
Interval Settings
Connect Choose either:
User: this will append the session number to the username you have specified, it will not do this for the servername.
Machine: this will append the session number to the servername you have specified, it will not do this for the username.
If you need more advanced numbering (on both the servername and username for instance) use the “custom with CSV” connection type.
Start number If you require a test to start at a user number that is higher than default (1) please enter the start number here.
Sessions Here you select the amount of session you want to start from a single launcher. If you specified “User” in the connect setting, it will append the session number to the username you have supplied.
If you specified “Machine” in the connect setting, it will append the session number to the servername you have supplied.
Formatting length Specify here if you want to reserve a specific amount of digits for the session numbering.
Interval Select the interval before a new session is launched, user density is typically much higher on a Terminal Server platform, this allows also a higher logon rate than VDI.
Recommended settings:
Terminal Server set a 30 second interval
VDI set a 60 second interval
TimeFrame When launching sessions in parallel mode you cannot specify an Interval. In parallel mode you specify the time in seconds wherein the launchers have to start all sessions. Based on their capacity all launchers will automatically calculate the number of sessions they have to launch and the required interval to do this within the timeframe.
Launch Delay The launch delay can be used to make all launchers wait for a specified amount of time (seconds) before starting a test.