July 1, 2008 - Sven Huisman
Citrix on VI3.x recommendations
Verron Martina from VMware dropped me an e-mail with a lot of recommendations for running Citrix in a VI3.x environment. These recommendations come from other system engineers from VMware working in the field. Thanks Verron, for sharing this.
– I used the ballooning driver. Some Citrix forums will tell you not to use it but for us the ballooning driver made a complete difference.
– Start by using only one vCPU per VM and if possible use affinity to make sure that the VM is not running on the same core as the console or another VM.
-The sweet spot we found was to assign only 2GB to the VM and something between 30 and 40 users per VM.
– Our target was not to beat a physical CPS server with a single VM but get more aggregated users using 2 or 3 VMs (depending on the number of cores available) with no more than 40 users per VM. Do not over commit the cores as that will lose advantage.
– The final target for us was to demonstrate that the VMs running simultaneously on the same physical server can get a higher number of users (between 70 and 90% more) than a normal CPS installed on the same HW while user experience (keyboard-screen response times, login times, app launch times, etc) are very similar.
– Some times we have to be patient and wait a few minutes for the VM to get steady, then the magic shows up and the VMs will surpass the physical server regarding load tolerance.
– Regarding login times, the VM can show longer times; however, once the user is in, the VMs will look fast. Check than DNS servers are not getting messy as this is commonly the problem with long login times.
– Make sure that the network interfaces are using fixed speed when connecting to the network, do not leave auto negotiated speeds. The best is to use 1000 mbps FULL DUPLEX.
-Use one virtual disk for Windows and CPS and a different virtual disk for Windows paging of the same VM.
-When installing VMware tools use a custom installation and remove the shared folder feature. This is very important as Citrix seems not to like that and it is a useless feature on ESX as it s meant for Workstation.
· Follow VMware’s best practices for performance tuning on ESX (http://www.vmware.com/pdf/vi_performance_tuning.pdf)
· Build your template Citrix virtual machine from scratch (don’t convert an existing physical server).
· Use a single virtual CPU for the template vm
· This will allow the Windows operating system in the guest to use a uni-processor HAL, as opposed to a SMP HAL, streamlining the guest operating system.
· Configure the template vm for 2-4 GB RAM.
· Configure separate virtual disks (VMDK files) for the operating system and the pagefile.
· at VMware – http://www.vmware.com/vmtn/resources/608).
· Use a 64-bit Windows installation.
· Have an understanding of what an ‘acceptable’ threshold of users will be… Some customers see an increase in the number of users per Citrix instance when virtualized, some see fewer. You should go into it with the expectation that you may get fewer users, as well as what you would like to see (ie 80% of physical or better? 70%?).
Bear in mind that even if you get fewer users per vm than in a physical environment, there are many other benefits to using virtualized Citrix servers:
o One of the things many Citrix shops struggle with is their deployment process – how do we maintain an up-to-date image for the farm that incorporates the required applications and accommodates the hardware in question… rolling out Windows, including updates and patches, and the Citrix software (though this could be handled by Citrix Installation Manager). Either way, you are maintaining server images somewhere – either through the use of a complicated installation script, or through imaging software such as Ghost.
o Deploying a virtual machine through the use of templates is far quicker and more efficient than any other physical imaging process you might have used. VMs can be deployed in a matter of minutes using templates. The templates themselves can be created from existing virtual machines, and can be copied and used with VMware snapshots or SAN/NAS snapshots, giving you the ability to easily maintain a library of templates for different types of operating systems, applications, etc.
· Disaster recovery
o Setting up a Citrix farm to failover to another site requires a large investment in hardware, and man-hours to configure the remote site to handle all the applications necessary. Furthermore, the hardware in the remote site has to be of the same type as the primary, or your deployment strategy has to take hardware differences into account.
o Using virtual machines, all you need to do to enable a DR site is have a copy of the required virtual machines in the remote location – hence you only need to set up the farm once, and maintain a copy of it in the remote location. Spinning up your DR or business continuity site is a matter of ‘powering up’ the virtual machines. VMware Site Recovery Manager may even help automate that process.
o Since the citrix system is accessed by users like a PC on a regular basis, a Citrix server is more prone to failure than a regular server (though, with proper maintenance, hopefully less prone than a desktop). Server outages mean lost productivity for your users, and a significant effort in troubleshooting the problem, since Terminal Services is a good deal more complicated than a regular server.
o To properly design for the outages we know we will have, you have to have extra capacity in the farm to handle the overflow users when one of the servers is down. This is true for both planned and unplanned downtime.
o VMware ESX has been recognized in the industry as one of the most stable platforms to be introduced… ever. This means fewer outages due to host failures. Also, since we standardize and virtualize the hardware of the guest operating systems, this holds true across different hosts, enabling your virtual machines to run across hosts from different manufacturers and chipsets.
o See http://redmondmag.com/features/article.asp?EditorialsID=2400
· Application Deployment
o Many Citrix shops do a good deal of work maintaining multiple images – deploying applications in ‘stovepipe’ configurations… that is to say, multiple small groups of Citrix servers, each dedicated to a specific set of applications. Frequently, this is due to largely due to application incompatibility. However, it results in the Citrix admin being required to maintain several different images for the Citrix farm.
o Even if the shop has standardized on a single Citrix image, they will not be using the company’s standard application deployment methodology… Terminal Services is too funky with regards to application deployment, and requires much handholding. Most Citrix shops has compeletely separate processes for packaging applications for a PC versus a Citrix server.
o VMware ThinApp (http://www.thinstall.com) can be used to image your applications separately from the Citrix image… In fact, an application that has been packaged with ThinApp on Windows 2003 will work on Terminal Services, Citrix, Windows XP, and Vista, eliminating the need to package that application for the different platforms. Furthermore, ThinApp includes a ‘sandbox’ to prevent applications from conflicting with each other. You simply place the packaged application on a file share on the network, accessible to the Citrix servers (or PCs, or both), and you are done. Your users simply execute the application from the shared directory, and they are off and running. This results in a win-win for the customer – the ability to package an application once, and use it for either a PC environment or a Citrix environment.
In short, there is a lot more to the story than just consolidation. We have customers here in Richmond that have deployed VMware ESX server for their high-end Oracle databases (Markel Corp), and they have accepted a 1:1 consolidation ratio (that means one virtual machine per physical host). The value to the organization is not just in consolidation, but in the strength of the platform, the disaster recovery capabilities, and how the infrastructure immediately becomes more fluid and resilient.
Optimizing Citrix Presentation Server on Vmware ESX Server – http://download3.vmware.com/vmworld/2006/med0115.pdf
Citrix and Vmware – http://download3.vmware.com/vmworld/2006/tac9728.pdf
Best practices for deploying Citrix on ESX – http://virtrix.blogspot.com/2007/03/vmware-best-practices-for-deploying.html
Improving Scalability for Citrix Presentation Server – http://www.vmware.com/pdf/esx_citrix_scalability.pdf
To virtualize or not Citrix and Terminal Server – http://www.vmware.com/community/thread.jspa?messageID=671864
Citrix and VMware: Oil and Water? – http://redmondmag.com/features/article.asp?EditorialsID=718
BriForum 2006 Video: Ron Oglesby on the feasibility of running Citrix in a VM – http://www.brianmadden.com/content/article/BriForum-2006-Video-Ron-Oglesby-on-the-feasibility-of-running-Citrix-in-a-VM
1) You typically run more instances of Citrix = more OS licenses. Always several Citrix PS instances per (very expensive ESX server) instead of 1 per (very cheap low-end box). It’s not necessarily a consolidation/cost savings model. It depends on #users/host in the Citrix environment etc.
2) The real advantages are:
a. Snapshots! So handy to make a change/patch and rollback if it screwed everything up
b. Hardware Independence for Citrix instances
i. vMotion/HA benefits of anytime hardware maintenance and greater uptime even on failure
ii. Ability to actually DR your Citrix environment