Microsoft has recently announced new Azure VM options that support high-end GPUs.
The reason: for some applications this is much more effective technical solution (see charts below)
Applications that scale using GPU Compute @ Microsoft Azure
Even Amazon Web Services is also offering similar options:
Windows GPU Instances - Amazon Elastic Compute Cloud
Programming Guide :: CUDA Toolkit Documentation @ Nvidia