This topic gains popularity with cloud services and web applications.
Memcached is one of the most popular Open Source solutions for distributed cache.
Running memcached in Azure:
Membase (link) is one of the Memcached implementations for Windows that has a 64-bit installation package. It includes Memcached but also adds additional features.