With technological advancements and constant changes of Internet, cloud computing has been today's trend. With the lower cost and convenience of cloud computing services, users have increasingly put their Web resources and information in the cloud environment. The availability and reliability of the client systems will become increasingly important. Today cloud applications slightest interruption, the impact will be significant for users. It is an important issue that how to ensure reliability and stability of the cloud sites. Load balancing would be one good solution. This paper presents a framework for global server load balancing of the Web sites in a cloud with two-level load balancing model. The proposed framework is intended for adapting an open-source load-balancing system and the framework allows the network service provider to deploy a load balancer in different data centers dynamically while the customers need more load balancers for increasing the availability.