2261294
Predicting the Upper Bound of Web Traffic Volume Using a Multiple Time Scale Approach
This paper presents a prediction algorithm for estimating the upper bound of future Web traffic volume. Unlike traditional traffic predictions that are performed at a single time scale using curve fitting, we employ a multiple time scale approach and utilize traffic statistical properties to do forecasting. We have applied our prediction algorithm to the 1998 World Cup data set. Experiments show that it is effective for short term traffic bound predictions, applicable to bursty traffic, and useful for Web server overload prevention.
45502875
DotSlash - Creating Content Distribution Networks on Demand
Traditional content distribution networks, such as Akamai, are well-suited for static web services that routinely experience large traffic volumes. They are unsuited for active content, i.e., content generated by scripts from databases, and web sites that are unlikely to receive significant number of requests. However, a few such sites will invariably experience their "fifteen minutes of fame", typically by being mentioned on a high-volume news site such as SlashDot or CNN. Such flashcrowds or "slashdot effect" will routinely cause single-server websites to collapse. We have designed and prototyped an autonomic web replication system, called DotSlash, that drafts rescue servers fully automatically, without user intervention. The system discovers suitable rescue servers via wide-area service location, either among peer servers or from a dedicated pool of rescue servers, allocates them for temporary use and redirects requests to them. The system is completely transparent to clients and does not require URL rewriting or other client modifications. We have designed two versions. The first, an Apache extension, deals only with static content, e.g., HTML pages or media objects. The second version can also replicate and execute scripts remotely. We have prototyped the system for the common LAMP (Linux, Apache, MySQL and PHP) configuration and shown that a common benchmark for bulletin boards can be replicated without code changes, yielding capacity increases bounded only by the database server. Since many such systems, including most blogs, are bottlenecked by the web server, our system can significantly increase capacity and works even for extremely rapid load increases. We are currently investigating how such systems can be further extended by increasing the database capacity of read-mostly systems with loose consistency constraints.
30153007
Selective anti-entropy
Anti-entropy [1] is an important mechanism to achieve eventual consistency among a set of replicas. We refer to traditional antientropy [2, 3] as complete anti-entropy, where two replicas reconcile all inconsistent states between them in a two-way session or two one-way sessions. Complete anti-entropy works well in full replications, but may cause a summary problem (a replica cannot summarize its received updates using a summary vector) in partial replications (where the state set is divided into subsets referred to as scopes). To avoid the summary problem, we propose to use selective anti-entropy, which is to selectively reconcile inconsistent states between two replicas in a session, i.e., a replica specifies the subsets of updates it solicits, and thus controls what it receives from another replica. In selective anti-entropy, all updates that are initially received by the same replica R= belong to the same s u b s e t / ~ . The subset of a state is determined by the last update applied to it. A selective anti-entropy session where R¢ requests new updates in -P~i, Rx2, .... R~ k from R~ is denoted as O(R~, {/:/=~, Rx2, ..., R=k }, R~). We distinguish four types of selective anti-entropy sessions (listed in Figure 1) based on the number of subsets requested and whether the session is direct or indirect. We assume that a replica R¢ does not request updates in ~ from other replicas. A session is direct if it only requests updates in R--~ from R= (e.g., O___(R~, { ~ } , R~)), otherwise the session is indirect (e.g., O(R=, {1-~u}, R~)) or mixed (e.g., O(_R=, {R~, R~}, R~)). A select-multiple or select-all session can be viewed as comprising k (k >_ 2) select-one sessions, in which at most one is select-one-direct session, and the rest are select-one-indirect sessions. A select-all session is equivalent to a complete anti-entropy session. An anti-entropy session is safe if it will not cause the summary problem. A replica can always choose safe sessions by using selective anti-entropy. Any select-one-direct anti-entropy session, such as O(R=, {R~}, R~), is safe. A select-one-indirect anti-entropy session O(R=, {R-~y}, R~) is safe if S(R=) A S(Ru) C_ S(R~), where S(R=), S(Ru) and S(Rz) denote the scopes of Re, Rv and R~, respectively. In other words, if S(R=) n S(Ru) D S(R=), O(R=, {R-~}, Rz) may cause the summary problem. In Figure 2, for example, O(Ra, {R1}, R6) is safe because S(Ra) N S(R1) = {$1, $2} = S(R6) , but O(R3, {R6}, R2) may not be safe since
16064988
Enhancing Service Location Protocol for efficiency, scalability and advanced discovery
This paper presents three new mechanisms for the Service Location Protocol (SLP): mesh enhancement, preference filters and global attributes. The mesh enhancement simplifies Service Agent (SA) registrations and improves consistency among Directory Agents (DAs) by defining an interaction scheme for DAs and supporting automatic registration distribution among peer DAs. Preference filters facilitate processing of search results (e.g., finding the best match) in SLP servers (DAs and SAs) to reduce the amount of data transferred to the client for saving network bandwidth. Global attributes allow using a single query to search services across multiple types. These mechanisms can improve SLP efficiency and scalability and support advanced discovery such as discovering multi-access-point services and multi-function devices. We expect that these techniques can also be applied to other service discovery systems.
9589474
DotSlash: A Self-Configuring and Scalable Rescue System for Handling Web Hotspots Effectively
DotSlash allows different web sites to form a mutual-aid community, and use spare capacity in the community to relieve web hotspots experienced by any individual site. As a rescue system, DotSlash intervenes when a web site becomes heavily loaded, and is phased out once the workload returns to normal. It aims to complement the existing web server infrastructure to handle short-term load spikes effectively. DotSlash is self-configuring, scalable, cost-effective, easy to use, and transparent to clients. It targets small web sites, although large web sites can also benefit from it. We have implemented a prototype of DotSlash on top of Apache. Experiments show that using DotSlash a web server can increase the request rate it supported and the data rate it delivered to clients by an order of magnitude, even if only HTTP redirect is used. Parts of this work may be applicable to other services such as Grid computational services.
14517544
Distributed Scheduling of Tasks with Deadlines and Resource Requirements
A set of four heuristic algorithms is presented to schedule tasks that have headlines and resource requirements in a distributed system. When a task arrives at a node, the local scheduler at that node attempts to guarantee that the task will complete execution on that node before its deadline. If the attempt fails, the scheduling components on individual nodes cooperate to determine which other node in the system has sufficient resource surplus to guarantee the task. Simulation studies are performed to compare the performance of these algorithms with respect to each other as well to two baselines. The first baseline is the noncooperative algorithm where a task that cannot be guaranteed locally is not sent to any other node. The second is an (ideal) algorithm that behaves exactly like the bidding algorithm but incurs no communication overheads. The simulation studies examine how communication delay, task laxity, load differences on the nodes, and task computation times affect the performance of the algorithms. The results show that distributed scheduling is effective even in a hard real-time environment and that the relative performance of these algorithms is a function of the system state. >
16198597
Effective delay control for high rate heterogeneous real-time flows
This paper presents a new method to control the delay performance for high rate heterogeneous real-time traffic flows based on a novel traffic control algorithm which is a generalization of traditional (/spl sigma/, /spl rho/) regulator. Our new control algorithm operates like the traditional regulator under the normal loading situation, but provides more regulation for the high rate (heavy load condition) of the traffic. For a set of heterogenous real-time traffic flows R we can show that D/sub r/(R) /spl les/ D(R) where D/sub r/(R) and D(R) are the worst-case delay bounds with our new control algorithm and that with (/spl sigma/, /spl rho/) regulator respectively. More specifically, we develop a set of formula that can be used to set the parameters in our new traffic controller so that the worst case delay bound is minimized by streaming the traffic flow. We can prove that there exists a minimum (average) input rate p* such that D/sub r/(R) = D(R) for /spl rho/ /spl les/ /spl rho/* and D/sub r/(R) < D(R) for /spl rho/ > /spl rho/*. Using the extended regulator can effectively control the delay when the average heterogeneous traffic rate is high. The issues are particularly useful for Integrated Services where a flow may over claim its share of resource and for Differentiated Services where a class of traffic flows may possess very high rates.
2999153
Distributed policy processing in virtual private operation environment for large scale networks
VPOE (virtual private operation environment) is an infrastructure to provide customized services for applications in large-scale heterogeneous networks. In this infrastructure, the programmable network devices - called "middleware boxes" can be deployed at some functional locations in the network and provide services effectively corresponding to the service requirements. The basic functionality of middleware box is to execute customized policies. With the number of applications increasing and new services becoming popular, the policy matching and processing have been becoming a bottleneck for the middleware box performance. We focus on designing a scalable policy processing architecture, aiming to deal with this issue. Particularly, our technologies include: (1) a distributed policy processing architecture for the middleware box; (2) two policy partitioning algorithms to achieve conflict-free policies for the distributed policy processing architecture and guarantee the correctness of the policy execution. We conduct extensive performance evaluations on different architectures and algorithms. The evaluation results show that the distributed architecture can achieve over 70 percent increase of performance/price ratio with proper assignment of the policy distribution degree. The experimental results also demonstrate that to make the policy both partition capable and conflict free, more new policies have to be generated, which can be effectively reduced by using the policy compression schemes.
1315595
An energy-efficient slack distribution technique for multimode distributed real-time embedded systems
In multimode distributed systems, active task sets are assigned to their distributed components for realizing one or more functions. Many of these systems encounter runtime task variations at the input and across the system while processing their tasks in real time. Very few efforts have been made to address energy efficient scheduling in these types of distributed systems. In this paper, we propose an analytical model for energy efficient scheduling in distributed real-time embedded systems to handle time-varying task inputs. A new slack distribution scheme is introduced and adopted during the schedule of the task sets in the system. The slack distribution is made according to the service demand at the nodes which affects the energy consumption in the system. The active component at a node periodically determines the service rate and applies voltage scaling according to the dynamic traffic condition observed at various network nodes. The proposed approach uses a comprehensive traffic description function at nodes and provides adequate information about the worst-case traffic behavior anywhere in the distributed network, thereby enhancing the system power management capabilities. We evaluate the proposed technique using several benchmarks employing an event driven simulator and demonstrate its performance for multimode applications. Experimental results indicate significant energy savings in various examples and case studies.
61581455
Using traffic regulation to meet end-to-end deadlines in ATM LANs
This paper considers the support of hard real-time connections in ATM networks. In an ATM network, a set of hard real-time connections can be admitted only if the worst case end-to-end delays of cells belonging to individual connections are less than their deadlines. Although there are several approaches to manage the network resources in order to meet the delay requirements of connections, we focus on the use of traffic regulation to achieve this objective. Leaky buckets provide simple and user-programmable means of traffic regulation. We design and analyse an efficient optimal algorithm for selecting the burst parameters of leaky buckets to meet connections' deadlines. Our algorithm is optimal in the sense that it always selects burst parameters to meet the delay requirements of hard real-time connections whenever some such assignment exists. The exponential size of the search space makes this problem a challenging one. Our algorithm is efficient and we observe a dramatic improvement in the system performance in terms of the connection admission probability when traffic is regulated using our algorithm.