10155852
Nexus: a novel weighted-graph-based prefetching algorithm for metadata servers in petabyte-scale storage systems
An efficient, accurate and distributed metadata-oriented prefetching scheme is critical to the overall performance in large distributed storage systems. In this paper, we present a novel weighted-graph-based prefetching technique, built on successor relationship, to gain performance benefit from prefetching specifically for clustered metadata servers, an arrangement envisioned necessary for petabyte-scale distributed storage systems. Extensive trace-driven simulations show that by adopting our new prefetching algorithm, the hit rate for metadata access on the client site can be increased by up to 13%, while the average response time of metadata operations can be reduced by up to 67%, compared with LRU and an existing state of the art prefetching algorithm.
20068677
A case study of parallel I/O for biological sequence search on Linux clusters
In this paper we analyze the I/O access patterns of a widely-used biological sequence search tool and implement two variations that employ parallel-I/O for data access based on PVFS (Parallel Virtual File System) and CEFT-PVFS (cost-effective fault-tolerant PVFS). Experiments show that the two variations outperform the original tool when equal or even fewer storage devices are used in the former. It is also found that although the performance of the two variations improves consistently when initially increasing the number of servers, this performance gain from parallel I/O becomes insignificant with further increase in server number. We examine the effectiveness of two read performance optimization techniques in CEFT-PVFS by using this tool as a benchmark. Performance results indicate: (1) doubling the degree of parallelism boosts the read performance to approach that of PVFS; and (2) skipping hot-spots can substantially improve the I/O performance when the load on data servers is highly imbalanced. The I/O resource contention due to the sharing of server nodes by multiple applications in a cluster has been shown to degrade the performance of the original tool and the variation based on PVFS by up to 10 and 21 folds, respectively; whereas, the variation based on CEFT-PVFS only suffered a two-fold performance degradation.
5775560
Hierarchical Bloom filter arrays (HBA): a novel, scalable metadata management system for large cluster-based storage
An efficient and distributed scheme for file mapping or file lookup scheme is critical in decentralizing metadata management within a group of metadata servers. This work presents a technique called HBA (hierarchical Bloom filter arrays) to map file names to the servers holding their metadata. Two levels of probabilistic arrays, i.e., Bloom filter arrays, with different accuracies are used on each metadata server. One array, with lower accuracy and representing the distribution of the entire metadata, trades accuracy for significantly reduced memory overhead, while the other array, with higher accuracy, caches partial distribution information and exploits the temporal locality of file access patterns. Extensive trace-driven simulations have shown our HBA design to be highly effective and efficient in improving performance and scalability of file systems in clusters with 1,000 to 10,000 nodes (or superclusters).
536806
CEFT: A cost-effective, fault-tolerant parallel virtual file system
The vulnerability of computer nodes due to component failures is a critical issue for cluster-based file systems. This paper studies the development and deployment of mirroring in cluster-based parallel virtual file systems to provide fault tolerance and analyzes the tradeoffs between the performance and the reliability in the mirroring scheme. It presents the design and implementation of CEFT, a scalable RAID-10 style file system based on PVFS, and proposes four novel mirroring protocols depending on whether the mirroring operations are server-driven or client-driven, whether they are asynchronous or synchronous. The comparisons of their write performances, measured in a real cluster, and their reliability and availability, obtained through analytical modeling, show that these protocols strike different tradeoffs between the reliability and performance. Protocols with higher peak write performance are less reliable than those with lower peak write performance, and vice versa. A hybrid protocol is proposed to optimize this tradeoff.
26735928
I/O Response Time in a Fault-Tolerant Parallel Virtual File System
A fault tolerant parallel virtual file system is designed and implemented to provide high I/O performance and high reliability. A queuing model is used to analyze in detail the average response time when multiple clients access the system. The results show that I/O response time is with a function of several operational parameters. It decreases with the increase in I/O buffer hit rate for read requests, write buffer size for write requests and number of server nodes in the parallel file system, while higher I/O requests arrival rate increases I/O response time.
16064075
Boosting performance of I/O-intensive workload by preemptive job migrations in a cluster system
Load balancing in a cluster system has been investigated extensively, mainly focusing on the effective usage of global CPU and memory resources. However, if a significant portion of applications running in the system is I/O-intensive, traditional load balancing policies that focus on CPU and memory usage may cause the system performance to decrease substantially. To solve this problem, a new I/O-aware load-balancing scheme with preemptive job migration is presented to sustain the high performance of a cluster with a diverse set of workload conditions. The proposed scheme dynamically detects I/O load imbalance on nodes of a cluster, and determines whether to preempt some running jobs on overloaded nodes and migrate them to other less- or under-loaded nodes. Besides balancing I/O load, the scheme takes into account both CPU and memory load sharing in clusters, thereby maintaining the same level of performance as existing schemes when I/O load is low or well balanced. Results from a trace-driven simulation show that, compared to the existing approaches that only consider I/O with nonpreemptive job migrations, the proposed schemes achieve the improvement in mean slowdown by up to a factor of 10.
17203024
A channel-aware adaptive control to the MAC protocol in rate adaptive wireless LANs
Due to the low efficiency of legacy IEEE 802.11 MAC protocol, it has been the main bottleneck of wireless local area networks (WLANs). In this paper, we focus on multi-rate WLANs and propose an adaptive transmission control scheme, which adapts the transmission probability according to the number of active stations, transmission rates, and channel conditions. At first, an analytical model is built in terms of the proposed scheme to explore the throughput of the network. Then, by means of the characteristics of practical system, a heuristic algorithm is developed to approach the maximum throughput on-line. Extensive numerical calculations and simulations based on NS-2 are implemented to evaluate the performance of the proposed algorithm and the impact of inaccurate estimation of parameters. The results show that our algorithm outperforms the existing adaptive algorithms in imperfect channel, and insensitive to inaccurate estimation of parameters. Copyright © 2005 John Wiley & Sons, Ltd.
2014328
A 3D reconstruction algorithm based on 3D deformable atlas
Reconstructing 3D models from 2D images is an important problem in visualization, particularly in medical and biological visualization. We present a new algorithm for 3D model reconstruction from 2D-images. In our approach, a 3D atlas is deformed to fit the feature data set in the target images. Compared with existing 3D reconstruction techniques, our approach is more efficient and easier to control. The resultant model has good inherent connectivity and smoothness. The resolution of the final model is determined by the resolution of reference model rather than the dataset. The model generates highly detailed view with a limited number of images. This algorithm has been successfully applied to medical simulation.
3757616
Hamilton cycles in 1-tough triangle-free graphs
A graph G is called triangle-free if G has no induced K3 as a subgraph. We set σ3=min{∑i=13d(vi)|{v1,v2,v3} is an independent set of vertices in G}. In this paper, we show that if G is a 1-tough and triangle-free graph of order n with n⩽σ3, then G is hamiltonian.
15428033
On Optimal Physical Carrier Sensing: Theoretical Analysis and Protocol Design
Traditional Physical Carrier Sensing (PCS), which aims at eliminating hidden terminals in wireless networks, causes too many exposed terminals and deteriorates the throughput per user seriously. Some existing work has proven that an aggressive PCS can improve the throughput by balancing the tradeoff between hidden terminals and exposed terminals. However, little work has been conducted to optimize the PCS according to the network conditions. In this paper, we develop an analytical model to study the behaviors of a user in the aggressive PCS scenario, with which the optimal PCS threshold can be derived. Then, to avoid the complicated computation, we present a heuristic algorithm, in which the parameters required for PCS tuning are estimated by the carrier sensing mechanism employed in IEEE 802.11. Simulation results show that the proposed heuristic algorithm can make the PCS threshold approach to the theoretical optimal one. Moreover, the proposed heuristic algorithm can obtain significant throughput gain compared to the traditional PCS threshold setting solutions.
47219612
A Receiver-Centric Transport Protocol for Mobile Hosts with Heterogeneous Wireless Interfaces