7356729
Application-Tailored Cache Consistency for Wide-Area File Systems
The inability to perform optimizations based on application-specific information presents a hurdle to the deployment of pervasive LAN file systems across WAN environments. This paper proposes a novel approach addressing this problem through application-tailored caching and consistency in widearea file systems. It leverages widely available Network File System (NFS) deployments without any modifications to kernels nor applications, and employs middleware to dynamically establish Grid-wide Virtual File System (GVFS) sessions with application-tailored cache consistency. Two consistency models are discussed in this paper: a relaxed model based on invalidation polling, and a stronger model based on delegation and callback. Experimental evaluation based on microbenchmarks and scientific applications show that with application-tailored cache consistency, GVFS is able to both improve application runtimes and reduce server load significantly, compared to kernel-level NFS in WAN.
6728240
Autonomic resource management in virtualized data centers using fuzzy logic-based approaches
Data centers, as resource providers, are expected to deliver on performance guarantees while optimizing resource utilization to reduce cost. Virtualization techniques provide the opportunity of consolidating multiple separately managed containers of virtual resources on underutilized physical servers. A key challenge that comes with virtualization is the simultaneous on-demand provisioning of shared physical resources to virtual containers and the management of their capacities to meet service-quality targets at the least cost. This paper proposes a two-level resource management system to dynamically allocate resources to individual virtual containers. It uses local controllers at the virtual-container level and a global controller at the resource-pool level. An important advantage of this two-level control architecture is that it allows independent controller designs for separately optimizing the performance of applications and the use of resources. Autonomic resource allocation is realized through the interaction of the local and global controllers. A novelty of the local controller designs is their use of fuzzy logic-based approaches to efficiently and robustly deal with the complexity and uncertainties of dynamically changing workloads and resource usage. The global controller determines the resource allocation based on a proposed profit model, with the goal of maximizing the total profit of the data center. Experimental results obtained through a prototype implementation demonstrate that, for the scenarios under consideration, the proposed resource management system can significantly reduce resource consumption while still achieving application performance targets.
18032989
On the Use of Virtualization and Service Technologies to Enable Grid-Computing
The In-VIGO approach to Grid-computing relies on the dynamic establishment of virtual grids on which application services are instantiated. In-VIGO was conceived to enable computational science to take place In Virtual Information Grid Organizations. Having its first version deployed on July of 2003, In-VIGO middleware is currently used by scientists from various disciplines, a noteworthy example being the computational nanoelectronics research community (http://www.nanohub.org). All components of an In-VIGO-generated virtual grid – machines, networks, applications and data – are themselves virtual and services are provided for their dynamic creation. This article reviews the In-VIGO approach to Grid-computing and overviews the associated middleware techniques and architectures for virtualizing Grid components, using services for creation of virtual grids and automatically Grid-enabling unmodified applications. The In-VIGO approach to the implementation of virtual networks and virtual application services are discussed as examples of Grid-motivated approaches to resource virtualization and Web-service creation.
9333650
Cooperative Autonomic Management in Dynamic Distributed Systems
The centralized management of large distributed systems is often impractical, particularly when the both the topology and status of the system change dynamically. This paper proposes an approach to application-centric self-management in large distributed systems consisting of a collection of autonomic components that join and leave the system dynamically. Cooperative autonomic components self-organize into a dynamically created overlay network. Through local information sharing with neighbors, each component gains access to global information as needed for optimizing performance of applications. The approach has been validated and evaluated by developing a decentralized autonomic system consisting of multiple autonomic application managers previously developed for the In-VIGO grid-computing system. Using analytical results from complex random network and measurements done in a prototype system, we demonstrate the robustness, self-organization and adaptability of our approach, both theoretically and experimentally.
15313560
A user-level secure grid file system
A grid-wide distributed file system provides convenient data access interfaces that facilitate fine-grained cross-domain data sharing and collaboration. However, existing widely-adopted distributed file systems do not meet the security requirements for grid systems. This paper presents a Secure Grid File System (SGFS) which supports GSI-based authentication and access control, end-to-end message privacy, and integrity. It employs user-level virtualization of NFS to provide transparent grid data access leveraging existing, unmodified clients and servers. It supports user and application-tailored security customization per SGFS session, and leverages secure management services to control and configure the sessions. The system conforms to the GSI grid security infrastructure and allows for seamless integration with other grid middleware. A SGFS prototype is evaluated with both file system benchmarks and typical applications, which demonstrates that it can achieve strong security with an acceptable overhead, and substantially outperform native NFS in wide-area environments by using disk caching.
12453165
Supporting application-tailored grid file system sessions with WSRF-based services
This paper presents novel service-based grid data management middleware that leverages standards defined by WSRF specifications to create and manage dynamic grid file system sessions. A unique aspect of the service is that the sessions it creates can be customized to address application data transfer needs. Application-tailored configurations enable selection of both performance-related features (block-based partial file transfers and/or whole-file transfers, cache parameters and consistency models) and reliability features (file system copy-on-write checkpointing to aid recovery of client-side failures; replication, autonomous failure detection and data access redirection for server-side failures). These enhancements, in addition to cross-domain user identity mapping and encrypted communication, are implemented via user level proxies managed by the service, requiring no changes to existing kernels. Sessions established using the service is mounted as distributed file systems and can be used transparently by unmodified binary applications. The paper analyzes the use of the service to support virtual machine based grid systems and workflow execution, and also reports on the performance and reliability of service managed wide-area file system sessions with experiments based on scientific applications (NanoMOS/Matlab, CHID, GAUSS and SPECseis).
34003913
Efficient Transmission Schemes for Multiuser MIMO-OFDM Downlink Systems in Time-Varying Channels
The performance of multiuser MIMO-OFDM downlink systems with block diagonalization (BD) depends on the accuracy of the channel state information (CSI) available at the transmitter (CSIT) to a great extent. In time-varying channels, the CSIT is always outdated due to an inherent time delay between the uplink channel estimation and the downlink data transmission in TDD systems. This will lead to drastic degradation in system capacity. In this paper, based on the analysis of the effect of the outdated CSIT on multiuser MIMO- OFDM downlink systems with BD method, two linear processing methods, BD with user selection at the transmitter and total MMSE decoder at the receiver (TBDUS-RTMMSE) and BD at the transmitter and partial MMSE decoder at the receiver (TBD-RPMMSE), are proposed to mitigate the effect. To fulfill them, a new pilot-sending architecture is introduced. Analysis and simulation results show that the two proposed methods can effectively reduce the impairment of the outdated CSIT and improve the system sum capacity in suitable time delay regions of the CSIT.
10078589
SNCC: A Selective Network-Coded Cooperation Scheme in Wireless Networks
Network-coded cooperation is a new communication paradigm that exploits spatial diversity by pooling distributed "communication" (relay) and also the distributed "computation" resources (coding) of different nodes in a network so as to increase wireless networks system performance. In this paper, we develop a selective network-coded cooperation (SNCC) scheme suitable for multiple unicast transmission pairs in a single-cell wireless network. The relay node performs network coding on received information from multiple sources before forwarding the network-coded data towards the corresponding destinations, which can decode their desired data from the network-coded data and the data they overhear from the other sources. The performance analysis and evaluation in terms of the single-pair outage probability and diversity-multiplexing tradeoff show that under SNCC any transmission pair achieves a full diversity order of M+1 (M is the number of available relays) while holding a better diversity-multiplexing tradeoff performance than existing cooperative cooperation schemes. Moreover, due to the mechanism that the relay adapts the data on which to perform network coding according to the observed source-to-relay channel quality, SNCC smartly avoids error propagation due to incorporating erroneous data into network-coded data, which is verified by numerical results of the single-pair outage probability.
34992988
An optimal OSA approach based on channel-usage estimate under collision probability constraint in cognitive radio systems
Opportunistic spectrum access system allows the secondary user to access spectrum holes not being utilized by the primary user. Traditional opportunistic spectrum access approaches only sense and utilize current spectrum holes. This can result in uncontrollable collision probability, which exceed the maximum collision probability allowed by the primary user network. In this paper, we consider a cognitive radio system with one primary channel and one secondary user, and then, we introduce a channel-usage pattern model and a fundamental access scheme in this system. Based on the fundamental access scheme, we adopt fixed detection duration and transmission duration ratio approach to analyze what and how to determine spectrum holes utilization and collision probability in this model. On the basis of this model and fundamental access scheme, we study optimal opportunistic spectrum access problem and formulate it as an optimization problem that the secondary user maximizes spectrum holes utilization under the constraint of collision tolerable level, and then we solve this optimization problem in two cases: one is that the idle period is exponential distribution, the other is that the idle period is Pareto distribution. According to the solution of the optimization problem, we respectively propose an optimal opportunistic spectrum access algorithm in each case. Theoretical analysis and simulation results both show that the optimal opportunistic spectrum access algorithms can maximize spectrum holes utilization under the constraint that the collision probability is bounded below collision tolerable level.
1953336
Tour the world: Building a web-scale landmark recognition engine
Modeling and recognizing landmarks at world-scale is a useful yet challenging task. There exists no readily available list of worldwide landmarks. Obtaining reliable visual models for each landmark can also pose problems, and efficiency is another challenge for such a large scale system. This paper leverages the vast amount of multimedia data on the Web, the availability of an Internet image search engine, and advances in object recognition and clustering techniques, to address these issues. First, a comprehensive list of landmarks is mined from two sources: (1) ~20 million GPS-tagged photos and (2) online tour guide Web pages. Candidate images for each landmark are then obtained from photo sharing Websites or by querying an image search engine. Second, landmark visual models are built by pruning candidate images using efficient image matching and unsupervised clustering techniques. Finally, the landmarks and their visual models are validated by checking authorship of their member images. The resulting landmark recognition engine incorporates 5312 landmarks from 1259 cities in 144 countries. The experiments demonstrate that the engine can deliver satisfactory recognition performance with high efficiency.
22137241
Efficient Transmission Strategies Against Channel Time Variations in Multiuser MIMO Downlink Systems
Based on the analysis of the effect of the outdated channel state information (CSI) available at the transmitter (CSIT) on multiuser MIMO (MU-MIMO) downlink systems with block zero-forcing precoding (BZFP) method, two linear processing methods, BZFP at the transmitter with total MMSE decoding at the receiver (TBZF-RTMMSE) and BZFP at the transmitter with partial MMSE decoding at the receiver (TBZF- RPMMSE) are proposed. To fulfill them, a new pilot-sending and channel estimation architecture is introduced. Analysis and simulation results show that the two proposed methods can effectively reduce the impairment of the outdated CSIT and improve the system sum capacitv in the suitable time delav region of the CSIT.