autonomic adaptive cloud
30469685
Energy Efficient Adaptive Resource Management for Real Time Vehicular Cloud Services
Providing real time cloud services to Vehicular Clients (VCs) must cope with delay and delay jitter issues. Fog computing is an emerging paradigm that aims at distributing small size self powered data centers (e.g. Fog nodes) between remote Clouds and VCs, in order to deliver data dissemination real time services to the connected VCs. Motivated by these considerations, in this paper, we propose and test an energy efficient adaptive resource scheduler for Networked Fog Centers (NetFCs) They operate at the edge of the vehicular network and are connected to the served VCs through Infrastructure to Vehicular (I2V) TCP/IP based single hop mobile links. The goal is to exploit the locally measured states of the TCP/IP connections, in order to maximize the overall communication plus computing energy efficiency, while meeting the application induced hard QoS requirements on the minimum transmission rates, maximum delays and delay jitters. The resulting energy efficient scheduler jointly performs: (i) admission control of the input traffic to be processed by the NetFCs; (ii) minimum energy dispatching of the admitted traffic; (iii) adaptive reconfiguration and consolidation of the Virtual Machines (VMs) hosted by the NetFCs; and, (iv) adaptive control of the traffic injected into the TCP/IP mobile connections. The salient features of the proposed scheduler are that: (i) it is adaptive and admits distributed and scalable implementation; and, (ii) it is capable to provide hard QoS guarantees, in terms of minimum/maximum instantaneous rates of the traffic delivered to the vehicular clients, instantaneous rate jitters and total processing delays. Actual performance of the proposed scheduler in the presence of: (i) client mobility; (ii) wireless fading; and, (iii) reconfiguration and consolidation costs of the underlying NetFCs, is numerically tested and compared against the corresponding ones of some state of the art schedulers, under both synthetically generated and measured real world workload traces.
IEEE Transactions on Cloud Computing
Mohammad Shojafar Nicola Cordeschi Enzo Baccarelli
1431100
Machine Learning for Cognitive Network Management
Over the last decade, a significant amount of effort has been invested on architecting agile and adaptive management solutions in support of autonomic, self managing networks. Autonomic networking calls for automated decisions for management actions. This can be realized through a set of pre defined network management policies engineered from human expert knowledge. However, engineering sufficiently accurate knowledge considering the high complexity of today's networking environment is a difficult task. This has been a particularly limiting factor in the practical deployment of autonomic systems. ML is a powerful technique for extracting knowledge from data. However, there has been little evidence of its application in realizing practical management solutions for autonomic networks. Recent advances in network softwarization and programmability through SDN and NFV, the proliferation of new sources of data, and the availability of lowcost and seemingly infinite storage and compute resource from the cloud are paving the way for the adoption of ML to realize cognitive network management in support of autonomic networking. This article is intended to stimulate thought and foster discussion on how to defeat the bottlenecks that are limiting the wide deployment of autonomic systems, and the role that ML can play in this regard.
IEEE Communications Magazine
Sara Ayoubi Noura Limam Mohammad Ali Salahuddin Nashid Shahriar Raouf Boutaba Felipe Estrada Solano Oscar Mauricio Caicedo Rendon
65453272
An Adaptive Dropout Deep Computation Model for Industrial IoT Big Data Learning With Crowdsourcing to Cloud Computing
Deep computation, as an advanced machine learning model, has achieved the state of the art performance for feature learning on big data in industrial Internet of Things (IoT) However, the current deep computation model usually suffers from overfitting due to the lack of public available labeled training samples, limiting its performance for big data feature learning. Motivated by the idea of active learning, an adaptive dropout deep computation model (ADDCM) with crowdsourcing to cloud is proposed for industrial IoT big data feature learning in this paper. First, a distribution function is designed to set the dropout rate for each hidden layer to prevent overfitting for the deep computation model. Furthermore, the outsourcing selection algorithm based on the maximum entropy is employed to choose appropriate samples from the training set to crowdsource on the cloud platform. Finally, an improved supervised learning from multiple experts scheme is presented to aggregate answers given by human workers and to update the parameters of the ADDCM simultaneously. Extensive experiments are conducted to evaluate the performance of the presented model by comparing with the dropout deep computation model and other state of the art crowdsourcing algorithms. The results demonstrate that the proposed model can prevent overfitting effectively and aggregate the labeled samples to train the parameters of the deep computation model with crowdsouring for industrial IoT big data feature learning.
IEEE Transactions on Industrial Informatics
Qingchen Zhang Laurence Tianruo Yang Zhikui Chen Peng Li Fanyu Bu
39245183
An autonomic resource provisioning approach for service based cloud applications: A hybrid approach
Abstract In cloud computing environment, resources can be dynamically provisioned on deman for cloud services The amount of the resources to be provisioned is determined during runtime according to the workload changes. Deciding the right amount of resources required to run the cloud services is not trivial, and it depends on the current workload of the cloud services. Therefore, it is necessary to predict the future demands to automatically provision resources in order to deal with fluctuating demands of the cloud services. In this paper, we propose a hybrid resource provisioning approach for cloud services that is based on a combination of the concept of the autonomic computing and the reinforcement learning (RL) Also, we present a framework for autonomic resource provisioning which is inspired by the cloud layer model. Finally, we evaluate the effectiveness of our approach under two real world workload traces. The experimental results show that the proposed approach reduces the total cost by up to 50% and increases the resource utilization by up to 12% compared with the other approaches.
Future Gener. Comput. Syst.
Mostafa Ghobaei-Arani Sam Jabbehdari Mohammad Ali Pourmina
214802232
SqueezeSegV3: Spatially Adaptive Convolution for Efficient Point Cloud Segmentation
LiDAR point cloud segmentation is an important problem for many applications. For large scale point cloud segmentation, the \textit{de facto} method is to project a 3D point cloud to get a 2D LiDAR image and use convolutions to process it. Despite the similarity between regular RGB and LiDAR images, we discover that the feature distribution of LiDAR images changes drastically at different image locations. Using standard convolutions to process such LiDAR images is problematic, as convolution filters pick up local features that are only active in specific regions in the image. As a result, the capacity of the network is under utilized and the segmentation performance decreases. To fix this, we propose Spatially Adaptive Convolution (SAC) to adopt different filters for different locations according to the input image. SAC can be computed efficiently since it can be implemented as a series of element wise multiplications, im2col, and standard convolution. It is a general framework such that several previous methods can be seen as special cases of SAC. Using SAC, we build SqueezeSegV3 for LiDAR point cloud segmentation and outperform all previous published methods by at least 3.7% mIoU on the SemanticKITTI benchmark with comparable inference speed.
ECCV
Chenfeng Xu Bichen Wu Zining Wang Wei Zhan Peter Vajda Kurt Keutzer Masayoshi Tomizuka
4640616
A Survey and Taxonomy of Self Aware and Self Adaptive Cloud Autoscaling Systems
Autoscaling system can reconfigure cloud based services and applications, through various configurations of cloud software and provisions of hardware resources, to adapt to the changing environment at runtime. Such a behavior offers the foundation for achieving elasticity in a modern cloud computing paradigm. Given the dynamic and uncertain nature of the shared cloud infrastructure, the cloud autoscaling system has been engineered as one of the most complex, sophisticated, and intelligent artifacts created by humans, aiming to achieve self aware, self adaptive, and dependable runtime scaling. Yet the existing Self aware and Self adaptive Cloud Autoscaling System (SSCAS) is not at a state where it can be reliably exploited in the cloud. In this article, we survey the state of the art research studies on SSCAS and provide a comprehensive taxonomy for this field. We present detailed analysis of the results and provide insights on open challenges, as well as the promising directions that are worth investigated in the future work of this area of research. Our survey and taxonomy contribute to the fundamentals of engineering more intelligent autoscaling systems in the cloud.
ACM Comput. Surv.
Tao Chen Rami Bahsoon Xin Yao
197507380
High accuracy multi camera reconstruction enhanced by adaptive point cloud correction algorithm
Abstract Multi camera schemes can effectively increase the perception range of vision systems compared to single camera schemes and are common in many optical applications. Unavoidable errors emerge in the global multi camera calibration process, however, such as manufacturing error of the optical devices and computational error from marker detection algorithms, which drive down the accuracy of the camera system correlation. This paper discusses the causes of global calibration errors in detail. A four camera vision system was built to obtain the visual information of targets including static objects and a dynamic concrete filled steel tubular (CFST) specimen. Local calibration and global calibration were applied successively to realize multi camera correlation, followed by filtering and stitching operations to acquire filtered global point clouds. A point cloud correction algorithm is designed accordingly to optimize the stitched point cloud structures and further improve the accuracy of the reconstructed surfaces. Based on the density features of the targets themselves (rather than standard calibration markers) the proposed point cloud correction algorithm is effective for various targets and adaptive under dynamic conditions. The point clouds and corresponding reconstructed models are shown to be more accurate after the proposed enhancement process. The point cloud correction algorithm also has strong adaptability to different static targets with complex surfaces and performs well under uncertain geometric changes and vibration. The results presented here provide both theoretical and practical support for advancements in multi vision applications such as optical measurement, real time target tracking, quality monitoring, and surface data acquisition.
Optics and Lasers in Engineering
Mingyou Chen Yunchao Tang Xiangjun Zou Kuangyu Huang L Li Yuxin He
2308131
STAR: SLA aware Autonomic Management of Cloud Resources
Cloud computing has recently emerged as an important service to manage applications efficiently over the Internet. Various cloud providers offer pay per use cloud services that requires Quality of Service (QoS) management to efficiently monitor and measure the delivered services through Internet of Things (IoT) and thus needs to follow Service Level Agreements (SLAs) However, providing dedicated cloud services that ensure user's dynamic QoS requirements by avoiding SLA violations is a big challenge in cloud computing. As dynamism, heterogeneity and complexity of cloud environment is increasing rapidly, it makes cloud systems insecure and unmanageable. To overcome these problems, cloud systems require self management of services. Therefore, there is a need to develop a resource management technique that automatically manages QoS requirements of cloud users thus helping the cloud providers in achieving the SLAs and avoiding SLA violations. In this paper, we present SLA aware autonomic resource management technique called STAR which mainly focuses on reducing SLA violation rate for the efficient delivery of cloud services. The performance of the proposed technique has been evaluated through cloud environment. The experimental results demonstrate that STAR is efficient in reducing SLA violation rate and in optimizing other QoS parameters which effect efficient cloud service delivery.
IEEE Transactions on Cloud Computing
Sukhpal Singh Inderveer Chana Rajkumar Buyya
749872
An autonomic prediction suite for cloud resource provisioning
One of the challenges of cloud computing is effective resource management due to its auto scaling feature. Prediction techniques have been proposed for cloud computing to improve cloud resource management. This paper proposes an autonomic prediction suite to improve the prediction accuracy of the auto scaling system in the cloud computing environment. Towards this end, this paper proposes that the prediction accuracy of the predictive auto scaling systems will increase if an appropriate time series prediction algorithm based on the incoming workload pattern is selected. To test the proposition, a comprehensive theoretical investigation is provided on different risk minimization principles and their effects on the accuracy of the time series prediction techniques in the cloud environment. In addition, experiments are conducted to empirically validate the theoretical assessment of the hypothesis. Based on the theoretical and the experimental results, this paper designs a self adaptive prediction suite. The proposed suite can automatically choose the most suitable prediction algorithm based on the incoming workload pattern.
Journal of Cloud Computing
Ali Yadavar Nikravesh Samuel Ajila Chung-Horng Lung
64036809
Adaptive Computing Plus Communication Optimization Framework for Multimedia Processing in Cloud Systems
A clear trend in the evolution of network based services is the ever increasing amount of multimedia data involved. This trend towards big data multimedia processing finds its natural placement together with the adoption of the cloud computing paradigm, that seems the best solution to cope with the demands of a highly fluctuating workload that characterizes this type of services. However, as cloud data centers become more and more powerful, energy consumption becomes a major challenge both for environmental concerns and for economic reasons. An effective approach to improve energy efficiency in cloud data centers is to rely on traffic engineering techniques to dynamically adapt the number of active servers to the current workload. Towards this aim, we propose a joint computing plus communication optimization framework exploiting virtualization technologies, called MMGreen. Our proposal specifically addresses the typical scenario of multimedia data processing with computationally intensive tasks and exchange of a big volume of data. The proposed framework not only ensures users the Quality of Service (through Service Level Agreements) but also achieves maximum energy saving and attains green cloud computing goals in a fully distributed fashion by utilizing the DVFS based CPU frequencies. To evaluate the actual effectiveness of the proposed framework, we conduct experiments with MMGreen under real world and synthetic workload traces. The results of the experiments show that MMGreen may significantly reduce the energy cost for computing, communication and reconfiguration with respect to the previous resource provisioning strategies, respecting the SLA constraints.
IEEE Transactions on Cloud Computing
Mohammad Shojafar Claudia Canali Riccardo Lancellotti Jemal H Abawajy