Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely: Asynchronous algorithms have been demonstrated to improve scalability of a variety of applications in parallel environments. Their distributed adaptations have received relatively less attention, particularly in the context of conventional execution environments and associated overheads. One such framework, MapReduce, has emerged as a commonly used programming framework for large-scale distributed environments. While the MapReduce programming model has proved to be effective for data-parallel applications, significant questions relating to its performance and application scope remain unresolved. The strict synchronization beten map and reduce phases limits expression of asynchrony and hence, does not readily support asynchronous algorithms.  investigates the notion of partial synchronizations in iterative MapReduce applications to overcome global synchronization overheads. The proposed approach applies a locality-enhancing partition on the computation. Map tasks execute local computations with (relatively) frequent local synchronizations, with less frequent global synchronizations. This approach yields significant performance gains in distributed environments, even though their serial operation counts are higher.  demonstrate these performance gains on asynchronous algorithms for diverse applications, including pagerank, shortestpath, and kmeans.  make the following specific contributions in the paper(i)  motivate the need to extend MapReduce with constructs for asynchrony, (ii)  propose an API to facilitate partial synchronizations combined with eager scheduling and locality enhancing techniques, and (iii) demonstrate performance improvements from our proposed extensions through a variety of applications from different domains.
['Karthik Kambatla', 'Naresh Rapolu', 'Suresh Jagannathan', 'Ananth Grama']
I am writing a research paper on a idea Asynchronous Algorithms in MapReduce
[{"from": "human", "value": "I am writing a research paper on a idea Asynchronous Algorithms in MapReduce"}, {"from": "gpt", "value": "Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely: Asynchronous algorithms have been demonstrated to improve scalability of a variety of applications in parallel environments. Their distributed adaptations have received relatively less attention, particularly in the context of conventional execution environments and associated overheads. One such framework, MapReduce, has emerged as a commonly used programming framework for large-scale distributed environments. While the MapReduce programming model has proved to be effective for data-parallel applications, significant questions relating to its performance and application scope remain unresolved. The strict synchronization beten map and reduce phases limits expression of asynchrony and hence, does not readily support asynchronous algorithms.  investigates the notion of partial synchronizations in iterative MapReduce applications to overcome global synchronization overheads. The proposed approach applies a locality-enhancing partition on the computation. Map tasks execute local computations with (relatively) frequent local synchronizations, with less frequent global synchronizations. This approach yields significant performance gains in distributed environments, even though their serial operation counts are higher.  demonstrate these performance gains on asynchronous algorithms for diverse applications, including pagerank, shortestpath, and kmeans.  make the following specific contributions in the paper(i)  motivate the need to extend MapReduce with constructs for asynchrony, (ii)  propose an API to facilitate partial synchronizations combined with eager scheduling and locality enhancing techniques, and (iii) demonstrate performance improvements from our proposed extensions through a variety of applications from different domains."}]