Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Filters








4,156 Hits in 7.1 sec

A New Data Placement Approach for Scientific Workflows in Cloud Computing Environments [chapter]

Hamdi Kchaou, Zied Kechaou, Adel M. Alimi
2017 Advances in Intelligent Systems and Computing  
The reach of Cloud Computing technologies approved distributing with massive data applications such as Scientific Workflows, which processing huge scientific data in dispersed computing infrastructures  ...  of resources in cloud environments.  ...  The authors would like to acknowledge the financial support of this work by grants from General Direction of Scientific Research (DGRST), Tunisia, under the ARUB program.  ... 
doi:10.1007/978-3-319-53480-0_33 fatcat:hrdbvv533jfifirjf5vlhbpa6i

BDAP: A Big Data Placement Strategy for Cloud-Based Scientific Workflows

Mahdi Ebrahimi, Aravind Mohan, Andrey Kashlev, Shiyong Lu
2015 2015 IEEE First International Conference on Big Data Computing Service and Applications  
In this new era of Big Data, there is a growing need to enable scientific workflows to perform computations at a scale far exceeding a single workstation's capabilities.  ...  In this work, we 1) formalize the data placement problem in scientific workflows, 2) propose a data placement algorithm that considers both initial input dataset and intermediate datasets obtained during  ...  The data placement solution for scientific workflow, W, to execute in a Cloud computing environment, C, is to select a data placement scheme Ψ P to minimize the workflow communication cost (WCC) under  ... 
doi:10.1109/bigdataservice.2015.70 dblp:conf/bigdataservice/EbrahimiMKL15 fatcat:fyyjfp3tdvgdlamr6klqtbtdna

Scientific Workflows in Heterogeneous Edge-Cloud Computing: A Data Placement Strategy Based on Reinforcement learning [article]

Xin Du
2022 arXiv   pre-print
The heterogeneous edge-cloud computing paradigm can provide an optimal solution to deploy scientific workflows compared to cloud computing or other traditional distributed computing environments.  ...  Some state-of-the-art data placement strategies combine edge computing and cloud computing to distribute scientific datasets.  ...  [21] proposed a data placement strategy based on k-means clustering for a scientific workflow in cloud environments. This approach focused on the data size and dependency.  ... 
arXiv:2205.07131v1 fatcat:lvtotbdfpfcmxbeygxwqplag2y

A Time-driven Data Placement Strategy for a Scientific Workflow Combining Edge Computing and Cloud Computing [article]

Bing Lin, Fangning Zhu, Jianshan Zhang, Jiaqing Chen, Xing Chen, Neal N. Xiong, Jaime Lloret Mauri
2019 arXiv   pre-print
Each task of a scientific workflow requires several large datasets that are located in different datacenters from the cloud computing environment, resulting in serious data transmission delays.  ...  Compared to traditional distributed computing environments such as grids, cloud computing provides a more cost-effective way to deploy scientific workflows.  ...  A. Problem Definition The problem definition includes a new hybrid environment combining edge computing and cloud computing, a scientific workflow, and a data placement strategy.  ... 
arXiv:1901.07216v2 fatcat:7ewchqr3vjgqhfgpuidfekzwgy

Data Placement in Era of Cloud Computing: a Survey, Taxonomy and Open Research Issues

Avinash Kaur, Pooja Gupta, Manpreet Singh, Anand Nayyar
2019 Scalable Computing : Practice and Experience  
This paper provides a complete survey and analyses of existing data placement schemes proposed in literature for cloud computing.  ...  In cloud computing, data placement is a critical operation performed as part of workflow management and aims to find the best physical machine to place the data.  ...  that make cloud computing possible.Recenetly data placement problem has become a hot topic in the area of cloud computing while considering the scientific workflow applications because it can greatly  ... 
doi:10.12694/scpe.v20i2.1530 fatcat:oqvuu2yqvnauhgpwtadmhn25ee

A Novel Workflow-Level Data Placement Strategy for Data-Sharing Scientific Cloud Workflows

Xuejun Li, Lei Zhang, Yang Wu, Xiao Liu, Erzhou Zhu, Huikang Yi, Futian Wang, Cheng Zhang, Yun Yang
2016 IEEE Transactions on Services Computing  
Cloud computing can provide a more cost-effective way to deploy scientific workflows than traditional distributed computing environments such as cluster and grid.  ...  Due to the large size of scientific datasets, data placement plays an important role in scientific cloud workflow systems for improving system performance and reducing data transfer cost.  ...  Then, all data placement maps of these workflows are assembled. And the new map is the final data placement map for all data-sharing scientific cloud workflows.  ... 
doi:10.1109/tsc.2016.2625247 fatcat:fpnjoe2m55fx7jf3f3fkvixfwa

A Survey on Data Placement Strategies for Cloud based Scientific Workflows

Lalitha Singh, Jyoti Malhotra
2016 International Journal of Computer Applications  
Several data placement strategies in cloud based scientific workflows are reviewed. A data placement scheme which uses big data to improve the performance and also the data movement cost is studied.  ...  The ideal data placement scheme optimizes the execution of the data intensive scientific workflows in cloud by assigning the tasks to the execution site in such a way that the file transfers and the cost  ...  The above discussed were some of the strategies for data placement in the cloud environment.  ... 
doi:10.5120/ijca2016909651 fatcat:a65624d6tbfcjmi2abjabydyti

Cloud Data Management for Scientific Workflows: Research Issues, Methodologies, and State-of-the-Art

Dong Yuan, Lizhen Cui, Xiao Liu
2014 2014 10th International Conference on Semantics, Knowledge and Grids  
The emergence of cloud computing technologies offers a new way to develop scientific workflow systems.  ...  As all the data are managed in the cloud, it is easy to share data among scientists. This kind of model is very convenient for users, but remains a big challenge to the system.  ...  Acknowledgement The research work reported in this paper is partly supported by National Natural  ... 
doi:10.1109/skg.2014.37 dblp:conf/skg/YuanCL14 fatcat:suphvnfsujgc3ps2tbvsj6zaya

A data placement strategy in scientific cloud workflows

Dong Yuan, Yun Yang, Xiao Liu, Jinjun Chen
2010 Future generations computer systems  
In this paper, we propose a matrix based k-means clustering strategy for data placement in scientific cloud workflows.  ...  In scientific cloud workflows, large amounts of application data need to be stored in distributed data centres.  ...  Acknowledgements The research work reported in this paper is partly supported by Australian Research Council under Linkage Project LP0990393.  ... 
doi:10.1016/j.future.2010.02.004 fatcat:e425odz3nzfktcszaxuk4hfege

Task Offloading for Scientific Workflow Application in Mobile Cloud

Feifei Zhang, Jidong Ge, Zhongjin Li, Chuanyi Li, Zifeng Huang, Li Kong, Bin Luo
2017 Proceedings of the 2nd International Conference on Internet of Things, Big Data and Security  
Mobile cloud computing (MCC) provides significant opportunities in enhancing computation capability and saving energy of smart mobile devices (SMDs) by offloading computation-intensive and data-intensive  ...  In this paper, we offer three entry points for the problem solving: first, a cost model based on the pay-as-you-go manner of IaaS Cloud is proposed; then, we investigate the problem of mapping strategy  ...  suitable candidate to manage scientific workflow execution in mobile cloud computing environment.  ... 
doi:10.5220/0006364501360148 dblp:conf/iotbd/ZhangGLLHKL17 fatcat:w253pze5frgbbkaxskggbnedbu

DR-SWDF: A Dynamically Reconfigurable Framework for Scientific Workflows Deployment in the Cloud

Khadija Bousselmi, Zaki Brahmi, Mohamed Mohsen Gammoudi
2017 Scalable Computing : Practice and Experience  
Workflows management systems (WfMS) are aimed for designing, scheduling, executing, reusing, and sharing workflows in distributed environments like the Cloud computing.  ...  In this paper, we propose a dynamically re-configurable framework for the deployment of scientific workflows in the Cloud (called DR-SWDF) that allows customizing the workflow deployment process according  ...  In [9] , the authors propose a new algorithm WPRC (Workflow Partition Resource Clusters) for scheduling Scientific Workflows in the Cloud environment.  ... 
doi:10.12694/scpe.v18i2.1289 fatcat:mcku67bp2rdq5lw2ycftyjxuh4

Special section: Federated resource management in grid and cloud computing systems

Rajkumar Buyya, Rajiv Ranjan
2010 Future generations computer systems  
In the paper ''A Data Placement Strategy in Scientific Cloud Workflows'', Dong Yuan, Yun Yang, Xiao Liu, and Jinjun Chen propose a matrix based kmeans clustering strategy for data placement in scientific  ...  In scientific Cloud workflows, large amounts of application data need to be stored in distributed data centers.  ...  Software technologies for Grid and Cloud computing developed under Dr.  ... 
doi:10.1016/j.future.2010.06.003 fatcat:yqtgba7etjb6nopcpuxoq6defi

Guest Editor's Introduction: Special Issue on Cloud Computing Orchestration

Miguel Caballer, Germán Moltó, Ignacio Blanquer
2018 Journal of Grid Computing  
In "The Flowbster cloud-oriented workflow system to process large scientific data sets", Peter Kacsuk and co-authors detail a new workflow system, called Flowbster, aimed to create data pipelines which  ...  efficiently process very large data sets on cloud computing environments.  ... 
doi:10.1007/s10723-018-9427-5 fatcat:y3r7dqrxe5cp5ep2xi7ywntd6u

A Systematic Mapping Study of Italian Research on Workflows

Marco Aldinucci, Elena Maria Baralis, Valeria Cardellini, Iacopo Colonnelli, Marco Danelutto, Sergio Decherchi, Giuseppe Di Modica, Luca Ferrucci, Marco Gribaudo, Francesco Iannone, Marco Lapegna, Doriana Medic (+7 others)
2023 Proceedings of the SC '23 Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis  
ACKNOWLEDGMENTS This work has been supported by ICSC -Centro Nazionale di Ricerca in High-Performance Computing, Big Data and Quantum Computing, funded by European Union -NextGenerationEU.  ...  in a Computing Continuum environment.  ...  PESOS [16] is an energy-efficient resource management algorithm for the placement of VMs in a Cloud environment, aiming to minimize the energy footprint of the overall platform while considering the  ... 
doi:10.1145/3624062.3624285 fatcat:6m3z42hglbhahkcy6huucndal4

Kepler + CometCloud: Dynamic Scientific Workflow Execution on Federated Cloud Resources

Jianwu Wang, Moustafa AbdelBaky, Javier Diaz-Montes, Shweta Purawat, Manish Parashar, Ilkay Altintas
2016 Procedia Computer Science  
Nowadays, cloud computing is gaining traction as an on-demand and elastic computing resource for executing scientific workflows [9] .  ...  In this context, cloud federations are being explored as means for extending as-a-service models to offer on-demand access to computing utilities, an abstraction of unlimited resources, customizable environments  ...  Acknowledgments:The research presented in this work is supported in part by National Science Foundation (NSF) via grants numbers ACI 1339036, ACI 1310283, ACI 1441376.  ... 
doi:10.1016/j.procs.2016.05.363 fatcat:ntdd7b2g4jcutihx6nvzjebdaq
« Previous Showing results 1 — 15 out of 4,156 results