Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Filters








1,307 Hits in 4.1 sec

Tolerating Adversarial Attacks and Byzantine Faults in Distributed Machine Learning [article]

Yusen Wu, Hao Chen, Xin Wang, Chao Liu, Phuong Nguyen, Yelena Yesha
2021 arXiv   pre-print
Adversarial attacks attempt to disrupt the training, retraining and utilizing of artificial intelligence and machine learning models in large-scale distributed machine learning systems.  ...  In this paper, we propose a novel distributed training algorithm, partial synchronous stochastic gradient descent (ParSGD), which defends adversarial attacks and/or tolerates Byzantine faults.  ...  In previous studies on Byzantine fault tolerate (BFT), several consensus protocols and systems have been proposed to tolerate arbitrary faults in distributed system (e.g., PBFT [8] , Raft [27] , BFT-Smart  ... 
arXiv:2109.02018v1 fatcat:54ndlvp455ainklmvemlgwunaq

Tolerating Adversarial Attacks and Byzantine Faults in Distributed Machine Learning [article]

Yusen Wu, Hao Chen, Xin Wang, Chao Liu, Phuong Nguyen, Yelena Yesha, Maryland Shared Open Access Repository
2021
Adversarial attacks attempt to disrupt the training, retraining and utilizing of artificial intelligence and machine learning models in large-scale distributed machine learning systems.  ...  In this paper, we propose a novel distributed training algorithm, partial synchronous stochastic gradient descent (ParSGD), which defends adversarial attacks and/or tolerates Byzantine faults.  ...  In previous studies on Byzantine fault tolerate (BFT), several consensus protocols and systems have been proposed to tolerate arbitrary faults in distributed system (e.g., PBFT [8] , Raft [27] , BFT-Smart  ... 
doi:10.13016/m2nnqk-wqj5 fatcat:er4p4kdpafdn5ekxovgdbjydmu

Byzantine Fault Tolerance in Distributed Machine Learning : a Survey [article]

Djamila Bouhata, Hamouma Moumen, Jocelyn Ahmed Mazari, Ahcène Bounceur
2022 arXiv   pre-print
Byzantine Fault Tolerance (BFT) is one of the most challenging problems in Distributed Machine Learning (DML), defined as the resilience of a fault-tolerant system in the presence of malicious components  ...  Byzantine failures are still difficult to deal with due to their unrestricted nature, which results in the possibility of generating arbitrary data.  ...  The authors would also like to thank Professor Kamal Eddine Melkemi from the Department of Computer Science at Batna 2 University for useful discussion on machine learning and deep learning.  ... 
arXiv:2205.02572v2 fatcat:b7dwh5ajnjazpkwfsvsfoioe5u

A Survey on Fault-tolerance in Distributed Optimization and Machine Learning [article]

Shuo Liu
2021 arXiv   pre-print
This survey investigates the current state of fault-tolerance research in distributed optimization, and aims to provide an overview of the existing studies on both fault-tolerant distributed optimization  ...  The robustness of distributed optimization is an emerging field of study, motivated by various applications of distributed optimization including distributed machine learning, distributed sensing, and  ...  We also discuss the special case of Byzantine fault-tolerant distributed machine learning.  ... 
arXiv:2106.08545v2 fatcat:g6fys4icrbbr5k3bd3ycylaptu

SignSGD: Fault-Tolerance to Blind and Byzantine Adversaries [article]

Jason Akoun, Sebastien Meyer
2022 arXiv   pre-print
As a matter of fact, the baseline distributed SGD algorithm does not converge in the presence of one Byzantine adversary.  ...  Our code is available on GitHub https://github.com/jasonakoun/signsgd-fault-tolerance and our experiments are reproducible by using the provided parameters.  ...  In the case of blind adversaries, Figure 4 shows that distributed SGD can resist to the attacks.  ... 
arXiv:2202.02085v2 fatcat:ddiyflbcwnfjzm4oljrlv5u77y

Implementing Trustworthy Services Using Replicated State Machines [chapter]

Fred B. Schneider, Lidong Zhou
2005 Lecture Notes in Computer Science  
The fault-tolerance of the ensemble thus exceeds the fault-tolerance of any individual state machine, and a distributed fault-tolerance is the result.  ...  In analogy with distributed fault-tolerance, then, we are seeking ways to implement distributed trust.  ...  The state-machine approach The details for using replicated state machines and implementing a Byzantine fault-tolerant service 1,2 are well known: 1.  ... 
doi:10.1007/978-3-642-11294-2_8 fatcat:pjsapx7n4fgv5ms7v2fhvg4yjq

Implementing Trustworthy Services Using Replicated State Machines

F.B. Schneider, Lidong Zhou
2005 IEEE Security and Privacy  
The fault-tolerance of the ensemble thus exceeds the fault-tolerance of any individual state machine, and a distributed fault-tolerance is the result.  ...  In analogy with distributed fault-tolerance, then, we are seeking ways to implement distributed trust.  ...  The state-machine approach The details for using replicated state machines and implementing a Byzantine fault-tolerant service 1,2 are well known: 1.  ... 
doi:10.1109/msp.2005.125 fatcat:e3mnqp4aqrbrxloyxfhi4nz4ci

Backdoor Attacks in Peer-to-Peer Federated Learning [article]

Gokberk Yar, Cristina Nita-Rotaru, Alina Oprea
2023 arXiv   pre-print
We study backdoor attacks in peer-to-peer federated learning systems on different graph topologies and datasets.  ...  We evaluate defenses proposed in the context of centralized federated learning and show they are ineffective in peer-to-peer settings.  ...  We observed a similar pattern for fault tolerance as for graph types, as graphs with more fault tolerant capacity are more prone to attack, and the gap between them reduces with longer training.  ... 
arXiv:2301.09732v2 fatcat:7lx42iockje6fiahj3eqng2fcq

Distributed Momentum for Byzantine-resilient Stochastic Gradient Descent

El Mahdi El Mhamdi, Rachid Guerraoui, Sébastien Rouault
2021 International Conference on Learning Representations  
worker nodes in a distributed setting.  ...  Byzantine-resilient Stochastic Gradient Descent (SGD) aims at shielding model training from Byzantine faults, be they ill-labeled training datapoints, exploited software/hardware vulnerabilities, or malicious  ...  Cong Xie, Sanmi Koyejo, and Indranil Gupta. Zeno: Distributed stochastic gradient descent with suspicion-based fault-tolerance.  ... 
dblp:conf/iclr/MhamdiGR21 fatcat:nfzfnqimjbffjbwx5mcogpsqmi

DeFL: Decentralized Weight Aggregation for Cross-silo Federated Learning [article]

Jialiang Han, Yudong Han, Gang Huang, Yun Ma
2022 arXiv   pre-print
Besides, we theoretically analyze the Byzantine fault tolerance, convergence, and complexity of DeFL. We conduct extensive experiments over two widely-adopted public datasets, i.e.  ...  Federated learning (FL) is an emerging promising paradigm of privacy-preserving machine learning (ML).  ...  Difference from Byzantine Fault Tolerant Federated Learning There are many efforts in defending Byzantine attacks in FL and they can be categorized into proactive and reactive defenses [36] .  ... 
arXiv:2208.00848v1 fatcat:s64duytwufbu5ffijh4zwo7fzy

Adversary-resilient Distributed and Decentralized Statistical Inference and Machine Learning [article]

Zhixiong Yang, Arpita Gang, Waheed U. Bajwa
2020 arXiv   pre-print
While the last few decades have witnessed a huge body of work devoted to inference and learning in distributed and decentralized setups, much of this work assumes a non-adversarial setting in which individual  ...  In this article, we provide an overview of some of the most recent developments in this area under the threat model of Byzantine attacks.  ...  ACKNOWLEDGEMENTS The authors gratefully acknowledge the support of the NSF (CCF-1453073, CCF-1907658), the ARO (W911NF-17-1-0546), and the DARPA Lagrange Program (ONR/SPAWAR contract N660011824020).  ... 
arXiv:1908.08649v2 fatcat:de356dvwinfv5g5njo64qmzpvi

Byzantine-resilient Decentralized Stochastic Gradient Descent [article]

Shangwei Guo, Tianwei Zhang, Han Yu, Xiaofei Xie, Lei Ma, Tao Xiang, Yang Liu
2021 arXiv   pre-print
First, from the adversarial perspective, we theoretically illustrate that Byzantine attacks are more dangerous and feasible in decentralized learning systems: even one malicious participant can arbitrarily  ...  However, how to achieve Byzantine Fault Tolerance in decentralized learning systems is rarely explored, although this problem has been extensively studied in centralized systems.  ...  Yang and Bajwa [13] proposed RD-SVM to support distributed Support Vector Machine (SVM) against Byzantine attacks.  ... 
arXiv:2002.08569v4 fatcat:jqsjyln3tnhjleiq4aic6f3yta

A Survey on Secure and Private Federated Learning Using Blockchain: Theory and Application in Resource-constrained Computing [article]

Ervin Moore, Ahmed Imteaj, Shabnam Rezapour, M. Hadi Amini
2023 arXiv   pre-print
Federated Learning (FL) has gained widespread popularity in recent years due to the fast booming of advanced machine learning and artificial intelligence along with emerging security and privacy threats  ...  To this end, we highlight some potential solutions towards the coupling of blockchain and federated learning that can offer high levels of reliability, data privacy, and distributed computing performance  ...  Blockchain consensus protocols include: Proof of Work (PoW), Proof of Stake (PoS), Raft, and practical Byzantine fault tolerance [50] . • Proof of Work (PoW) discourages harmful blocks from being added  ... 
arXiv:2303.13727v1 fatcat:nwrlxlmvfjcaldvfoamyxe4tfu

Justinian's GAAvernor: Robust Distributed Learning with Gradient Aggregation Agent

Xudong Pan, Mi Zhang, Duocai Wu, Qifan Xiao, Shouling Ji, Zhemin Yang
2020 USENIX Security Symposium  
This work was supported in part by the National Natural Science Foundation of China (61972099, U1636204, U1836213, U1836210, U1736208, 61772466, U1936215, and U1836202), the National Key Research  ...  We would also like to thank the anonymous reviewers for their constructive comments and input to improve our paper.  ...  efforts on building more robust and reliable machine learning systems.  ... 
dblp:conf/uss/PanZWXJY20 fatcat:at7djul3mvectpmpiwilghmq3u

SoK: Understanding BFT Consensus in the Age of Blockchains [article]

Gang Wang
2021 IACR Cryptology ePrint Archive  
Byzantine fault-tolerant (BFT) state machine replication (SMR) is regarded as an ideal candidate that can tolerate arbitrary faulty behaviors.  ...  Due to trust issues, it is hard to design a resilient system in practical situations because of the existence of various faults.  ...  Besides, RSCoin relies on a two-phase commit protocol executed within each shard which, unfortunately, is not Byzantine fault-tolerant and can result in double-spending attacks by a colluding adversary  ... 
dblp:journals/iacr/Wang21c fatcat:wggbkbi25fg43fieebp4qzlk3m
« Previous Showing results 1 — 15 out of 1,307 results