A distributed computing framework based on lightweight variance reduction method to accelerate machine learning training on blockchain

2020 ◽  
Vol 17 (9) ◽  
pp. 77-89
Author(s):  
Zhen Huang ◽  
Feng Liu ◽  
Mingxing Tang ◽  
Jinyan Qiu ◽  
Yuxing Peng
Keyword(s):  
Machine Learning ◽  
Distributed Computing ◽  
Variance Reduction ◽  
Reduction Method ◽  
Computing Framework

scholarly journals VR-SGD: A Simple Stochastic Variance Reduction Method for Machine Learning

2020 ◽  
Vol 32 (1) ◽  
pp. 188-202 ◽  
Author(s):  
Fanhua Shang ◽  
Kaiwen Zhou ◽  
Hongying Liu ◽  
James Cheng ◽  
Ivor W. Tsang ◽  
...  
Keyword(s):  
Machine Learning ◽  
Variance Reduction ◽  
Reduction Method

PODC 2020 Review

2021 ◽  
Vol 51 (4) ◽  
pp. 75-81
Author(s):  
Ahad Mirza Baig ◽  
Alkida Balliu ◽  
Peter Davies ◽  
Michal Dory
Keyword(s):  
Machine Learning ◽  
Distributed Computing ◽  
Keynote Speaker ◽  
Lively Discussion ◽  
Theoretical Understanding ◽  
New Directions ◽  
New Ideas ◽  
New Challenges ◽  
The Impact ◽  
Distributed Machine Learning

Rachid Guerraoui was the rst keynote speaker, and he got things o to a great start by discussing the broad relevance of the research done in our community relative to both industry and academia. He rst argued that, in some sense, the fact that distributed computing is so pervasive nowadays could end up sti ing progress in our community by inducing people to work on marginal problems, and becoming isolated. His rst suggestion was to try to understand and incorporate new ideas coming from applied elds into our research, and argued that this has been historically very successful. He illustrated this point via the distributed payment problem, which appears in the context of blockchains, in particular Bitcoin, but then turned out to be very theoretically interesting; furthermore, the theoretical understanding of the problem inspired new practical protocols. He then went further to discuss new directions in distributed computing, such as the COVID tracing problem, and new challenges in Byzantine-resilient distributed machine learning. Another source of innovation Rachid suggested was hardware innovations, which he illustrated with work studying the impact of RDMA-based primitives on fundamental problems in distributed computing. The talk concluded with a very lively discussion.

Research and Design of the Distributed Mass Small File Storage System Based on WCF

2013 ◽  
Vol 765-767 ◽  
pp. 1087-1091
Author(s):  
Hong Lin ◽  
Shou Gang Chen ◽  
Bao Hui Wang
Keyword(s):  
Fault Tolerance ◽  
Distributed Computing ◽  
Data Storage ◽  
Large Scale ◽  
Storage System ◽  
Hardware Platform ◽  
File Storage ◽  
Computing Framework ◽  
Research And Design ◽  
Small File

Recently, with the development of Internet and the coming of new application modes, data storage has some new characters and new requirements. In this paper, a Distributed Computing Framework Mass Small File storage System (For short:Dnet FS) based on Windows Communication Foundation in .Net platform is presented, which is lightweight, good-expansibility, running in cheap hardware platform, supporting Large-scale concurrent access, and having certain fault-tolerance. The framework of this system is analyzed and the performance of this system is tested and compared. All of these prove this system meet requirements.

Sign in / Sign up

Export Citation Format

Share Document