Dealing with the data deluge: file systems and storage technologies

2012 ◽  
Author(s):  
David H. Denson
Keyword(s):  
File Systems ◽  
Storage Technologies ◽  
And Storage

Porphyrin-based frameworks for oxygen electrocatalysis and catalytic reduction of carbon dioxide

2021 ◽  
Author(s):  
Zuozhong Liang ◽  
Hong-Yan Wang ◽  
Haoquan Zheng ◽  
Wei Zhang ◽  
Rui Cao
Keyword(s):  
Carbon Dioxide ◽  
Recent Progress ◽  
Catalytic Reduction ◽  
Storage Technologies ◽  
Conversion Technologies ◽  
And Storage

The recent progress made on porphyrin-based frameworks and their applications in energy-related conversion technologies (e.g., ORR, OER and CO2RR) and storage technologies (e.g., Zn–air batteries).

Keysystems in large systems implementing distributed data processing and storage technologies

2021 ◽  
Author(s):  
V.G. Belenkov ◽  
V.I. Korolev ◽  
V.I. Budzko ◽  
D.A. Melnikov
Keyword(s):  
Data Processing ◽  
Distributed Processing ◽  
Specific Work ◽  
Distributed Data ◽  
Distributed Data Processing ◽  
Technical Specifications ◽  
The Creation ◽  
Processing And Storage ◽  
Storage Technologies ◽  
And Storage

The article discusses the features of the use of the cryptographic information protection means (CIPM)in the environment of distributed processing and storage of data of large information and telecommunication systems (LITS).A brief characteristic is given of the properties of the cryptographic protection control subsystem - the key system (CS). A description is given of symmetric and asymmetric cryptographic systems, required to describe the problem of using KS in LITS.Functional and structural models of the use of KS and CIPM in LITS, are described. Generalized information about the features of using KS in LITS is given. The obtained results form the basis for further work on the development of the architecture and principles of KS construction in LITS that implement distributed data processing and storage technologies. They can be used both as a methodological guide, and when carrying out specific work on the creation and development of systems that implement these technologies, as well as when forming technical specifications for the implementation of work on the creation of such systems.

scholarly journals Uncertainty analysis in the techno-economic assessment of CO2 capture and storage technologies. Critical review and guidelines for use

2020 ◽  
Vol 100 ◽  
pp. 103113 ◽  
Author(s):  
Mijndert van der Spek ◽  
Timothy Fout ◽  
Monica Garcia ◽  
Vishalini Nair Kuncheekanna ◽  
Michael Matuszewski ◽  
...  
Keyword(s):  
Uncertainty Analysis ◽  
Co2 Capture ◽  
Critical Review ◽  
Economic Assessment ◽  
Co2 Capture And Storage ◽  
Storage Technologies ◽  
And Storage

scholarly journals Distributed Data Collection for the Next Generation ATLAS EventIndex Project

2019 ◽  
Vol 214 ◽  
pp. 04010
Author(s):  
Álvaro Fernández Casaní ◽  
Dario Barberis ◽  
Javier Sánchez ◽  
Carlos García Montoro ◽  
Santiago González de la Hoz ◽  
...  
Keyword(s):  
Data Collection ◽  
Current Approach ◽  
Distributed Data ◽  
Future Data ◽  
Data Files ◽  
Complete Catalogue ◽  
And Performance ◽  
Processing And Storage ◽  
Storage Technologies ◽  
And Storage

The ATLAS EventIndex currently runs in production in order to build a complete catalogue of events for experiments with large amounts of data. The current approach is to index all final produced data files at CERN Tier0, and at hundreds of grid sites, with a distributed data collection architecture using Object Stores to temporarily maintain the conveyed information, with references to them sent with a Messaging System. The final backend of all the indexed data is a central Hadoop infrastructure at CERN; an Oracle relational database is used for faster access to a subset of this information. In the future of ATLAS, instead of files, the event should be the atomic information unit for metadata, in order to accommodate future data processing and storage technologies. Files will no longer be static quantities, possibly dynamically aggregating data, and also allowing event-level granularity processing in heavily parallel computing environments. It also simplifies the handling of loss and or extension of data. In this sense the EventIndex may evolve towards a generalized whiteboard, with the ability to build collections and virtual datasets for end users. This proceedings describes the current Distributed Data Collection Architecture of the ATLAS EventIndex project, with details of the Producer, Consumer and Supervisor entities, and the protocol and information temporarily stored in the ObjectStore. It also shows the data flow rates and performance achieved since the new Object Store as temporary store approach was put in production in July 2017. We review the challenges imposed by the expected increasing rates that will reach 35 billion new real events per year in Run 3, and 100 billion new real events per year in Run 4. For simulated events the numbers are even higher, with 100 billion events/year in run 3, and 300 billion events/year in run 4. We also outline the challenges we face in order to accommodate future use cases in the EventIndex.

Sign in / Sign up

Export Citation Format

Share Document