CERN Accelerating science

Development of Monitoring and Analysis Tools for the Huawei Cloud Storage System

Date published: 
Monday, 1 September, 2014
Document type: 
Summer student report
V. Bahaa
Abstract: CERN is the largest research centre for particle physics research in the world. Experiments generate large amounts of data which must be stored, processed and analysed. The storage solutions should provide large data capacity, scalability and reliability. The openlab CERN-Huawei partnership aims at testing and evaluating the performance of the Huawei Universal Distributed Storage system. Benchmarking and monitoring tools are developed to investigate the storage system behaviour. This report describes the upgrades done for the monitoring and analysis tools used by the Huawei cloud storage system at CERN. The first part of the report describes the additions done to the monitoring system of the cloud storage. The rest of the report describes the improvements done for scripts for listing files on the storage and monitoring their size.