Data visualization and representation in ATLAS BigPanDA monitoringстатьяЭлектронная публикация
Информация о цитировании статьи получена из
Scopus
Статья опубликована в журнале из перечня ВАК
Статья опубликована в журнале из списка Web of Science и/или Scopus
Дата последнего поиска статьи во внешних источниках: 31 июля 2019 г.
Аннотация:A rising demand on visualization of high-volume data we observe currently is an immediate follow up to the technological ability to collect, store and handle Big Data drastically increased in the recent years. A lot of contemporary development activities both open source and proprietary are focused on indexing, plotting and navigating over historical and scattered data. In particular GitHub reports 7,449 data visualization projects registered in the 2017 while only 3,183 for 2015. Many of such developments form a technological stack which delivers advanced data visualization functionality almost out of the box but in the same time complex data aggregation, analysis and navigation still requires custom solutions.
In this paper we describe author’s experience of building BigPanDA monitoring which provides interface to the PanDA jobs management system used in CERN Particle Physics experiments such as ATLAS at LHC and COMPASS at SPS. We present principles of design of user interfaces and data visualization which provides compact, user oriented access to the data stored in hundreds millions of rows scattered in tenths of database tables and another sources. The system operates in 24x7 mode and serves different needs of more than thousand users.