Speaker
Mr
Kostas Kagkelidis
(AUTH/GRNET)
Description
In the context of the ARGO framework (initially the A/R EGI funded mini project) our team at AUTH (being part of a larger consortium formed by GRNET, SCRE and CNRS) has developed and deployed the A/R core compute engine, which uses Big Data tools for the processing of the incoming monitoring data on top of virtualised resources. The current production instance is deployed on ~okeanos (GRNET’s IaaS cloud). The compute engine relies heavily on Big Data tools (Hive and Pig mostly) and the results are offered towards a central portal through a distributed MongoDB and a REST API (written in golang) which also reside on virtualised resources. Through the proposed presentation we intend to share our experiences so far in developing, deploying and running Big Data processing tools and services on top of IaaS Cloud resources.
Primary author
Mr
Kostas Kagkelidis
(AUTH/GRNET)
Co-authors
Christos Kanellopoulos
(GRNET)
Kostas Koumantaros
(GRNET)
Paschalis Korosoglou
(GRNET)
