Demonstration at EGI User Forum opens new possibilities for large scale scientific high performance computing (HPC)
Vilnius, 14 April 2011 - At the EGI User Forum, held in Vilnius, Lithuania, the EDGI project for the first time demonstrated a brand new feature. The feature is called the MetaJob mechanism by which users are enabled to submit jobs to the EDGI Desktop Grid through gLite using one single submit command in the range of thousands of jobs, tens of thousands of jobs or even more. This was being demonstrated in the EDGI booth with great success.
During the day 10,000 jobs were submitted several times to show the EGI User Forum visitors, how the jobs can easily be processed by BOINC and to show the gLite users, how MetaJob can be used through glite, without disrupting the gLite infrastructure.
From a technical point of view the solution is based on the well known Service Cluster Grid to Desktop Grid bridge, where an extra metajob description file - containing the definition of a huge number of jobs - is attached to the job as input file. This metajob input file is recognised by the 3GBridge component, which then creates the jobs and inserts them into BOINC. That is the essence of the solution. This solution also works with XtremWeb on the Desktop Grid side or ARC on the Service/Cluster Grid side without any modification. This work was performed in the framework of "Task JRA1.5: Solve Service/Cluster Grid to Desktop Grid bridge scalability issues" in the EDGI project.
Peter Kacsuk from the EDGI project stated: "This successful EDGI demonstration clearly shows that Desktop Grids can be used effortlessly for scientific day-to-day calculations. The relevance of Desktop Grids for e-Science has been proven once and for all."
The technical results and documentation are available on both the EDGI and Desktop Grid
Federation websites. The International Desktop Grid Federation will take care that also other Grids can use the demonstrated technology.
EDGI develops middleware that consolidates the results achieved in the EDGeS project concerning the extension of Service Grids with Desktop Grids (DGs) in order to support European Grid Initiative (EGI) and National Grid Initiative user communities that are heavy users of Distributed Computing Infrastructures (DCIs) and require an extremely large number of CPUs and cores. EDGI is moving beyond existing DCIs that are typically cluster Grids and supercomputer Grids, and extends them with public and institutional Desktop Grids and Clouds. EDGI integrates software components of ARC, gLite, Unicore, BOINC, XtremWeb-HEP, 3G Bridge, and Cloud middleware into Service/Cluster Grid-Desktop Grid-Cloud platforms for service provision and as a result EDGI extends ARC, gLite and Unicore Grids with volunteer and institutional Desktop Grid systems. More
information is available at http://edgi-project.eu/
About the International Desktop Grid Federation
The International Desktop Grid Federation is a member organisation, supported by the EDGI project, that brings together people from companies, universities and institutes that are interested in using Desktop Grid computing power and that want to exchange experiences with others. The Federation provides several services to its members. This includes face-to-face meetings, in workshops and tutorials, a library of documentation, message boards, a portal and help by experts.
More information is available at http://desktopgridfederation.org
Note for the editor:
More information on this press release
IDGF/EDGI Dissemination Manager
E-mail: info at almeregrid.nl
Phone: +31 36 5373 867
The IDGF gets initial support from the EDGI project.
The EDGI project is a European project led by MTA SZTAKI. EDGI is supported by the FP7
Capacities Programme under grant agreement RI-261556.
EDGI Project Coordinator
Prof. Peter Kacsuk
E-mail: kacsuk at sztaki.hu
Phone: +36 1 329 7864