SCHEDULE: NOV 10-16, 2007

Optimizing Center Performance through Coordinated Data Staging, Scheduling and Recovery

Session: Scheduling

Event Type: Paper

Time: 4:30pm - 5:00pm

Session Chair: Greg Bronevetsky

Author(s): Zhe Zhang, Chao Wang, Sudharshan S. Vazhkudai, Xiaosong Ma, Gregory G. Pike, John W. Cobb, Frank Mueller

Location: A2 / A5

Abstract:
Procurement and the optimized utilization of Petascale supercomputers and centers is a renewed national priority. Sustained performance and availability of such large centers is a key technical challenge significantly impacting their usability. Storage systems are known to be the primary fault source leading to data unavailability and job resubmissions. This results in reduced center performance, partially due to the lack of coordination between I/O activities and job scheduling.

In this work, we propose the coordination of job scheduling with data staging/offloading and on-demand staged data reconstruction to address the availability of job input data and to improve center-wide performance. Fundamental to both mechanisms is the efficient management of transient data: in the way it is scheduled and recovered. Collectively, from a center’s standpoint, these techniques optimize resource usage and increase its data/service availability. From a user’s standpoint, they reduce the job turnaround time and optimize the allocated time usage.

This paper can be found in the ACM Digital Libaries
Click here for ACM

Chair/Author Details:

Greg Bronevetsky (Chair)
Lawrence Livermore National Laboratory

Zhe Zhang
North Carolina State University

Chao Wang
North Carolina State University

Sudharshan S. Vazhkudai
Oak Ridge National Laboratory

Xiaosong Ma
North Carolina State University

Gregory G. Pike
Oak Ridge National Laboratory

John W. Cobb
Oak Ridge National Laboratory

Frank Mueller
North Carolina State University

Home | About | Contact Us | Registration