Description: SC10FlatWhiteLogo.eps

The 2010 Workshop on Verification, Validation, and Uncertainty Analysis in High-Performance Computing



14 November 2010

New Orleans, LA, USA

Collocated with the 23rd Supercomputing Conference (SC10)


High-performance computing applications (HPC) have historically advanced the frontier of software complexity, and next generation (HPC) environments will increase substantially further.  The nature of HPC introduces verification, validation and uncertainty analysis (VV&U) challenges that are perhaps unique to the field.  Many HPC applications are simulation-oriented which further exacerbates the difficulties by introducing additional validation requirements and possibilities for uncertainty in the results.  Unfortunately, HPC application software VV&U do not have a strong tradition since most of the work related to this area has been heavily focused on tolerance to faults due to hardware failure.  This workshop will provide a forum for evaluating, sharing, and creating ideas for validation, verification, and uncertainty analysis of HPC applications.

Topics of Interest

The VVUHPC 2010 workshop consists of peer-reviewed papers in the field of verification, validation and uncertainty analysis in high-performance computing. The goal of VVUHPC 2010 is to provide a platform for encouraging exploration of new paths towards the ensuring and evaluating the dependability of HPC applications. Topics of interest include:


      HPC V&V

      HPC simulation V&V

      HPC requirements analysis

      HPC specification writing

      Uncertainty analysis

      Multiple or aggregate model evaluation

      Fault tolerance

      HPC software testing

      Data integrity analysis

      HPC model validation

      HPC application fault analysis, prediction and diagnosis

      Multi-core and parallel fault resolution

      HPC dependability solutions and challenges

Submissions Guidelines and Workshop Proceedings

VVUHPC welcomes two types of submissions:


  1. Full papers of up to 8 pages of work not already published or under review for publication in other conferences of journals.
  2. Extended abstracts of up to 4 pages describing work in progress, which is intended to foster discussions of the emerging trends in the VV&U of HPC and exchange of recent ideas.


Submissions are accepted only electronically, in PDF format, and must conform to the IEEE conference paper style. Full papers may not exceed 8 pages and extended abstracts of work in progress should be no more than 4 pages long including all figures, tables, references, and supplementary material. Reference style files are available at Papers and abstracts should be submitted to the workshop chairs at Multiple program committee members will review each submission.

Important Dates

       Abstract submission: 23 August 2010

       Full paper or extended abstract submission: 7 September 2010

       Notification of acceptance: 11 October 2010

       Camera-ready papers and extended abstracts: 1 November 2010

Workshop Co-Chairs

       Laura Pullum, Oak Ridge National Laboratory, USA

       Robert Patton, Oak Ridge National Laboratory, USA

       Thomas Potok, Oak Ridge National Laboratory, USA

Program Committee

       David E. Bernholdt, Oak Ridge National Laboratory, USA

       Greg Bronevetsky, Lawrence Livermore National Laboratory, USA

       Jeffrey Carver, University of Alabama, USA

       Jack Dongarra, University of Tennessee, USA

       Al Geist, Oak Ridge National Laboratory, USA

       Mats Heimdahl, University of Minnesota, USA

       Lorin Hochstein, USC Information Sciences Institute, USA

       Jesse Poore, University of Tennessee, USA

       Mladen Vouk, North Carolina State University, USA



Opening Remarks

1:30 – 1:55

Gradient Enhanced Universal Kriging Model for Uncertainty Quantification in Reactor Safety Simulations [paper] [slides]

Brian Lockwood (University of Wyoming) and Mihai Anitescu (Argonne National Laboratory)

1:55 – 2:20

Polynomial Regression with Derivative Information for Uncertainty Analysis of Complex Simulation Models [paper] [slides]

Oleg Roderick (Argonne National Laboratory), Mihai Anitescu (Argonne National Laboratory), Yiou Li (Illinois Institute of Technology) and Zhu Wang (Virginia Polytechnic Institute)

2:20 – 3:00

Invited Talk:  Workflow Management Support for Uncertainly Analysis [slides]

Mladen Vouk (North Carolina State University)

3:00 – 3:15


3:20 – 4:00

Invited Talk:  Applying Software Engineering Principles to the Development of Scientific and Engineering Software: Lessons Learned from a Series of Case Studies & Workshops [slides]

Jeffrey Carver (University of Alabama)

4:00 – 4:40

Invited Talk:  Hardware and Software Considerations for VV&UQ [slides]

David Bernholdt (Oak Ridge National Laboratory)

4:40 – 5:00

Discussion and Closing Remarks


Workshop Site