Contents 1 Versions of the Roadmap 1.1 Current Version of the IESP Roadmap 1.2 Previous Versions of the IESP Roadmap 2 Presentations at the IESP exploratory meeting SC08, Austin, TX, 18Nov08 3 Meeting 1 (Santa Fe, NM, USA) 3.1 Presentations 3.1.1 Summaries from the meeting breakout groups 3.1.2 Plenary Presentations 3.2 Whitepapers 4 Meeting 2 (Paris, France) 4.1 Full Workshop Report 4.2 Presentations 4.2.1 Plenary Presentations 4.2.2 Summaries from meeting breakout groups - Day 1 4.2.3 Summaries from meeting breakout groups - Day 2 4.2.4 Wrap-up Workshop 2/Preparation for Workshop 3 4.3 Whitepapers and notes on crosscutting issues for Paris Meeting 5 Meeting 3 (Tsukuba, Japan) 5.1 Starting documents for meeting, including initial Roadmap "strawman" 5.2 Presentations 5.2.1 Day 1 5.2.2 Reports from the software breakout groups (Day 2) 5.2.3 Reports from application breakout group (Day 2) 5.3 Whitepapers 6 IESP Birds-of-a-feather session, SC09, Portland, OR 7 Meeting 4 (Oxford, United Kingdom) 7.1 Presentations 7.1.1 Day 1 (Tuesday, April 13) 7.1.2 Items from Day 1 Break-out Groups 7.1.3 Day 2 (Wednesday, April 14) 8 Combined Archive of Presentations and Whitepapers 9 Relevant background material

1 Versions of the Roadmap

1.1 Current Version of the IESP Roadmap

• IESP Roadmap Version 1.0

To refer this document in print, it is now available as a CS Technical Report: ut-cs-10-654 -- "International Exascale Software Project Roadmap"; Dongarra, Beckman, et al., May 30, 2010

1.2 Previous Versions of the IESP Roadmap

• IESP Roadmap Draft 0.9
• IESP Roadmap Draft 0.91
• IESP Roadmap Draft 0.92
• IESP Roadmap Draft 0.93
• IESP Roadmap Draft 0.935

2 Presentations at the IESP exploratory meeting SC08, Austin, TX, 18Nov08

Jack Dongarra and Pete Beckman, who organized this initial discussion of the challenges and potential of the IESP, began the conversation with a short presentation.

3 Meeting 1 (Santa Fe, NM, USA)

Agenda

3.1 Presentations

3.1.1 Summaries from the meeting breakout groups

• Summary of Breakout Group 1: Developing a technical roadmap for peta/exascale software infrastructure.
• Summary of Breakout Group 2: Organization and funding models for international collaboration to develop peta/exascale software infrastructure.

3.1.2 Plenary Presentations

• Improving HPC Software: Welcome, Pete Beckman (Argonne National Laboratory/University of Chicago) and Jack Dongarra (University of Tennessee/Oak Ridge National Laboratory)
• e-Infrastructure in FP7: HPC related aspects, Catherine Riviére, GENCI, France
• Development of an Over Petascale Computer in Japan,Satoshi Matsuoka, GSIC Center, Tokyo Institute of Technology/National Institute of Informatics
• International Exascale Software Program, Abani Patra, NSF Office of Cyberinfrastructure.
• Improving HPC Software: Overview, Pete Beckman (Argonne National Laboratory/University of Chicago) and Jack Dongarra (University of Tennessee/Oak Ridge National Laboratory)
• Thou Shalt Specialize or Commoditize? The Japanese Situation Towards Peta and Exascale, Satoshi Matsuoka, GSIC Center, Tokyo Institute of Technology/National Institute of Informatics
• Technology and Architectures for Future Large‐Scale Computing Systems, Rick Stevens, Argonne National Laboratory and University of Chicago.
• Computational Science and HPC Software-Development in Europe, Thomas Lippert and Bernd Mohr, Forschungszentrum Jülich, JSC and Gauss Centre for Supercomputing e.V.
• Slides from the panel:Software Barriers to HPC, Today and Tomorrow. Panel participants:Al Gara, Jean-Yves Berthou, Mitsuhisa Sato, Peggy Williams, Vivek Sarkar, Ann Trefethen
• Science Drivers, Current HPC Software Development, and Platform Deployment Plans for the USA, Horst Simon,Lawrence Berkeley National Laboratory and UC Berkeley

3.2 Whitepapers

• Musings on the Path Toward Exascale, Robert Lucas - ISI/USC
• BSC Vision Towards Exascale, Mateo Valero, BSC
• Software Challenges of Extreme Scale Computing, Michael Heroux - Sandia National Laboratory
• Software and Exascale Computing, Bill Camp - Intel Corporation
• Application Analysis and Porting in the PRACE Project, Peter Michielse - Netherlands National Computing Facilities Foundation (NCF)
• The Application Perspective - Seeking Productivity and Performance, David Barkai - Intel Corporation
• XXL Simulation for XXI st Century Power Systems Operation, J.Y. Berthou, J.F. Hamelin and Etienne de Rocquigny - EDF R&D
• The Biggest Need: A New Model of Computation, Thomas Sterling - Louisiana State University
• NSF IESP Whitepaper, Abani Patra, Rob Pennington, Ed Seidel - Office of Cyberinfrastructure, National Science Foundation
• A Proposal for a Capability Centers Consortium, Bill Gropp, Mark Snir - NCSA and the University of Illinois at Urbana-Champaign
• Slouching Towards Exascale, Rusty Lusk, Argonne National Laboratory
• A Collaboration and Commercialization Model for Eascale Software Research, Mark Seager and Brent Gorda, Lawrence Livermore National Laboratory
• The Case for A Hierarchal System Model for Linux Clusters, Mark Seager and Brent Gorda, Lawrence Livermore National Laboratory
• IESP 
Whitepaper:
 PDE­-based
 applications 
and
 solvers 
at
 extreme
 scale, David
Keyes
, Columbia 
University 
&
 SciDAC
 TOPS 
project
• Developing a high performance computing/numerical analysis roadmap, Ann Trefethen, Nick Higham, Ian Duff, and Peter Coveney

4 Meeting 2 (Paris, France)

4.1 Full Workshop Report

Summary Report:IESP Workshop 2, Paris, France

4.2 Presentations

4.2.1 Plenary Presentations

• Grand Équipement National de Calcul Intensif, Catherine Riviere (GENCI)
• Improving HPC Software, Jack Dongarra (UTK/ORNL)
• Results from Sante Fe, Pete Beckman (ANL/U. Chicago)
• Objectives and Organization of the European IESP workshop, Franck Capello (INRIA), Christian Saguez (TeraTec)
• Lessons and feedback of the Santa Fe Meeting, Jean-Yves Berthou (INRIA)
• Synthesis of the IESP Santa Fe Whitepapers, Bernd Mohr (JSC), Thomas Lippert (JSC), Jesus Labarta,(BSC)
• Workshop Series on Science Grand Challenges Enabled by Extreme Scale Computing, Paul Messina (ANL)

4.2.2 Summaries from meeting breakout groups - Day 1

• Technical challenges and needs of academic and industrial software infrastructure research and development (Breakout group 1-1)
• Intranode Programming Model (Breakout group 1-2)
• Computational Challenges and Needs for Academic and Industrial Applications Communities (Breakout group 2)
• Economic and management challenges and needs of computational resource providers and industry partners (Breakout group 3)
• Role and Participation of national and international funding agencies (Breakout group 4)

4.2.3 Summaries from meeting breakout groups - Day 2

• Programming Models at Exascale, with a focus on problems within a socket (Breakout group 1A)
• Software working group slides, complete. This set of slides,compiled by Mike Heroux, contains the cumulative output of both software infrastructure subgroups for both days.
• Computational Challenges and Needs for Academic and Industrial Applications Communities (Breakout group 2) This group also put together a list of application experts from different research domains who we can consult with as the planning process moves forward.
• Economic and management challenges and needs of computational resource providers and industry partners (Breakout group 3)
• Role and Participation of national and international funding agencies (Breakout group 4)

4.2.4 Wrap-up Workshop 2/Preparation for Workshop 3

• Next Steps and Research Agenda, Paul Messina and Anne Trefethen

4.3 Whitepapers and notes on crosscutting issues for Paris Meeting

• Programming Models at Exascale: adaptive runtime systems, incomplete simple languages, and interoperability, Laxmikant (Sanjay) Kale (University of Illinois, Urbana-Champagne)
• On the Importance of End-to-end Application Performance Monitoring and Workload Analysis at the Exascale, David Skinner (LBNL) and Alok Choudary (Northwestern University)
• Towards exascale distributed data management, Giovanni Aloisio (Euro-Mediterranean Centre for Climate Change-CMCC)
• Towards Exascale Resilience, Franck Cappello (INRIA), Al Geist (ORNL), Bill Gropp (UIUC), Sanjay Kale (UIUC), Bill Kramer (UIUC), Marc Snir (UIUC)
• Early application development/tuning and application characterization/segmentation, Laxmikant (Sanjay) Kale (University of Illinois, Urbana-Champagne)
• An Exascale Approach to Software and Hardware Design, William Kramer(NCSA) and David Skinner(LBNL)
• Consistent Application Performance at Exascale, William Kramer(NCSA) and David Skinner(LBNL)
• Performance at Exascale, Bernd Mohr (Jülich Supercomputing Centre) and Matthias S. Mueller (Wolfgang E. Nagel Center for Information Services and HPC)
• Resource Management, Barney McCabe (ORNL) and Hugo Falter (ParTec)
• Programmability Issues, Vivek Sarkar (Rice U.), Jesus Labarta (UPC), Mitsuhisa Sato (U. of Tsukuba), Barbara Chapman (U. of Houston)
• Models of Computation – Enabling Exascale, Thomas Sterling, Louisiana State University.
• Major Computer Science Challenges at Exascale, Al Geist (ORNL) and Robert Lucas (ISI)
• Towards Exascale File I/0, Yutaka Ishikawa, University of Tokyo
• Co-design of Architectures and Algorithms, Al Geist (ORNL) and Sudip Dosanjh (SNL)
• IESP Exascale Challenge: Resilience and Fault Tolerance, Al Geist (ORNL) and Franck Cappello (INRIA)

5 Meeting 3 (Tsukuba, Japan)

5.1 Starting documents for meeting, including initial Roadmap "strawman"

Attendees to the workshop were asked to download and review the following documents:

• Initial strawman of the IESP Roadmap
• Roadmap template, which was used help guide participants working on different software component areas.
• Targets and milestones for the different software component areas used this Milestone template (doc)

5.2 Presentations

5.2.1 Day 1

• IESP Workshop: Asia Round, Taisuke Boku
• Government of Japan's Approach to High Performance Computing, Yuichi Inoue
• Goals for the IESP, Rick Stevens
• Main Results of the Previous Meetings and Overview of Whitepapers, Bernd Mohr.
• Objectives and organization of the meeting--The Software Roadmap, Satoshi Matsuoka
• Building the IESP Roadmap, Pete Beckman.

5.2.2 Reports from the software breakout groups (Day 2)

• Algorithms -- Lead: Bill Gropp
• Debugging -- Lead: David Skinner
• Frameworks -- Lead: Mike Herioux
• I/0, storage and data managmement -- Lead: Alok Choudrey
• Libraries -- Lead: Jack Dongarra
• Programming Models and Compilers -- Lead: Barbara Chapman
• Operating Systems -- Lead: Barney Maccabe
• Performance -- Lead: Bernd Mohr
• Power Efficiency -- Lead: John Shalf
• Programmability -- Lead: Thomas Sterling
• Resilience -- Lead: Franck Capello
• Runtime Systems -- Lead: Jesus Labarta
• Systems Management and Security -- Lead: Bob Wisnieswski

5.2.3 Reports from application breakout group (Day 2)

• Computational Challenges and Needs for Academic and Industrial Application Communities-- Leads: Jean-Claude Andre and Jean-Yves Berthou
• Pioneering Application: Priority Research Directions -- Leads: Bill Tang and Richard Kenway

5.3 Whitepapers

• Climate Change Research at Exascale, Giovanni Aloisio (University of Salento, Italy), Italo Epicoco (University of Salento, Italy), Silvia Mocavero (Euro-Mediterranean Centre for Climate Change – CMCC, Italy) and Mark Taylor (Sandia National Laboratory, USA)
• IESP Challenges: Application Development, Translation and Execution Environments, Barbara Chapman (Univ. of Houston), Richard Graham (ORNL), Barney Maccabe (ORNL), Oscar Hernandez(Univ. of Houston), Bernd Mohr(JSC), Wolfgang E. Nagel(TUD-ZIH)
• Operating Systems for Exascale, John Shalf (LBNL) and Thomas Sterling (Louisiana State Univ.)

6 IESP Birds-of-a-feather session, SC09, Portland, OR

• IESP BoF, SC09:Introduction, Jack Dongara
• Notes: Building the IESP Roadmap, Pete Beckman
• IESP and Applications, Paul Messina
• European Exascale Software Initiative, Jean-Yves Berthou

7 Meeting 4 (Oxford, United Kingdom)

• Logistics for the Oxford meeting
• Draft meeting agenda
• Background documents
  • Current version of the IESP Roadmap

7.1 Presentations

7.1.1 Day 1 (Tuesday, April 13)

• IESP Introduction, Oxford Workshop, Pete Beckman (ANL)
• A DOE Laboratory plan for providing exascale applications and technologies for critical DOE mission needs, Rick Stevens (ANL)
  • Rick's slide on "The Way Forward"
• European Exascale Software Initiative, Jean-Yves Berthou
• Department of Energy Planning for Exascale, Barbara Helland
• (Exascale) Software at NSF, Rob Pennington (NSF)
• Government of Japan’s Approach to High Performance Computing, Akiyuki Seki (MEXT)

7.1.2 Items from Day 1 Break-out Groups

• Technology break-out group:
  • Considerations on software technologies
  • Slide template for sorting technical priorities.
• Agency break-out group: Considerations for IESP governance
• Application break-out group:Application community considerations
• Vendor/Facility break-out group:Vendor/Provider considerations

7.1.3 Day 2 (Wednesday, April 14)

• Software Technologies breakout:
  • Report on discussions of software technology area representatives
  • Summary chart of software technology priorities
  • Categorized priorities for individual areas:
    • Priorities for I/O and Scientific Data Management
    • Priorities for Programming Models and Compilers
    • Priorities for Algorithms
    • Priorities for Debuggers
    • Priorities for Frameworks
    • Priorities for Numerical Libraries
    • Priorities for Operating Systems
    • Priorities for Performance
    • Priorities for Power Efficiency
    • Priorities for Programmability
    • Priorities for Fault Tolerance
    • Priorities for Runtime Systems
• Vendor Breakout:Report on discussions of vendor representatives
• Agency Breakout (Days 1 and 2 consolidated):Report on discussions of funding agency representatives
• Application Community Breakout:Report on discussions of application community representatives

8 Combined Archive of Presentations and Whitepapers

A PDF file (109MB) containing the presentations and whitepapers from Meetings 1 and 2 is available to download. This archive is inclusive of all white papers as of 16June09. More items have since been contributed and will soon be added to the archive.

9 Relevant background material

• Slides from SC09 Panel -- The Road to Exascale: Hardware and Software Challenges
  • SC'09 Exascale Panel, Stephen Scott, CTO, Cray.
  • Software at Exascale, Marc Snir, Univ. of Illinois.
  • Energy at Exaflops, Peter Kogge, Univ. of Notre Dame.
  • The Road to Exascale: Hardware and Software Challenge, Jack Dongarra, Univ. of Tennessee.
• ExaScale Computing Software Study: Software Challenges in Extreme Scale Systems, a DARPA/IPTO Report (September 14, 2009)
• International Assessment of Research in Simulation-Based Engineering and Science, a World Technology Evaluation Center (WTEC) panel report, sponsored by the NSF and other US Govt. Agencies. This is a large document (426 pgs., 6.1MB), but chapter 5 (Next Generation Architectures and Algorithms by George Em Karniadakis) and chapter 6 (Software Development by Martin Head-Gordon) are of obvious interest to the IESP.
• Modeling and Simulation at the Exascale for Energy and the Environment: Report on the Advanced Scientific Computing Research Town Hall Meetings on Simulation and Modeling at the Exascale for Energy, Ecological Sustainability and Global Security (E3) (2008), Horst Simon(LBNL), Thomas Zacharia (ORNL), Rick Stevens (ANL). Sponsored by the DOE Office of Science.
• ExaScale Computing Study: Technology Challenges in Achieving Exascale Systems] (DARPA/IPTO, 2008)
• Technology and Architectures for Future Large-Scale Computing Systems – Rick Stevens. Presentation from the DOE workshop Forefront Questions in Nuclear Science and the Role of High Performance Computing, January 26-28, 2009 · Washington D.C.
• Parallel Computing Research at Illinois The vision and research agenda of the Universal Parallel Computing Research Center at the University of Illinois at Urbana-Champaign.
• Report from the Workshop on Software Development Tools for Petascale Computing
• ICT Infrastructures for eScience, Communication from the Commission to the European Parliament, The Council, the European Economic and Social Committee, and the Committee of the Regions
• High Performance Computing & Numerical Analysis Applications/Algorithms Roadmap Version 1.0, A. Trefethen, N. Higham, I. Duff, P.V. Coveney - Engineering and Physical Sciences Research Center (EPSRC)
• The slides available from the Sept. 2008 Workshop: Simulating the Future Using One Million Cores and Beyond are directly relevant to the goals and challenges of the IESP.
• Overview for the IESP exploratory meeting, SC08, Austin Texas: To prepare for the early discussions about the need for and potential of the IESP, Pete Beckman and Jack Dongarra provided a two-page concept paper intended to motivate the discussion.
• Fundamentals of Technology Roadmapping, Marie L. Garcia and Olin H. Bray, Sandia National Laboratory