eStep

Developing an eScience technology platform
Image: Martijn van Dam

An important aspect of eScience is the development of new methods and tools to support scientists to enhance the ways they conduct research and to optimize the route to new scientific discovery. The route from data to information to knowledge and insight can and should take optimal advantage of modern ICT facilities and e-infrastructures, but often requires specialist experience. Ideally, researchers should be engaged in their scientific challenges rather than with ICT, however supportive.

The goal of eStep is to develop tools, interfaces, and libraries to deal with and extract information from large amounts of (distributed) data, requiring large computing infrastructures, high-speed networks, and high-resolution visualization equipment. Moreover, in many cases data and results, as well as compute kernels and full scientific workflows, are made sharable among multiple collaborating parties.

Avoiding ‘reinventing the wheel’

As part of our strategy we explicitly try to avoid ‘reinventing the wheel’ even for domain-specific eScience solutions. To this end, eStep follows a layered and modular approach. At the lowest layer, system-level libraries are developed (or adopted) and integrated, following five themes:

(1) Data

(2) Computing

(3) Networking

(4) Visualization

(5) Other

The low-level libraries specifically aim at hiding the particular idiosyncrasies of accessing, and making optimal use of, the underlying hardware and middleware infrastructures. eStep tools categorized under the ‘Computing’ theme, for example, allow easy access to, and concurrent use of, a large variety of computing resources, thus supporting the Jungle Computing paradigm.

Maximizing software re-use

The highest layer offers generic and domain-specific solutions. Each of the tools at this layer either serve as a complete solution for a domain-specific problem, or as a domain-independent ‘skeleton’ that can be used for various scientific problems with very similar properties. An example skeleton represents a multi-model/multi-kernel simulation environment that applies to both the domains of computational astrophysics and climate modeling, and possibly more. An important aim of the eStep project is to have the high-level tools be built on top of the low-level libraries as much as possible, thus maximizing software re-use.

Output

Writing Testable GPU Code

By Ben van Werkhoven

April 12, 2018

Read the blog

SPOT : Visual scientific data analytics made easy

By Faruk Diblen

January 16, 2018

Read the blog

Free as in Free Market: Or why the GNU General Public License is open for business

By Lourens Veen

October 05, 2017

Read the blog

A license to science

By Lourens Veen

May 23, 2017

Read the blog

mcfly: time series classification made easy

By Dafne van Kuppevelt

March 20, 2017

Read the blog

1 Book

  • Computer performance engineering

Team

  • Rob van Nieuwpoort
    Netherlands eScience Center
  • Alessio Sclocco
    Netherlands eScience Center
  • Arnold Kuzniar
    Netherlands eScience Center
  • Atze van der Ploeg
    Netherlands eScience Center
  • Ben van Werkhoven
    Netherlands eScience Center
  • Berend Weel
    Netherlands eScience Center
  • Christiaan Meijer
    Netherlands eScience Center
  • Dafne van Kuppevelt
    Netherlands eScience Center
  • Elena Ranguelova
    Netherlands eScience Center
  • Evelien Schat
    Netherlands eScience Center
  • Faruk Diblen
    Netherlands eScience Center
  • Felipe Zapata
    Netherlands eScience Center
  • Hanno Spreeuw
    Netherlands eScience Center
  • Jason Maassen
    Netherlands eScience Center
  • Jisk Attema
    Netherlands eScience Center
  • Johan Hidding
    Netherlands eScience Center
  • Jurriaan H. Spaaks
    Netherlands eScience Center
  • Lourens Veen
    Netherlands eScience Center
  • Mateusz Kuzak
    Netherlands eScience Center
  • Niels Drost
    Netherlands eScience Center
  • Piter T. de Boer
    Netherlands eScience Center
  • Rena Bakhshi
    Netherlands eScience Center
  • Romulo Gonçalves
    Netherlands eScience Center
  • Sonja Georgievska
    Netherlands eScience Center
  • Tom Bakker
    Netherlands eScience Center
  • Vincent van Hees
    Netherlands eScience Center
  • Willem van Hage
    Netherlands eScience Center
  • Wouter Kouw
    Netherlands eScience Center
Show all contributors