Parallelization with MPI
Hybrid Course: Parallelization with MPI
24 - 26 April 2023, 09:00 - 16:30 CEST
Course for academia and industry
Organised by VSC Research Center (TU Wien) in cooperation with the High-Performance Computing-Center Stuttgart (HLRS). Funded by EuroCC and EuroCC Austria.
Language: English
Location: hybrid (online - Zoom or FH Internet-Raum FH1 at TU Wien)
Price: free
On clusters and distributed memory architectures, parallel programming with the Message Passing Interface (MPI) is the dominating programming model. This 3 days course teaches parallel programming with MPI starting from a beginners level. Hands-on sessions (in C, Fortran, and Python) will allow users to immediately test and understand the basic constructs of the Message Passing Interface (MPI).
Content levels: Beginners = 8:00h (50%) + Intermediate = 6:00h (37%) + Advanced = 2:00h (13%)
Note, an additional course on Shared memory parallelization with OpenMP takes place on the following two days, registration for both courses can be done on the same registration form.
Agenda
24 April 2023 (Day 1)
08:45 Join in
09:00 Welcome (talk)
09:05 MPI overview (talk+demo)
10:05 Break
10:15 Process model and language bindings (talk+demo+practical)
11:30 Break
11:45 Messages and point-to-point communication (talk+practical)
13:00 Lunch
14:00 Nonblocking communication (talk+demo+practical)
15:30 Break
15:45 Fortran and MPI - only for Fortran participants (talk)
16:30 End of first day
25 April 2023 (Day 2)
08:45 Join in
09:00 Collective communication (talk+demo+practical)
10:15 Break
10:30 Groups & Communicators (talk+practical)
11:30 Break
11:45 Virtual topologies (talk+practical)
13:00 Lunch
14:00 Derived datatypes (talk+demo+practical)
15:30 Break
15:45 Optimizing MPI communication - a real world example (talk+discussion)
16:00 Short Tour: other MPI topics (talk)
16:30 End of second day
26 April 2023 (Day 3)
08:45 Join in
09:00 One-sided Communication (talk+practical)
10:30 Break
10:45 Shared Memory One-sided Communication (talk+practical)
12:00 Break
12:15 Short Tour: MPI I/O (talk)
13:00 Lunch
14:00 Best practice, MPI jobs scripts, pinning (talk+demo+practical)
15:30 Break
15:45 Summary, Q&A (talk+discussion)
16:30 End of third day (course)
Course format
This course will be delivered as an HYBRID COURSE, i.e., you can choose either in-person attendance onsite at TU Wien or online participation via Zoom.
If you are planning to travel to Vienna for in-person attendance, we strongly recommend to choose travel options and hotels with the possibility to cancel (even close to the event) because we might be forced to deliver the course entirely online if Covid strikes back.
Prerequisites
For the hands-on sessions you should be able to program in either C/C++ or Fortran or Python and if you do the exercises on the VSC you should know how to work on the Unix/Linux command line.
Hands-on labs
For doing the hands-on labs all you need is a C/C++ or Fortran compiler, or Python+numpy+mpi4py, and a recent MPI library. Participants can choose between using any system they have access to that provides these or their own laptops with a proper installation of the mentioned software. Alternatively, participants can ask for a training user account at the VSC for the duration of the course.
Accepted participants will be contacted a few days before the course and asked to do a short PRE-ASSIGNMENT that has to be completed before the course starts.
Lecturers
Claudia Blaas-Schenner (VSC Research Center, TU Wien)
TBD (tutors; VSC Research Center, TU Wien)
Language
English
Date, time, and location
24.-26.04.2023, 09:00 - 16:30 CEST,
FH Internet-Raum FH1 (TU Wien, Wiedner Hauptstraße 8-10, ground floor, red area)
OR live online course via Zoom (hybrid course format)
Prices and eligibility
This course is is funded by EuroCC. Therefore, the course is open and free of charge for participants from academia and industry from the Member States (MS) of the European Union (EU) and Associated/Other Countries to the Horizon 2020 programme.
Registration
Registration for this course is closed (fully booked)!
Please register with your official e-mail address to prove your affiliation.
Registration period is from 6 February to 2 April 2023, and follows the "first come – first served" principle.
Following your successful registration, you will receive further information approx. 1 week before the course.
For the hybrid course we can take a maximum of 40 persons. Additional registrations will be added to a waiting list.
Note, an additional course on Shared memory parallelization with OpenMP takes place on the following two days, registration for both courses can be done on the same registration form.
Course material
MPI – Course Material
Please provide your feedback (at the end of the course) here:
https://events.prace-ri.eu/event/1452/surveys/1080
Course organiser / contact:
Claudia Blaas-Schenner and Ulrike Faltin: training@vsc.ac.at