Program
The course covers the programming models and the paradigms used with distributed and parallel systems, for both the application and support tool software. The main focus of the course is on structured programming models (parallel design pattern, algorithimc skeletons) as the main API provided to the application programmers to develop parallel applications. The implementation of structured parallel programming models will be detailed in terms of models and support mechanisms. The models and mechanisms considered include classical models (client/server, master/worker, map/reduce) and mechanisms (POSIX TCP/IP, OpenMP, MPI, etc). While presenting models and paradigms, special emphasis will be given to different aspects related to either the programming model presented to the final user or the particular implementation mechanism chosen, namely
- separation of concerns (application vs. system programmers, functional vs. non functional concerns)
- program refactoring techniques
- modularity, software reuse, incremental design
- performance modelling and portability
- fault tolerance and adaptivity
- targeting of different, possibly heterogeneous, architectures, including co-processor exploitation.
The course will be logically split into distinct parts:
- Introduction Evolution of parallel and distributed architectures, Urgency of parallel/distributed programming models and tools, “Parallel” vs. “distributed” dichotomy revised.
- Part I: Parallel and distributed programming paradigms. Structured programming, Parallel design patterns and algorithmic skeletons.
- Part II: Implementation models. High level models (e.g. client/server or master/worker) and low level mechanisms (e.g. POSIX TCP/IP or Pthreads)
- Part III: Networks in distributed systems. Wireless, multimedia and peer-to-peer networks: features, peculiarities and exploitation in distributed systems
- Part IV: Lab&Technology. Skeleton environments, Component environments, Implementation of simple RTS, Implementation of simple applications
Support material
The whole program will be covered by the course notes material.