Parallel and Distributed Computation (CS621, Spring 2021)

Please note that you must have an M.S. degree in CS or have taken two 500 level CS courses at the University of Kentucky before you can register for this course.

Semester: Spring, 2021.
Class: 12:00 - 12:50pm, MWF.
Classroom: Fully on line.

Instructor: Jun Zhang,, Tel:257-3892.
Office: 321 Marksbury Building.
Office Hours: MW: 9:00am - 10:00am, and by appointment.

Reference Text Books:
Introduction to Parallel Computing: Design and Analysis of Algorithms
by Vipin Kuman, Ananth Grama, Anshul Gupta, and George Karypis, 2nd Ed., 2003. (required, BOOK 1)

Using MPI: Portable Parallel Programming with the Message-Passing Interface
by William Gropp, Ewing Lusk, and Anthony Skjellum, 2nd Ed., 1999. (BOOK 2)

CS621 syllabus.pdf, for Spring 2021; (subject to change)

Some rules rule.pdf, you should know before taking this course.

Here is An MPI Tutorial, describing simple MPI routines

Here is another online tutorial on Message Passing Interface (MPI);

Here is how to install a copy of MPI library for your PC machines: Using MPI at Home.

This is the official MPI webpage with MPICH.

I recommend students using Windows system to install Microsoft MPI, this is a stand-alone, redistributable and SDK installers for Microsoft MPI.

Please also check the Microsoft MPI Documents.

Class Slides (Spring 2019)

Important Changes from previous teaching: We will no longer use the supercomputers at the UK Computing Center for the assignments. Students must have their own machines (PC or whatever machines) to run a version of MPI to simulate parallel and distributed computations.
Assignments (Spring 2021)

All homeworks and projects are to be submitted on Canvas

For some information on building PC and workstation clusters, please see Microway, Inc.

The following is the course materials that I used in previous year's teaching. It may give you an idea of what will be covered in the this course. However, there is NO GUARANTEE that this year's course content and requirements will be exactly the same as that offered in 1998.
Parallel Computer: The supercomputer that will be used in this class for practicing parallel programming is the HP Superdome at the University of Kentucky High Performance Computing Center. Alternatively, you can install a copy of MPI on your own computers

Here is an old description of the course.


Homework Projects


Supercomputing Technology News

Here is a list of parallel scientific computing courses offered at several universities:

On-line study materials on parallel computing:

Last modified on Monday, January 12, 2016.