Parallel and Distributed Computation (CS621, Spring 2021)
Please note that you must have an M.S. degree in CS or have
taken two 500 level CS courses at the
University of Kentucky before you can register for this course.
Semester: Spring, 2021.
Class: 12:00 - 12:50pm, MWF.
Classroom: Fully on line.
Instructor: Jun Zhang, E-mail:email@example.com, Tel:257-3892.
Office: 321 Marksbury Building.
Office Hours: MW: 9:00am - 10:00am, and by appointment.
Reference Text Books:
Introduction to Parallel Computing: Design and Analysis of Algorithms
by Vipin Kuman, Ananth Grama, Anshul Gupta, and George Karypis,
2nd Ed., 2003.
(required, BOOK 1)
Using MPI: Portable Parallel Programming with the Message-Passing Interface
by William Gropp, Ewing Lusk, and Anthony Skjellum, 2nd Ed., 1999. (BOOK 2)
CS621 syllabus.pdf, for Spring 2021;
(subject to change)
Some rules rule.pdf, you should know
before taking this course.
An MPI Tutorial, describing simple
Here is another online tutorial on Message Passing Interface (MPI);
Here is how to install a copy of MPI library for your PC machines:
Using MPI at Home.
This is the official MPI webpage with
I recommend students using Windows system to install
Microsoft MPI, this is a stand-alone, redistributable and SDK installers for Microsoft MPI.
Please also check the
Microsoft MPI Documents.
Class Slides (Spring 2019)
Important Changes from previous teaching: We will no longer use the
supercomputers at the UK Computing Center for the assignments. Students must
have their own machines (PC or whatever machines) to run a version of MPI
to simulate parallel and distributed computations.
Assignments (Spring 2021)
All homeworks and projects are to be submitted on Canvas
For some information on building PC and workstation clusters, please see
The following is the course materials that I used in previous
year's teaching. It may give you an idea of what will be
covered in the this course. However, there is NO GUARANTEE
that this year's course content and requirements will be
exactly the same as that offered in 1998.
Parallel Computer: The supercomputer that will be used in this
class for practicing parallel programming is the HP Superdome
at the University of Kentucky
High Performance Computing Center. Alternatively, you can
install a copy of MPI on your own computers
Here is an old description of the course.
Supercomputing Technology News
IEEE Computer Society's
ParaScope, a list of parallel computing sites.
On February, 1998, IBM announced the world's first
1000 MHZ chip, three times faster than
Intel's fastest chip. Don't worry about that, your parallel computers
could be even faster.
In May, 1998, Los Alamos built a mail-order
supercomputer and it is among the word's fastest. Take a look at
the new supercomputer, named
The TOP500 List of Supercomputer Sites .
MPI Software Technology, Inc.: a commercial MPI software company.
Beowulf Project at CESDIS.
Take a look at the
Earth Simulator in Japan, the fastest supercomputer on Earth.
Here is a list of parallel scientific computing courses offered at several
On-line study materials on parallel computing:
Last modified on Monday, January 12, 2016.