High Performance Computing

Online Course

Udacity
Go to Udacity
Start Learning
High Performance Computing
  1. What is the course about?
  2. Prerequisites & Facts
  3. Cost, Certificate & Degree
  4. Reviews & Experiences

What is the course about?

High Performance Computing
The course High Performance Computing is an online class provided by Udacity. The skill level of the course is Advanced. It may be possible to receive a verified certification or use the course to prepare for a degree.

The goal of this course is to give you solid foundations for developing, analyzing, and implementing parallel and locality-efficient algorithms. This course focuses on theoretical underpinnings. To give a practical feeling for how algorithms map to and behave on real systems, we will supplement algorithmic theory with hands-on exercises on modern HPC systems, such as Cilk Plus or OpenMP on shared memory nodes, CUDA for graphics co-processors (GPUs), and MPI and PGAS models for distributed memory systems.

Course description
  • High Performance Computing
  • 4 months
  • Offered at Georgia Tech as CS 6220
  • This course is a graduate-level introduction to scalable parallel algorithms. “Scale” really refers to two things: efficient as the problem size grows, and efficient as the system size (measured in numbers of cores or compute nodes) grows. To really scale your algorithm in both of these senses, you need to be smart about reducing asymptotic complexity the way you’ve done for sequential algorithms since CS 101; but you also need to think about reducing communication and data movement. This course is about the basic algorithmic techniques you’ll need to do so.
  • The techniques you’ll encounter covers the main algorithm design and analysis ideas for three major classes of machines: for multicore and many core shared memory machines, via the work-span model; for distributed memory machines like clusters and supercomputers, via network models; and for sequential or parallel machines with deep memory hierarchies (e.g., caches). You will see these techniques applied to fundamental problems, like sorting, search on trees and graphs, and linear algebra, among others. The practical aspect of this course is implementing the algorithms and techniques you’ll learn to run on real parallel and distributed systems, so you can check whether what appears to work well in theory also translates into practice. (Programming models you’ll use include Cilk Plus, OpenMP, and MPI, and possibly others.)
  • Work-Span or Dynamic Multithreading Model
  • Distributed Memory or Network Models
  • Two-Level Memory or I/O Models
  • Intro to the basic algorithmic model
  • Intro to OpenMP, a practical programming model
  • Comparison-based sorting algorithms
  • Scans and linked list algorithms
  • Tree algorithms
  • Graph algorithms, e.g., breadth-first search
  • The basic algorithmic model
  • Intro to the Message Passing Interface, a practical programming model
  • Reasoning about the effects of network topology
  • Dense linear algebra
  • Sorting
  • Sparse graph algorithms
  • Graph partitioning
  • Basic models
  • Efficiency metrics, including “emerging” metrics like energy and power
  • I/O-aware algorithms
  • Cache-oblivious algorithms
  • A “second course” in algorithms and data structures, a la Georgia Tech’sCS 3510-B or Udacity’s Intro to Algorithms
  • For the programming assignments, programming experience in a “low-level” “high-level” language like C or C++
  • Experience using command line interfaces in *nix environments (e.g.,Unix, Linux)
  • Course readiness survey. You should feel comfortable answering questions like those found in the Readiness Survey Course, HPC-0
  • See the Technology Requirements for using Udacity.
Start Learning

Prerequisites & Facts

High Performance Computing

Course Topic

Development, ECMAscript, Web Development

University, College, Institution

Udacity

Course Skill Level

Advanced
see course summary

Course Language

English

Place of class

Online, self-paced (see curriculum for more information)

Degree

Certificate

Start Learning

Degree & Cost

High Performance Computing

To obtain a verified certificate from Udacity you have to finish this course or the latest version of it, if there is a new edition. The class may be free of charge, but there could be some cost to receive a verified certificate or to access the learning materials. The specifics of the course may have been changed, please consult the provider to get the latest quotes and news.
Udacity
High Performance Computing
provided by Udacity
Start Learning

Reviews

[display-frm-data id=”8278″ filter=”1″]

Please select a valid form
Here you can find information, reviews and user experiences for the course “High Performance Computing“. The provider of the course – “Udacity” – will be glad to answer any questions you may have about the class, click here to use the offical support channels. It would be great if you could share your experience of participating in the course – Your honest review will surely help others to choose the right class!
School: Udacity
Topic: Autonomous Flight, Flying Car

More classes & courses

Start E-Learning
Popular courses with huge future potential
Schools & Universities
Learn with some of the best schools of the world
More online courses
Continue being curious & the world is yours
Contact us | Privacy Policy
© 2024 All Rights Reserved