NERSCPowering Scientific Discovery for 50 Years

CUDA Shared Memory -- Part 2 of 9 CUDA Training Series, Feb 19, 2020

February 19, 2020


CUDA® is a parallel computing platform and programming model that extends C++ to allow developers to program GPUs with a familiar programming language and simple APIs.

NVIDIA will present a 9-part CUDA training series intended to help new and existing GPU programmers understand the main concepts of the CUDA platform and its programming model. Each part will include a 1-hour presentation and example exercises. The exercises are meant to reinforce the material from the presentation and can be completed during a 1-hour hands-on session following each lecture (for in-person participants) or on your own (for remote participants).  OLCF and NERSC will both be holding in-person events for each part of the series. Please see the topics of each part and dates here

Part 2 of 9:  CUDA Shared Memory

Date and Time: 10 am - 12 pm (Pacific time), Wednesday, February 19, 2020

Shared memory is extremely fast, user-managed, on-chip memory that can be used to share data between threads within a thread block. This can be used to manage data caches, speed up high-performance cooperative parallel algorithms, and facilitate global memory coalescing in cases where it would otherwise not be possible. This module will show you how to allocate and utilize shared memory on the GPU.

After the presentation, there will be a hands-on session where in-person participants can complete example exercises meant to reinforce the presented concepts. Exercises will be made available to all participants (both in-person and remote), and remote participants are welcome to join via Zoom during the hands-on sessions. 


Please register here.  You may choose to attend in person at OLCF (the ORNL site) instead of at NERSC if it is more convenient to you.

In-person and Remote Connection Information

This event will be presented both online and in person at NERSC/LBNL (visitor info) in Berkeley, CA.  The training will be held at Building 59, Room 4102 (CRT Building, aka Wang Hall), from 10 am to 12 pm. 

Presentation Materials 

  • Slides
  • Recording
  • Exercises: The example exercises for this module can be found in the "exercises/hw2" folder of this GitHub repo
  • Survey: Please help us to provide feedback by completing a 3-min short survey (access via the "Survey" tab located in the middle of this page)