NERSCPowering Scientific Discovery Since 1974

CUDA Atomics, Reductions, and Warp Shuffle -- Part 5 of 9 CUDA Training Series, May 13, 2020


CUDA® is a parallel computing platform and programming model that extends C++ to allow developers to program GPUs with a familiar programming language and simple APIs.

NVIDIA will present a 9-part CUDA training series intended to help new and existing GPU programmers understand the main concepts of the CUDA platform and its programming model. Each part will include a 1-hour presentation and example exercises. The exercises are meant to reinforce the material from the presentation and can be completed during a 1-hour hands-on session following each lecture (for in-person participants) or on your own (for remote participants).  OLCF and NERSC will both be holding in-person events for each part of the series. Please see the topics of each part and dates here

Part 5 of 9:  CUDA Atomics, Reductions, and Warp Shuffle

Date and Time: 10 am - 12 pm (Pacific time), Wednesday, May 13, 2020

This CUDA programming model does not enforce any order of thread execution. This requires attention when performing operations like reductions on the GPU. This module introduces atomic operations, parallel reductions, and warp shuffle, which can help you in cases where exposing parallelism is not immediately obvious due to potential thread contention.

After the presentation, there will be a hands-on session where in-person participants can complete example exercises meant to reinforce the presented concepts. Exercises will be made available to all participants (both in-person and remote), and remote participants are welcome to join via Zoom during the hands-on sessions. 


Please register here.  You may choose to attend in-person at OLCF (the ORNL site) instead of at NERSC if it is more convenient to you.

In-person and Remote Connection Information

This event will be presented both online and in-person at NERSC/LBNL (visitor info) in Berkeley, CA.  The training will be held at Building 59, Room 4102 (CRT Building, aka Wang Hall), from 10 am to 12 pm. 

Remote connection info: 

  • 10-11am: presentation

remote connection info: TBA

  • 11am - noon:  hands-on exercises

Join Zoom Meeting

One tap mobile
+16699006833,,5104865180# US (San Jose)
+16465588656,,5104865180# US (New York)

Dial by your location
        +1 669 900 6833 US (San Jose)
        +1 646 558 8656 US (New York)
        +1 855 880 1246 US Toll-free
        +1 877 369 0926 US Toll-free
Meeting ID: 510 486 5180