In this last episode of the companion podcast for the C++ course at UCL, I invited both Klaus Iglberger and Marc Hartung (Dive, Berlin) to go through some aspects of parallel computing. But also to look a little bit ahead of what's in store for C++ in future standards. And how the language may help you in your career.

Links:

• https://www.youtube.com/watch?v=NReDubvNjRg&list=PLY_qIufNHc2-Dk9IVNtgoF4uhKRszjJPz Cpp Conference (Cpp Con) Back to basics YouTube 2023
• https://www.youtube.com/watch?v=VRGRTvfOxb4&list=PLY_qIufNHc2950NLOeUFuO0DsqjAZ6cG0 Cpp Conference (Cpp Con) Back to basics YouTube 2024
• https://cppcast.com/ A podcast dedicated to all things C++
• https://adspthepodcast.com/ ADSP (Algorithms + Data Structures = Programs) Podcast
• https://learning.oreilly.com/library/view/c-software-design/9781098113155/ Klaus Iglberger's book on "C++ Software Design"
• https://blogs.fau.de/hager/hpc-book HPC book with lots of material on parallel computing Georg Hager, Gerhard Wellein

I'd like to thank UCL and the UCL Advanced Research Computing Centre for their support and creating this show. In particular David Perez-Suarez, Michael McLeod and Mashy Green.

Don't be shy - say Hi

This podcast is brought to you by the Advanced Research Computing Centre of the University College London, UK.
Producer and Host: Peter Schmidt

Marc Hartung and I will discuss distributed memory in parallel computing in this episode, with tools like OpenMPI. We also discuss some of the hardware aspects around HPC systems and how shared and distributed memory computations differ.

Links:

• https://www.open-mpi.org OpenMPI homepage
  • https://docs.open-mpi.org/ the docs for OpenMPI
• https://www.mpi-forum.org The MPI Forum (who write the MPI standard)
• http://openshmem.org/site/ OpenSHMEM
• https://en.wikipedia.org/wiki/Distributed_memory summary page on distributed memory
• https://en.wikipedia.org/wiki/InfiniBand InfiniBand network solution
• https://www.nextplatform.com/2022/01/31/crays-slingshot-interconnect-is-at-the-heart-of-hpes-hpc-and-ai-ambitions/ Slingshot network solution
• https://en.wikipedia.org/wiki/Partitioned_global_address_space
• https://www.techtarget.com/whatis/definition/von-Neumann-bottleneck the bottleneck named after John von Neumann
• https://en.wikipedia.org/wiki/Floating_point_operations_per_second overview of FLOPS (floating point operations per second)
• https://www.openmp.org/wp-content/uploads/HybridPP_Slides.pdf OpenMP and OpenMPI working together in a hybrid solution
• https://blogs.fau.de/hager/hpc-book Georg Hager/Gerhard Wellein book on HPC for scientists and engineers

Don't be shy - say Hi

This podcast is brought to you by the Advanced Research Computing Centre of the University College London, UK.
Producer and Host: Peter Schmidt

Parallel programming is a huge, exciting and evolving field. Together with my guest Marc Hartung from Dive in Berlin, Germany, we try to cover some aspects of it: including OpenMP, how to synchronise data etc.

Links:

• https://en.cppreference.com/w/cpp/language/memory_model the C++ memory model
• https://www.openmp.org OpenMP home page
• https://www.openmp.org/resources/openmp-compilers-tools/ Compilers for OpenMP
  • https://gcc.gnu.org/projects/gomp/ the GNU OpenMP compiler
• https://en.wikipedia.org/wiki/Amdahl%27s_law Amdahl's "law"
  • https://dl.acm.org/doi/pdf/10.1145/1465482.1465560 the paper from Amdahl
• https://en.wikipedia.org/wiki/Threading_Building_Blocks TBB
  • https://github.com/uxlfoundation/oneTBB GitHub link for TBB
• https://eigen.tuxfamily.org/dox/TopicMultiThreading.html Eigen
• https://help.rc.ufl.edu/doc/Memory:_Shared_vs_Distributed one of the links discussing shared and distributed memory in parallel computing

Don't be shy - say Hi

This podcast is brought to you by the Advanced Research Computing Centre of the University College London, UK.
Producer and Host: Peter Schmidt