Shashank Shekhar

      • AllGather
      • AllReduce
      • AllToAll
      • Bandwidth
      • BFloat16 (Brain Floating Point)
      • Compute-Bound
      • FLOPs (Floating Point Operations)
      • FLOPs (Floating Point Operations)
      • GPU (Graphics Processing Unit)
      • Memory-Bound
      • MXU (Matrix Multiply Unit)
      • Numba
      • ReduceScatter
      • Roofline Model
      • Sharding
      • Systolic Array
      • TPU (Tensor Processing Unit)
      • VMEM (Vector Memory)
        • Chapter 2 Heterogeneous Data Parallel Computing Exercise Solutions
        • Chapter 3 Multidimensional Grids and Data Exercise Solutions
        • Chapter 4 Compute Architecture and Scheduling Exercise Solutions
        • Chapter 5 Memory Architecture and Data Locality Exercise Solutions
        • Chapter 6 Performance Considerations Exercise Solutions
        • Chapter 7 Convolution Exercise Solutions
        • Chapter 1 Introduction Notes
        • Chapter 2 Heterogeneous Data Parallel Computing Notes
        • Chapter 3 Multidimensional Grids and Data Notes
        • Chapter 4 Compute Architecture and Scheduling Notes
        • Chapter 5 Memory Architecture and Data Locality Notes
      • Drawing 2025-03-28 13.46.45.excalidraw
      • Scaling Book Part 0. Introductions
      • Scaling Book Part 1. All About Rooflines
      • Scaling Book Part 1. All About Rooflines Exercises
      • Scaling Book Part 2. How to Think About TPUs
      • Scaling Book Part 2. TPU Questions
      • Scaling Book Part 3 - Sharding Questions
      • Scaling Book Part 3. Sharded Matrices and How to Multiply Them
      • PEFT Review by Xu et al, Dec 2023
      • Speculative Decoding (DeepMind) by Chen et al 2023
      • Speculative Decoding (Google Brain) by Leviathan et al 2023
      • MiniTorch
      • 5 Apr, 2025 Readings
      • 7 April, 2025 Readings
      • 8 April, 2025 Readings
      • 9 April, 2025 Readings
      • 10 March, 2025 Readings
      • 11 March, 2025 Readings
      • 12 March, 2025 Readings
      • 13 March, 2025 Readings
      • 14 April, 2025 Readings
      • 14 March, 2025 Readings
      • 14 March, 2025 Readings
      • 16 March, 2025 Readings
      • 17 April, 2025 Readings
      • 17 March, 2025 Readings
      • 18 April, 2025 Readings
      • 18 March, 2025 Readings
      • 19 March, 2025 Readings
      • 20 March, 2025 Readings
      • 21 April, 2025 Readings
      • 21 March, 2025 Readings
      • 22 April, 2025 Readings
      • 22 March, 2025 Readings
      • 24 April, 2025 Readings
      • 24 March, 2025 Readings
      • 25 April, 2025 Readings
      • 25 March, 2025 Readings
      • 26 March, 2025 Readings
      • 27 April, 2025 Readings
      • 27 March, 2025 Readings
      • 28 March, 2025 Readings
      • 29 March, 2025 Readings
      • 30 March, 2025 Readings
      • 31 March, 2025 Readings
        • CUDAvMetal
        • Optimizing a Metal Matmul kernel for 5TFLOPs+ performance on my M1 Max
      • Machine Learning Compilation Course
    Home

    ❯

    Reading List

    Reading List

    Stuff I Read Everyday.

    33 items under this folder.

    • Apr 27, 2025

      27 April, 2025 Readings

      • Apr 25, 2025

        25 April, 2025 Readings

        • Apr 24, 2025

          24 April, 2025 Readings

          • Apr 22, 2025

            22 April, 2025 Readings

            • Apr 21, 2025

              21 April, 2025 Readings

              • Apr 18, 2025

                18 April, 2025 Readings

                • Apr 17, 2025

                  17 April, 2025 Readings

                  • Apr 14, 2025

                    14 April, 2025 Readings

                    • Apr 09, 2025

                      9 April, 2025 Readings

                      • Apr 08, 2025

                        8 April, 2025 Readings

                        • Apr 07, 2025

                          7 April, 2025 Readings

                          • Apr 05, 2025

                            5 Apr, 2025 Readings

                            • Mar 31, 2025

                              31 March, 2025 Readings

                              • Mar 30, 2025

                                30 March, 2025 Readings

                                • Mar 29, 2025

                                  29 March, 2025 Readings

                                  • Mar 28, 2025

                                    28 March, 2025 Readings

                                    • Mar 27, 2025

                                      27 March, 2025 Readings

                                      • Mar 26, 2025

                                        26 March, 2025 Readings

                                        • Mar 25, 2025

                                          25 March, 2025 Readings

                                          • Mar 24, 2025

                                            24 March, 2025 Readings

                                            • Mar 22, 2025

                                              22 March, 2025 Readings

                                              • Mar 21, 2025

                                                21 March, 2025 Readings

                                                • Mar 20, 2025

                                                  20 March, 2025 Readings

                                                  • Mar 19, 2025

                                                    19 March, 2025 Readings

                                                    • Mar 18, 2025

                                                      18 March, 2025 Readings

                                                      • Mar 17, 2025

                                                        17 March, 2025 Readings

                                                        • Mar 16, 2025

                                                          16 March, 2025 Readings

                                                          • Mar 13, 2025

                                                            13 March, 2025 Readings

                                                            • CUDA
                                                          • Mar 13, 2025

                                                            14 March, 2025 Readings

                                                            • CUDA
                                                          • Mar 13, 2025

                                                            14 March, 2025 Readings

                                                            • CUDA
                                                          • Mar 12, 2025

                                                            12 March, 2025 Readings

                                                            • CUDA
                                                          • Mar 11, 2025

                                                            11 March, 2025 Readings

                                                            • MiniTorch
                                                            • Numba
                                                            • Numpy
                                                          • Mar 10, 2025

                                                            10 March, 2025 Readings

                                                            • LORA
                                                            • PEFT
                                                            • CUDA
                                                            • NVCC
                                                            • Quartz

                                                          Created with Quartz v4.4.0 © 2025

                                                          • GitHub
                                                          • Discord Community