leetGPU
CUDA kernels written from scratch, from matrix multiplication to an online softmax.
LeetGPU is a set of GPU programming challenges. I solve them on my own time: element-wise kernels (ReLU, SiLU, SwiGLU), matrix addition, multiplication and transpose, a 1D convolution, a parallel reduction and an online softmax.
- kernels
- ~20
About 20 kernels so far, all on GitHub.