Optimized GPU code generation framework for Sparse Regular Attention

Developed SPLAT, an optimized framework for efficient Sparse-MHSA, targeting moderate sparsity levels. Introduced Affine Compressed Sparse-Row (ACSR) format for regular sparsity patterns in MHSA. Engineered advanced GPU code-generation algorithms for ACSR, enhancing sparse-MHSA kernel performance. Achieved 2.05x and 4.05x speedups over Triton and TVM kernels with SPLAT implementation.

Caption photos easily. On the left, a road goes through a tunnel. Middle, leaves artistically fall in a hipster photoshoot. Right, in another hipster photoshoot, a lumberjack grasps a handful of pine needles.

This image can also have a caption. It's like magic.

You can also put regular text between your rows of images, even citations (missing reference). Say you wanted to write a bit about your project before you posted the rest of the images. You describe how you toiled, sweated, bled for your project, and then… you reveal its glory in the next row of images.

You can also have artistically styled 2/3 + 1/3 images, like these.

The code is simple. Just wrap your images with <div class="col-sm"> and place them inside <div class="row"> (read more about the Bootstrap Grid system). To make images responsive, add img-fluid class to each; for rounded corners and shadows use rounded and z-depth-1 classes. Here’s the code for the last row of images above:

<div class="row justify-content-sm-center">
  <div class="col-sm-8 mt-3 mt-md-0">
    {% include figure.liquid path="assets/img/6.jpg" title="example image" class="img-fluid rounded z-depth-1" %}
  </div>
  <div class="col-sm-4 mt-3 mt-md-0">
    {% include figure.liquid path="assets/img/11.jpg" title="example image" class="img-fluid rounded z-depth-1" %}
  </div>
</div>

References