Tools
Block-sparse GPU kernels
Listen to Brief
AI audio in English, based on the NadiAI brief and original source.
Daily Audio Digest
Get daily AI news audio on your device.
Install NadiAI for quick access to the 5 latest AI stories each day.
- Tap Enable Alerts and allow notifications from NadiAI.
- If the Install App option appears in the address bar, install NadiAI for faster access.
- If it does not appear, bookmark this page or pin the NadiAI tab.
Brief
We’re releasing highly-optimized GPU kernels for an underexplored class of neural network architectures: networks with block-sparse weights. Depending on the chosen sparsity, these kernels can run orders of magnitude faster than cuBLAS or cuSPARSE. We’ve used them to attain state-of-the-art results in text sentiment analysis and generative modeling of text and images.
Why It Matters
Pecutan prestasi ini mempercepat latihan dan inferens model besar, menjimatkan masa dan sumber pengkomputeran untuk aplikasi NLP dan generatif.