We’ve developed the Sparse Transformer, a deep neural network which sets new records at predicting what comes next in a sequence — whether text, images, or sound. It uses an algorithmic improvement of the attention mechanism to extract patterns from sequences 30x longer than possible previously. Read more: https://openai.com/blog/sparse-transformer/ | OpenAI
0:27
We’ve developed the Sparse Transformer, a deep neural networ…
7.9K viewsApr 23, 2019
FacebookOpenAI
Giannis Daras: Improving sparse transformer models for efficient self-attention (spaCy IRL 2019)
20:14
Giannis Daras: Improving sparse transformer models for efficient s…
3.2K viewsJul 12, 2019
YouTubeExplosion
13x FASTER Video Generation - Sparse Linear Attention Diffusion Transformer
10:25
13x FASTER Video Generation - Sparse Linear Attention Diffusion …
903 views4 months ago
YouTubeVuk Rosić
Longformer: The Long-Document Transformer
26:36
Longformer: The Long-Document Transformer
26K viewsApr 20, 2020
YouTubeYannic Kilcher
The Sparse Frontier: Sparse Attention Trade-offs in Transformer LLMs (Apr 2025)
20:56
The Sparse Frontier: Sparse Attention Trade-offs in Transform…
69 views8 months ago
YouTubeAI Paper Slop
Three-phase transformer connections and vector groups for beginners
Three-phase transformer connections and vector groups fo…
Sep 19, 2016
electrical-engineering-portal.com
Fast Transpose of Sparse Matrix - LABxRIT
2:51
Fast Transpose of Sparse Matrix - LABxRIT
23.8K viewsJul 2, 2022
YouTubeIshan Dubey
5:50
ICCV Introduction Videos: SP2T：Sparse Proxy Attention for …
4 views4 months ago
YouTubeWallelWan
Depth-Aware Sparse Transformer for Video-Language Learning | Pro…
Oct 27, 2023
acm.org
16:46
Sparse Attention Vs Self-Attention
470 viewsFeb 15, 2025
YouTubeAI Super Storm
23:54
13. Transpose of Sparse Matrix
17K viewsMay 23, 2021
YouTubeDr. Samaleswari Prasad Nayak
22:32
Transpose of sparse matrix - Lecture 9 | Data Structures | Algori…
5.5K viewsJan 28, 2022
YouTubeLogical Notion
7:40
HySparse Hybrid Sparse Attention Architecture with Oracle Token Se…
1 week ago
YouTubeCosmoX
What is a Transformer? - definition and meaning - Circuit Globe
Sep 11, 2015
circuitglobe.com
7:31
Soft Mixture of Experts - An Efficient Sparse Transformer
5.6K viewsAug 4, 2023
YouTubeAI Papers Academy
11:28
Intro to Sparse Tensors and Spatially Sparse Neural Networks
7.8K viewsApr 7, 2021
YouTubeChris Choy
36:05
[Transformer Survey] #2 Sparse Attention
4.1K viewsAug 4, 2021
YouTube서울대학교 산업공학과 DSBA 연구실
6:26
Sparse Matrix Transpose: Algorithm
26.5K viewsDec 9, 2021
YouTubeCS KTU Lectures
4:52
Lecture 5: How to find the transpose of a sparse matrix given in triplet f…
26.8K viewsJul 18, 2020
YouTubeComputer Engineering made Easy
18:57
Sparse Representation (for classification) with examples!
28.9K viewsMay 28, 2021
YouTubeSteve Brunton
12:08
Sparse Identification of Nonlinear Dynamics for Model Predictive Co…
29.6K viewsJun 11, 2018
YouTubeSteve Brunton
19:48
Lecture 4: How to convert a Sparse Matrix to its Triplet and CSR repre…
7.7K viewsJul 17, 2020
YouTubeComputer Engineering made Easy
17:51
Coarse-to-Fine Sparse Transformer for Hyperspectral Image Reconstr…
71 viewsNov 6, 2023
bilibilihave-done
0:50
Cosmos-Predict2 + NATTEN: World Generation accelerated with Spars…
613 views7 months ago
YouTubeDeep Imagination NVIDIA
10:47
Accelerating Sparse MoE Transformer Layer on FPGA usin…
42 views2 months ago
YouTubeZhiru Zhang
57:07
Sparse is Enough in Scaling Transformers (aka Terraformer) | …
24.1K viewsDec 2, 2021
YouTubeYannic Kilcher
8:30
DSVT: Dynamic Sparse Voxel Transformer with Rotated Sets. (C…
263 viewsJun 1, 2023
YouTubewang haiyang
Video Semantic Segmentation via Sparse Temporal Transformer | Pr…
Oct 17, 2021
acm.org
3:29
What are Sparse Transformers?
1K viewsDec 24, 2023
YouTubeWhat Is It
10:15
The Transformer neural network architecture EXPLAINED. “Attenti…
90.4K viewsJul 5, 2020
YouTubeAI Coffee Break with Letitia
See more videos
Static thumbnail place holder