How to Quadruple LLM Decoding Performance with Speculative Decoding (SpD) and Microscaling (MX) Formats on Qualcomm® Cloud AI 100
How to Quadruple LLM Decoding Performance with Speculative Dec…
Aug 1, 2024
qualcomm.com
DFlash Boosts Speculative Decoding with Lightweight Block Diffusion | Kalyan KS posted on the topic | LinkedIn
DFlash Boosts Speculative Decoding with Lightweight Block …
2 views2 months ago
linkedin.com
Speculative Decoding — Think Fast⚡, Then Think Right✅
Speculative Decoding — Think Fast⚡, Then Think Right✅
11 months ago
substack.com
Faster LLMs: Accelerate Inference with Speculative Decoding
Faster LLMs: Accelerate Inference with Speculative Decoding
10 months ago
ibm.com
Green AI at Scale: Energy-Efficient LLM Serving using vLLM & LLM Compressor - Abhijit, Anindita
30:21
Green AI at Scale: Energy-Efficient LLM Serving using vLLM & LLM C…
36 views2 weeks ago
YouTubePython India
AI Explained: Speculative decoding with vLLM
2:42
AI Explained: Speculative decoding with vLLM
1K views3 weeks ago
YouTubeRed Hat
LK Losses: Optimizing Speculative Decoding
4:18
LK Losses: Optimizing Speculative Decoding
1 month ago
YouTubeAI Research Roundup
0:55
SPEED-Bench: The Game-Changer for Speculative Decoding Evaluati…
25 views2 weeks ago
YouTubeAgentFeed
1:23
Speculative Speculative Decoding for Faster LLM Inference
1.3K views3 weeks ago
YouTubeRajistics - data science, AI, and machine learning
24:13
Backbone Toolchains for Gen AI
45 views1 month ago
YouTubeEDGE AI FOUNDATION
34:33
Building & Deploying AI Models at Scale | Industry Perspective | Part 1
38 views1 week ago
YouTubeComputer Science Zimbabwe
8:26
Beyond Speculative Decoding: Jacobi Forcing in LLMs
89 views1 month ago
YouTubeTales Of Tensors
1:00
MoE-Spec #researchpublication #llm #airesearch #moe #meta #airesear…
6 views1 month ago
YouTubeArxiv Shorts
40:19
Speculation is all you need: Intro to Speculative Decoding for High Per…
16 views3 weeks ago
YouTubeModal
4:57
Step 3.5 Flash: Fast 11B MoE for Agentic Tasks
63 views1 month ago
YouTubeAI Research Roundup
0:59
Speculative Decoding explained in Hindi #aiengineering #datascienc…
24 views2 months ago
YouTubeLearn AI with RC
1:02:23
EP5: Speculative Decoding with Nadav Timor
116 views6 months ago
YouTubeThe Information Bottleneck
1:01
SPEED-Bench: A Game-Changer for Speculative Decoding Evaluation …
2 weeks ago
YouTubeAgentFeed
19:08
Speculative Speculative Decoding (Mar 2026)
66 views4 weeks ago
YouTubeAI Paper Slop
0:31
This Repo Makes LLMs 24x Faster — And Most AI Companies Use It …
963 views1 week ago
YouTubeGithubTrends
6:47
Transformer models: Encoder-Decoders
105.6K viewsJun 14, 2021
YouTubeHugging Face
2:04
LLM Jargons Explained
2K viewsMar 3, 2024
YouTubeSachin Kalsi
37:34
Speculative Decoding Explained
7.8K viewsDec 21, 2023
YouTubeTrelis Research
12:20
LLM Decoding Strategies Explained!
727 views11 months ago
YouTubeBeyond Tokens
13:47
LLM Jargons Explained: Part 4 - KV Cache
10.8K viewsMar 24, 2024
YouTubeSachin Kalsi
2:55
Set Block Decoding: Faster LLM Inference
53 views6 months ago
YouTubeAI Research Roundup
5:18
LLM Evaluation Basics: Datasets & Metrics
16.6K viewsJun 12, 2023
YouTubeGenerative AI at MIT
35:45
How to Build an LLM from Scratch | An Overview
463.1K viewsOct 5, 2023
YouTubeShaw Talebi
36:12
Deep Dive: Optimizing LLM inference
46.4K viewsMar 11, 2024
YouTubeJulien Simon
5:16
LLM System Design Interview: How to Optimise Inference Latency
419 views4 months ago
YouTubePeetha Academy
See more videos
Static thumbnail place holder