Andrej Karpathy: Intro to Large Language Models
Intro to Large Language Models
This is a 1 hour general-audience introduction to Large Language Models: the core technical component behind systems like ChatGPT, Claude, and Bard. What they are, where they are headed, comparisons and analogies to present-day operating systems, and some of the security-related challenges of this new computing paradigm.
As of November 2023 (this field moves fast!).
Context: This video is based on the slides of a talk I gave recently at the AI Security Summit. The talk was not recorded but a lot of people came to me after and told me they liked it. Seeing as I had already put in one long weekend of work to make the slides, I decided to just tune them a bit, record this round 2 of the talk and upload it here on YouTube. Pardon the random background, that's my hotel room during the thanksgiving break.
资深庸才
LLM
(9/9)
1458播放 
简介
简介
Quantization in Deep Learning (LLMs)
Quantization in Deep Learning (LLMs)
13:04
The 5 Levels Of Text Splitting For Retrieval
1:09:00
Speculative Decoding: When Two LLMs are Faster than One
12:46
The KV Cache: Memory Usage in Transformers
08:34
What is Low-Rank Adaptation (LoRA) | explained by the inventor
07:29
QLoRA—How to Fine-tune an LLM on a Single GPU (w/ Python Code)
36:58
LLaMA explained: KV-Cache, Rotary Positional Embedding, RMS Norm, Grouped Query
1:10:55
Q* - Clues to the Puzzle?
27:45
Andrej Karpathy: Intro to Large Language Models
59:48
顶部