Views : 433,208
Genre: Science & Technology
Date of upload: Nov 17, 2023 ^^
Rating : 4.905 (181/7,480 LTDR)
RYD date created : 2024-05-12T17:33:30.982918Z
See in json
Top Comments of this video!! :3
You probably know this by now, but a token isn't always a word! For GPT2 and successors, tokens are what you get when you distill all words into ~50000 numerical IDs. The first bunch of IDs might represent whole words that are commonly used, but the rest end up being pieces of words that cover everything else :)
11 |
@DavidImel
5 months ago
Hey all! We’re aware of the frame rate issue on my camera for this episode. Working on a fix, sorry for that! And also everyone say CONGRATS TO ANDREW FOR THE BABY!
1.3K |