videos

22755 readers

223 users here now

Breadtube if it didn't suck.

Post videos you genuinely enjoy and want to share, duh. Celebrate the diversity of interests shared by chapochatters by posting a deep dive into Venetian kelp farming, I dunno. Also media criticism, bite-sized versions of left-wing theory, all the stuff you expected. But I am curious about that kelp farming thing now that you mentioned it.

Low effort / spam videos might be removed, especially weeb content.

There is a cytube that you can paste videos into and watch with whoever happens to be around. It's open submission unless there's something important to commandeer it with at the time.

A weekly watch party happens every Saturday (Sunday down under), with video nominations Saturday-Monday, voting Monday-Thursday. See the pin for whatever stage it's currently in.

founded 4 years ago

MODERATORS

[email protected]

A breakdown how how transformer models work (AlexNet, an image classifier) [edit: more about CNNs then transformers, I misunderstood] (www.youtube.com)

submitted 4 months ago* (last edited 4 months ago) by [email protected] to c/[email protected]

4 comments fedilink hide all child comments

A great, slightly more in depth (without being mathy) explanation of transformer models. Mostly talking about AlexNet, an image classifier from 2012. Goes over some history and has some very interesting looks under the hood.

He does use some personifying language for these models, but that's unfortunately the case for most information on the topic.

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 5 points 4 months ago (1 children)

This is mostly about convolution neural networks, which don't really work the same way as transformers. transformers weren't invented until 2017 and they are most like a more complex version of a recurrent neural network (even that is simplifying it)

[–] [email protected] 3 points 4 months ago (1 children)

ohnoes Of course I messed it up. I thought the transformer paper was newer then 2012, but I remembered them being mentioned in the beginning of the video. I should have rewatched to make sure I understood.

[–] [email protected] 3 points 4 months ago

Honestly the video made it sound like CNNs were a part of transformers, so I'd blame the video before yourself