BabaIsPissed

joined 2 years ago
[–] [email protected] 4 points 1 month ago* (last edited 1 month ago)

We consistently find across all our experiments that, across concepts, the frequency of a concept in the pretraining dataset is a strong predictor of the model’s performance on test examples containing that concept. Notably, model performance scales linearly as the concept frequency in pretraining data grows exponentially

This reminds me of an older paper on how LLMs can't even do basic math when examples fall outside the training distribution (note that this was GPT-J and as far as I'm aware no such analysis is possible with GPT4, I wonder why), so this phenomena is not exclusive to multimodal stuff. It's one thing to pre-train a large capacity model on a general task that might benefit downstream tasks, but wanting these models to be general purpose is really, really silly.

I'm of the opinion that we're approaching a crisis in AI, we've hit a barrier on what current approaches are capable of achieving and no amount of data, labelers and tinkering with architectural minutiae or (god forbid) "prompt engineering" can fix that. My hopes are that with the bubble bursting the field will have to reckon with the need for algorithmic and architectural innovation, more robust standards for what constitutes a proper benchmark and reproducibility at the very least, and maybe, just maybe, extend its collective knowledge from other fields of study past 1960's neuroscience and explore the ethical and societal implications of your work more deeply than the oftentimes tiny obligatory ethics section of a paper. That is definetly a overgeneralization, so sorry for any researchers out here <3, I'm just disillusioned with the general state of the field.

You're correct about the C suites though , all they needed to see was one of those stupid graphs that showed line going up, with model capacity on the x axis and performance on the y axis, and their greed did the rest.

[–] [email protected] 22 points 1 month ago* (last edited 1 month ago) (2 children)

There is a disconnect between what computer scientists understands as AI and what the general public understands as AI. This was previously not a problem, nerds give confusing names to stuff all the time, but it became a problem after this latest hype cycle where incurious laypeople are in charge of the messaging (or in a less charitable interpretation, benefit from fear of the singularity™). Doesn't help that scientific communication is dogshit.

[–] [email protected] 3 points 7 months ago (1 children)

got the Samsung buds pro 2 at half price recently and I kind of like them, but they were a bit underwhelming even at that price. I've never spent a lot on audio in general, so they were actually a big improvement, but there was no "wow" factor or anything. Plus having to install bloatware that asks for all permissions under the sun sucks (why the fuck would a settings menu want to know my location???).

I do think you underestimate how nice the noise cancelation can be though. I moved to a big city and my hick ass cannot deal with all the fucking noise. Plus I'm clumsy and end up getting wires caught on everything, which means wire stuff also becomes e-waste fairly quickly.

[–] [email protected] 2 points 9 months ago (1 children)

It reads as parody so much that I was actually kind of enjoying it. I mean the scene with the Teslas crashing, Havana Syndrome, "Death to America, I remember it from the videogame", the 13 year old girl quoting West Wing, all the nonsense pontificating about random bullshit like Friends, the camera zooming and twisting for no discernible reason, I thought I was picking up on some deep contempt for lib neurosis and vapidness and it got a laugh out of me a couple of times. Pausing it to check out who made it was a mistake, soured the rest of the thing. It might have been ruined by the runtime anyway so no big loss.

[–] [email protected] 5 points 9 months ago

the ice levels in Spelunky HD are my least favorite, but this track almost makes up for all the stupid UFOs crashing into me from out of screen

[–] [email protected] 11 points 9 months ago

The video consists of like 2 hours of some examples of youtube plagiarism, with discussion of content mills and the beginning of an interesting point about how plagiarists view the people they steal from as lesser, which is not expanded upon as much as it should IMO.

The other 2 hours are about James Somerston, a gay video essayist that basically Frakensteined a bunch (if not all) of his videos from queer authors, some well known, a lot of them not. By the end Hbomb makes a good point about erasure, and how young queer people don't understand their history in part because of people like Somerston.

I'm generally not annoyed by length since I'm a zoomer and watch everything at 2x or more, but in this case I get the point because it actually took me 2 real time hours to watch and I felt there was a lot that could have been cut. I still won't watch the 3 hour scorcese movie, fuck all of you, movies ARE too long now.

I went on a ramble about the video that should probably be a separate comment, feel free to ignore

So regarding video length I think there's some value in going into detail about how plagiarism takes place. Some of this context is also relevant as a way to preempt any shitty response (for example he took the time to explain that Somerston's assistant writer is most likely not in on it and how his boss has shown signs of setting him up as a scapegoat).

He also seems to genuinely care about James's plagiarism because he's bi himself. I'm currently having a bout of insomnia, and was reading The Gentrification of the Mind before making the mistake of opening hexbear and seeing a new hbomb video was out, and while these two are not comparable in content, I found it interesting to experience them back to back, and since a bit of the vibe is there, I believe Harris is sincere about why he cares about it (also Vito Russo's name popped up in both, so I guess this is a sign that I should add The Celluloid Closet to my reading list).

However, the video does feel petty. Hbomb has this mean streak to him that served him really well when he was directly responding to right wing talking points, but is a lot less useful when talking about stuff like this, which becomes a problem when it's a large chunk of the video. He kind of recognizes it too, saying this feels like a drama video, and how he's donating all ad revenue to people James plagiarized from.

It does feel more appropriate when you consider that most of these people are reactionary pieces of shit and that should have been a much larger part of the video. He mentions it a bit (the first guy is a chud, internet historian tries to hide that he's a chud, Somerston came from business school and seems to hate women) and talks about contempt for the people they copy from, but I feel there's a lot more to dig into. What about contempt for the audience? What is the frame of mind of people that trend chase for years, sometimes decades, in order to garner an audience? That think regurtitating Wikipedia is worthy of other people's time? He says it was always like this mentioning AVGN copycats, but was it really? While the incentive structure didn't change how plagiarism takes place, didn't the kind of people that did the plagiarizing change? I think exploring this thoroughly is a lot more interesting than "showing the receipts" by comparing the copied work to the original for most of the runtime.

I still think it was worth a watch, but that's because I was already familiar with Somerston and some of the other people and they gave me the video essay equivalent of the ick. This should have been 2 hours at most.

[–] [email protected] 5 points 10 months ago (1 children)

doing that as well, but asking here can't hurt right?

 

So, I've started working my first "real job" last month, and it's pretty decent. Good benefits, decent pay, strong union despite being tech, and for reasonable hours (6 per day). The problem is that I took this job mainly so I can continue grad school. Currently I'm finishing up my master's, so I'm managing to conciliate doing both OK since I don't need to be in uni premises for anything anymore, but I'm unsure about being able to do a PhD later.

I figure once I work for a few months and get to work remote for most of the week I can do 6 hours of office work plus 6 hours of research work, or alternatively 6 + 4 and compensate by doing some research on the weekends. However I've heard conflicting feedback about this plan. One of my roommates says this is a horrible idea and that I'll become the Joker after a couple months, while one of my coworkers said I should wait a bit to see if this job won't demand too much of me (still in training currently), but that he thinks it's doable. Both are currently doing/have done a PhD at the same uni I want to enroll in. Also is 6ish hours per day even enough for a PhD?

Additional info: Public latam uni, so no tuition but the government grants are nothing to write home about (before getting the job it was barely enough to get by, and that was with help from my folks). The advisor I'm aiming for can be demanding at times but is also really nice and is new faculty. The PhD is in compsci (ML/NLP) and I plan to continue exploring a niche I'm already familiar with. Work schedule is fairly flexible, save for the fucking meetings (agile delenda est). A lot of credits can be done by getting good publications instead of doing uni courses.

Edit: Thanks everyone! I kind of feared "obviously no you moron" would be the general consensus. I probably got too optimistic about getting to keep doing research immediately. I'll wait for things to settle down and reevaluate my options. There's some mechanisms at the job that are supposedly designed so you can continue education, but my impression is that those are mostly reserved for MBA types, infrequently offered and also really contested, but I should ask around some more to be sure. I also know some better sources of funding are available once you enroll, but seeing my friend applying for those and failing repeatedly discourages me from betting on it. Worst comes to worst I'll save up some money, try doing this for a bit and quit if it proves unsustainable. Again, thanks for the input!

[–] [email protected] 29 points 10 months ago

The only guy I have on my friends list that plays this stuff is definetly not afraid to let others know, he does extensive reviews of every datable girl in a given game. visible-disgust but also entertaining to read/make fun of sometimes.

[–] [email protected] 57 points 10 months ago (7 children)

There is no deeper understanding about the issues they are marching for. It is all just slogans.

projection . I don't understand how people who don't know shit don't just shut the fuck up until they learn more.

I'm sick of simulation theory as well and want something cooler to take its place. Maybe Gnosticism?

[–] [email protected] 1 points 10 months ago

They do once their depression gets better though? Anhedonia, loss of interest/libido/attention/whatever the fuck else are symptoms of depression. I'm all for self-improvement, my own mental health improved greatly as a result of trying to improve myself, to the point I consider myself no longer depressed. But we're social creatures and no one builds self-confidence and mental resilience in a vacuum. It's often up to the depressed person to put themselves out in situations where this can happen, but sometimes it does not work out for whatever reason and the whole thing is a long process. In this situation self-compassion is a lot better than telling yourself you're a sack of shit.

Also, isn't the interesting life thing all backwards? If you like a person you get curious and find them interesting. If I like a guy I'll find what they are into cool, be it singing, playing chess or knowing a lot about bugs.

No one is owed that kind of attention, but most people are worthy of compassion.

[–] [email protected] 5 points 11 months ago

I started typing a long debatebro paragraph about how Israel is not forced to bomb hospitals because its ego is wounded but a) I suck at convincing people and b) the suggestion of just showing footage is better.

Maybe with captions? "Why should I care if these are 'good victims' like in the West Bank?" " Is this not state terrorism (A.K.A terrorism?)" "The vast majority of Hamas's arsenal is underground, who is this really hurting?". IDK, something snappy to shake them out of the debatebro mentality.

view more: next ›