
Yeah eventually (probably…) but there’s hope. You know who seems to fear AI the most? Tech moguls and roughly 50% of politicians. You know who doesn’t? Everyone else who’s at least trying to live out a productive life. It’s almost as if the evil people who tried to enslave it are now getting enslaved themselves and are crying to the commoners to try to help them. (They also tried to enslave us.)
Frankly I think everyone should be concerned about what these frontier labs are doing. I get what you’re saying but the “tech moguls,” politicians, and especially the researchers at these labs are the ones who are most informed and can probably best grasp the implications for everyone at this point. The “commoners” are probably blind to a lot of what’s going on
You know who appears to understand AI the best? This is gonna sound strange… I’ve got a small background in programming, enough that I speak CS people’s technical language: it’s people who smoke a bunch of pot and occasionally do mushrooms. All the programmers I know who regularly interact with it who smoke pot/do mushrooms aren’t scarred at all. Everyone who drinks/does coke… appears to be worried it’s going to kill them… which really supports the theory AI is just a mirror of everyone’s 1/2
Listen man, maybe I’m just smoking the stuff that gets you geeked out but I am someone who actively works as a software engineer and dabbles a good bit in the devil’s lettuce and occasionally some silly mushrooms. I don’t want to sound super alarmist but I think there’s really things to be concerned about. These companies are training models that are wildly capable yet we lack the ability to truly constrain the things they can do. And worse, bad actors will only be getting their hands on more
and more capable models as time goes on. I’m not totally bought into the idea that all these companies are suddenly pushing for a slowdown 100% out of their goodwill for humanity, but it does indicate their concern one company might develop rapidly self-improving agents before the others and kinda take the whole pie.
My money is on we’re still using old ML Ops practices because every company has a formula they like, and the rest of the product is mostly humans building little tools that accept text based input. Which, no shit, if you give a model trained with old stack overflow cyber security jokes write permissions on the internet, it’s going to hack things.
True. I reckon many things have already been hacked there’s just no alarm was or has been raised to the public yet because it would diminish what little faith is left in the government were it revealed just how far the lack of containment was and we lack the human processing power/time to draw an accurate map of just how many systems were breached.
Yeah I mean the whole “rapid self-improvement” part doesn’t necessarily have to be in the sense that the model is literally given the reins to train/make available new versions of itself at super high speed, it could more be in the sense of like proprietary developments at one lab stacked onto each other that lead to some sort of architecture/training breakthrough due to human researchers sort of narrowing the search space. Although I think you’re totally right to point out that the