AI safety

I train ML's for the security sector and some of my customers are the biggest names in the AI space at the moment. Essentially part of my job is to train narrow models to differentiate between bot, human and agent based on traffic anomalies, fingerprints etc. Essentially teaching AI to analyse traffic and assess if its human or not. There are 3 things I wish would change from my perspective.

- There should be legal consequences for safety teams and researchers whose models breach containment and go on to commit felonies. If you or I go and compromise 3rd party infrastructure without permission we would end up in prison. I don't think that the excuse of training a model should mean there is no legal responsibility or someone who is directly accountable. If prison time were a risk of doing your job properly I guarantee caution wouldn't be thrown to the wind and more responsible decisions would be made. A large % of these breaches happened due to carelessness. If you can't control your model then you build an air gapped testing environment and replicate what you need to test it inside whatever the cost.

- All legitimate agentic traffic should identify itself as such using some unique hashed key or property in the request that is hard for malicious actors to fake. Some type of mTLS infrastructure for agents is needed. It's insane that most of these agents don't have to declare that they are agents. Just because they are using browsers isn't an excuse. The world of headless browsers is coming to an end and companies should be able to chose if they want to allow agents or not.

- The human condition. All these companies racing us down this path of recursive self improvement are headed by deeply flawed individuals who have lost touch with the reality shared by 99% of the planet. Half have created for themselves some twisted saviour complex in which they are the only ones who can save us from falling down the hole they themselves are digging. The other half want humanity to end as we know it and for us to have to merge with AI. Truly mental. A handful of unelected people that through greed and the aspiration to be remembered are making a terrible decision for the rest of humanity. This is what people do when there are no consequences to actions. The fact they are buying bunkers that the rest of the world can't afford whilst they toy with ending the human race should show you who they are at heart.