"It Usually Doesn't End Well for the Less Intelligent Species..."

I believe you'll hear me say this often on this site, but Mark Zuckerberg and Silicon Valley's strategy of "Move fast and break things," is not acceptable when it comes to a technology that could end us.

In the Bloomberg interview at Davos with Yuval Noah Harari and Max Tegmark linked below, Harari said "It usually doesn't end well for the less intelligent species when the more intelligent species comes along." Scary and sad, but true.

Harari reiterates that we're introducing a new, alien intelligence. We'll have no clue what this intelligence will find important or what it will need to achieve its goals, but its goals will almost certainly not align with human desires and needs. This alignment problem is one of the main issues to solve, and it is not an easy problem.

Tegmark discusses how the latest versions of AI pass the Turing test, which he said was Alan Turing's warning test to show we're very close to a point where AI can surpass human intelligence.

Tegmark also says it's a huge mistake to think it is a given that AI will surpass human intelligence before the alignment problem, which is a hard problem that may not even be solvable, is resolved. We have a role to play in when and whether super intelligent AI is created.

According to Tegmark, safety standards for AI development have to be created and enforced. We have them for restaurants, and hospitals, and nuclear reactors. We have to formulate them for AI development.

Check out the interview if it's of interest and think about the risks and what you can do to help or get the word out about the risk of super intelligent AI.