Yuval Noah Harari argues that AI will take over bureaucracies like finance, making systems humans can't understand, so humanity risks becoming the 'cows of the future.'
Key Takeaways
- The greatest AI risk may be loss of understanding and control over financial and bureaucratic systems rather than physical violence.
- Humans are cognitively ill-suited to bureaucracy because it is a very recent invention in evolutionary terms.
- AI's advantage in memory and complexity handling could let it run systems humans can no longer follow.
- Humanity risks becoming subordinate to systems it cannot understand, like cows under human financial markets.
What the video covers
- Cows know humans exist but cannot grasp money, the stock exchange, or the bond market, even though these systems control their lives.
- Harari suggests humans may soon be in the same position relative to AI-run financial systems.
- The near-future threat is not robots attacking streets but AIs taking over financial and bureaucratic systems.
- Bureaucracy is alien to humans because it was invented only in the last 5,000 to 10,000 years, while humans evolved over millions of years.
- Humans were 'born in the forest, not in the office,' making bureaucratic thinking unnatural for them.
- AIs are 'bureaucratic natives' who are born in the office and feel at home in bureaucratic systems.
- An AI banker can remember all of a bank's transactions, which no human can do.
- AIs will create financial and legal systems more sophisticated than humans can understand.
- Within 10 or 20 years, AI-driven financial systems may control human lives in ways people cannot comprehend.
- The central warning is that humans could lose control over the systems that govern their existence.
Full Transcript — Download SRT & Markdown
Speaker A
Cows know that humans exist. They can see us. But cows don't know that money exists.
Speaker A
Like, [clears throat] I can sell you a cow, and you transfer money to my bank account. This is invisible to the cow.
Speaker A
Even if you're an animal rights activist and you try to explain to the cow, "Look, there is this thing called money, and there is the stock exchange, and there is the bond market." How do you explain the bond market to cows? Even though it controls their lives.
Speaker A
What's happening now, or in the near future, is not that AIs will create robots that will come into the streets and shoot us.
Speaker A
The AIs are taking over the financial system. They are taking over all the bureaucracies, because they are bureaucratic natives.
Speaker A
For most of us, bureaucracy is difficult. It is alien, because we are millions of years older than the bureaucracies. Bureaucracies were invented just in the last 5,000 to 10,000 years. We were born in the forest, not in the office. So it's alien to us.
Speaker A
For AIs, bureaucracy is home. They are born in the office. They are bureaucratic natives. No human banker can remember all the transactions of the bank. An AI banker can.
Speaker A
They will take over the bureaucracies, like the financial system, and create much more sophisticated financial and legal systems that we can't understand. So just as cows can't understand the financial system that controls their lives today, we will not be able to understand the AI financial system that will control our lives in 10 or 20 years.
Speaker A
Which means that we are the cows of the future.
Speaker A
We are the cows of the future.
Topics:Yuval Noah Harariartificial intelligencebureaucracyfinancial systemAI riskfuture of humanitycontrolautomationbond marketphilosophy











