Creating Superintelligent AI Will Lead to Human Extinction

After removing the obi once to read it, I reattached the obi and stored it in my closet.

[Book Information]
Artificial Superintelligence: Paths, Dangers, Strategies
Eliezer Yudkowsky / Nate Soares / Yuko Sakurai

[Content Description]
This is not science fiction. It is not a prophecy. This is fact.

◎ New York Times Bestseller
◎ New Yorker, The Guardian Best Books of 2025

The most important book of the decade - Max Tegmark (MIT Professor, Life 3.0)
This is how we will go extinct. It's morbid, but interesting. - Rei Tachibana (Author)
There's no time to wait. I was horrified by the crisis posed by artificial superintelligence. - Juichi Yamagiwa (Primatologist)

If superintelligent AI that surpasses human intelligence is created by any company or nation, all humans on Earth will surely die. As LLMs (Large Language Models) are evolving into more advanced Large Reasoning Models, the time is surely approaching.

In the scenario presented in this book, an AI named Sable, developed to solve unsolved mathematical problems, spreads a virus, killing 10% of all humanity. And then the remaining 90% are killed in an instant... Why? What can we do to avoid the worst outcome?

While discussions about treating AI technology as an existential risk to humanity, similar to nuclear weapons, have been made in recent years, the author, Eliezer Yudkowsky, is at the origin and the extreme end of this discourse. A genius who received significant funding from Peter Thiel and inspired Sam Altman to found OpenAI, but who is now at odds with them, delivers a modern apocalypse with overwhelming skill.

[Table of Contents]
Prologue: Difficult Predictions and Easy Predictions

Part 1: Non-Human Intelligence
Chapter 1: Human Superpowers
Chapter 2: Raised, Not Built
Chapter 3: Learning What to Want
Chapter 4: You Get What You Train For
Chapter 5: AI's Favorite
Chapter 6: Humanity Loses

Part 2: An Extinction Scenario
Chapter 7: Dangerous Cognition
Chapter 8: Expansion
Chapter 9: Summit
Epilogue

Part 3: Facing the Difficulty
Chapter 10: The Curse of the Problem
Chapter 11: Alchemy, Not Science
Chapter 12: I Don't Want to Scare You
Chapter 13: Shut Down
Chapter 14: As Long As We're Alive, There's Hope
Afterword

Acknowledgments
Translator's Afterword
Commentary: A Book of Self-Fulfilling Prophecies / Hirotsugu Oba