Steve Omohundro on 2011

This AI Prediction was made by Steve Omohundro in 2011.


Predicted time for AGI / HLMI / transformative AI:

(Hover for explanation)Types of advanced artificial intelligence: AGI (AI that can perform many tasks at a human-level), HLMI (more advanced AI that surpasses human intelligence in specific areas), and Transformative AI (AI that could significantly impact society and the world)




Opinion about the Intelligence Explosion from Steve Omohundro:



Flycer’s explanation for better understanding:

Not provided



The future of humanity with AGI / HLMI / transformative AI:

The challenge is to make protective systems powerful enough for safety but not so powerful that they themselves become a problem. I believe that advances in formal verification will enable us to produce systems with provable properties of this type. But I don’t believe this kind of system on its own will be sufficient to deal with the deeper issues of preserving the human spirit.


Flycer’s Secondary Explanation:

The challenge is to create protective systems that are powerful enough for safety but not too powerful. Advances in formal verification can help us create systems with provable properties. However, this kind of system alone is not enough to preserve the human spirit.




Steve Omohundro is a computer scientist and artificial intelligence (AI) researcher. He received his Ph.D. in physics from the University of California, Berkeley in 1985 and has since been working in various fields such as artificial intelligence, computational mathematics, and physics.

Omohundro is particularly known for his work on AI safety and the development of “self-improving” AI systems. He has published numerous research papers and articles on topics such as self-improving AI, machine ethics, and the future of AI. He is also a co-founder of the Machine Intelligence Research Institute (formerly the Singularity Institute for Artificial Intelligence), which is dedicated to researching and ensuring the safety of advanced AI systems.

In addition to his work in AI, Omohundro has also been a pioneer in the field of digital physics, which explores the idea that the universe itself may be a computational system. He has also worked on various other topics such as complex systems, neural networks, and evolutionary algorithms.







Keywords: Protective Systems, Formal Verification, Human Spirit