AGI Significance Paradox: As progress accelerates towards AGI, the number of people who realize the significance of each new breakthrough decreases.

Why is it that you can boil a frog in water without it jumping out if you gradually increase the temperature?
The problem for the frog is that it does not have the internal models to realize that there is a change in the water temperature. A cold-blooded creature like the frog has its temperature regulated by the external environment.
To recognize change, an agent must have an internal model of reality that is able to recognize this change. Unfortunately, a majority of the population do not have good models of human general intelligence.
In fact, even the simplistic dual-process model of system 1 and system 2 is not very well known.
Recent big developments was muZero, AlphaFold2, GPT-3 and Dall-E. GPT-3 did receive a lot of attention, but the other 3 likely have not. To understand muZero and AlphaFold2 requires a high level of expertise. Dall-E is actually like GPT-3 but it's more difficult to grasp.
We are going to continue to get these incremental developments for several years. But the audience that recognizes its importance will continue to decline. Then suddenly, boom... we get to AGI and most people will be in shock. Shocked because they thought there was no progress.
The quantum leaps (punctuated) in evolution is a consequence of many incremental developments that accrue. It is only when the final piece in the jigsaw puzzle is found when the revolution is expressed.
But it takes unusual expertise to know that we are accelerating towards AGI. The problem is that it is not obvious how human intelligence actually works. We simply do not know what it means to 'understand'.
Ask most AGI researchers, philosophers or psychologists as to what it means to 'understand'. They will be stumped to give you a good answer.
So if we do not know this answer, then how can we recognize that the water's temperature is gradually increasing?
The number of people who might know continues to diminish. This implies collectively that we know less and less. When AGI happens, it will come as a shock. It is as if, nobody had anticipated it.
@threadreaderapp unroll

More from Carlos E. Perez

It's a very different perspective when we realize that our bodies consist of an entire ecology of bacteria and viruses that are also passed to our ancestors. Mammals rear their young and as a consequence transfer the microbiome and virome to their offspring.


What does it mean to treat our individuality as ecologies? We are all ecologies existing in other ecologies. Nature is constantly performing a balancing act across multiple scales of existence.

There are bacteria and viruses that are unique to your ancestry as that of your own DNA. They have lived in symbiosis with your ancestor and will do so for your descendants.

It is an empirical fact that the microbiome in our stomach can influence not only our own moods but also our metabolism and thus our weight and health.

It is also intriguing to know that brains evolved out of stomachs and that our stomachs contain hundreds of millions of neurons. Humans can literally think with their gut.
Nice to discover Judea Pearl ask a fundamental question. What's an 'inductive bias'?


I crucial step on the road towards AGI is a richer vocabulary for reasoning about inductive biases.

explores the apparent impedance mismatch between inductive biases and causal reasoning. But isn't the logical thinking required for good causal reasoning also not an inductive bias?

An inductive bias is what C.S. Peirce would call a habit. It is a habit of reasoning. Logical thinking is like a Platonic solid of the many kinds of heuristics that are discovered.

The kind of black and white logic that is found in digital computers is critical to the emergence of today's information economy. This of course is not the same logic that drives the general intelligence that lives in the same economy.

More from Science

An interesting thing about carp is that they can go into anoxic hibernation and switch to an anaerobic metabolism based on converting glycogen to ethanol.

The waste ethanol is diffused out the gills

https://t.co/V3D1umHf04

Carp can switch over to an anaerobic metabolism and quietly exhale booze until the situation gets better.

They basically evolved the same metabolic pathway as yeast, independently.

In theory, if you spent a few thousand years breeding carp for it, you could use them to make booze.

They'd be enormous, almost entirely glycogen deposits with a fish added as an afterthought.

The really interesting thing about anaerobic carp, is that they can go 4-5 months without oxygen by relying on liver glycogen.

You, a human, have only about 100 grams of glycogen in your liver, about 400 more grams in your skeletal muscles. Call it 500 grams total.

In humans, glycogen is also burned for energy. This is where the marathon runner's bonk comes from: you only have about 2,000 calories worth, and running a marathon burns those 2,000 calories.
💥and so it begins..💥
It's time, my friends 🤩🤩

[Thread] #ProjectOdin


https://t.co/fO90N78fta


new quantum-based internet #ElonMusk #QVS #QFS

Political justification ⏬⏬
#ProjectOdin


#ProjectOdin #Starlink #ElonMusk #QuantumInternet

You May Also Like