Nice to discover Judea Pearl ask a fundamental question. What's an 'inductive bias'?

I crucial step on the road towards AGI is a richer vocabulary for reasoning about inductive biases.
@yudapearl explores the apparent impedance mismatch between inductive biases and causal reasoning. But isn't the logical thinking required for good causal reasoning also not an inductive bias?
An inductive bias is what C.S. Peirce would call a habit. It is a habit of reasoning. Logical thinking is like a Platonic solid of the many kinds of heuristics that are discovered.
The kind of black and white logic that is found in digital computers is critical to the emergence of today's information economy. This of course is not the same logic that drives the general intelligence that lives in the same economy.
Digital computers do not have the inductive biases to navigate the complex and messy world of life. Look around, have you seen a machine with the autonomy of a honey bee? They simply have no grounding in life.
General intelligence emerges out of things that are alive. To construct a synthetic general intelligence requires the kind of algorithm that organically grows itself from the inside out.
Which requires the kind of inductive biases that are organic in nature. https://t.co/64gYeKBtI2
So what this reveals is that an inductive bias is an emergent feature of a complex process. Just like the wetness of water. It is interesting to identify these biases, but they aren't the process themselves. They are how we describe the process.
Things that our brains can identify are things that exhibit recurring patterns. We feel the wetness of water because that wetness repeats itself every time we feel water. This causation invariance in nature forges the causality reasoning necessary for navigating a messy world.
An inductive bias is the identifiable recurring thought process (i.e. habits) the brain has developed in the process of its own constructive development while growing into this world.
This said one should never mistake the map from the actual territory. A cognitive bias developed by too many is to confuse the two.
@threadreaderapp unroll

More from Carlos E. Perez

More from For later read

You May Also Like

1/ Some initial thoughts on personal moats:

Like company moats, your personal moat should be a competitive advantage that is not only durable—it should also compound over time.

Characteristics of a personal moat below:


2/ Like a company moat, you want to build career capital while you sleep.

As Andrew Chen noted:


3/ You don’t want to build a competitive advantage that is fleeting or that will get commoditized

Things that might get commoditized over time (some longer than


4/ Before the arrival of recorded music, what used to be scarce was the actual music itself — required an in-person artist.

After recorded music, the music itself became abundant and what became scarce was curation, distribution, and self space.

5/ Similarly, in careers, what used to be (more) scarce were things like ideas, money, and exclusive relationships.

In the internet economy, what has become scarce are things like specific knowledge, rare & valuable skills, and great reputations.
Department List of UCAS-China PROFESSORs for ANSO, CSC and UCAS (fully or partial) Scholarship Acceptance
1) UCAS School of physical sciences Professor
https://t.co/9X8OheIvRw
2) UCAS School of mathematical sciences Professor

3) UCAS School of nuclear sciences and technology
https://t.co/nQH8JnewcJ
4) UCAS School of astronomy and space sciences
https://t.co/7Ikc6CuKHZ
5) UCAS School of engineering

6) Geotechnical Engineering Teaching and Research Office
https://t.co/jBCJW7UKlQ
7) Multi-scale Mechanics Teaching and Research Section
https://t.co/eqfQnX1LEQ
😎 Microgravity Science Teaching and Research

9) High temperature gas dynamics teaching and research section
https://t.co/tVIdKgTPl3
10) Department of Biomechanics and Medical Engineering
https://t.co/ubW4xhZY2R
11) Ocean Engineering Teaching and Research

12) Department of Dynamics and Advanced Manufacturing
https://t.co/42BKXEugGv
13) Refrigeration and Cryogenic Engineering Teaching and Research Office
https://t.co/pZdUXFTvw3
14) Power Machinery and Engineering Teaching and Research