THREAD: My Top 12 Favourite Perceptual Illusions

1. A great example of how expectations guide perception.

2. The horizontal lines in this image are all parallel. https://t.co/Y0o0hd8R15 HT @victoria1skye
3. The circles in this image are all the same colour. https://t.co/H4Prys8l0n
4. This isn't a GIF – the movement is all in your head.
5. This looks two photos of the same road, taken from different angles. But it’s just the same photo twice. https://t.co/pdq0iRynFw
6. We don't directly perceive how light or dark objects are; the perceptual system makes an educated "guess" based on the lightness or darkness of the surroundings. https://t.co/C8VwDBJbYx HT @AkiyoshiKitaoka
7. The Dynamic Ebbinghaus: The orange circle doesn't change size. https://t.co/wReYo1466M
8. The Dynamic Müller-Lyer Illusion: The vertical black, green, and blue lines don't change size. https://t.co/bDyeOKXgbC
9. You can make the train change direction. https://t.co/n8AzuhJx26
10. Rotating Rings: Every time you switch from looking at one wheel to looking at the other, they both change direction. https://t.co/IdAQGgXsJi
11. The Spinning Dancer https://t.co/3GAwtsnVAL

If you look at the dancer on the left and the one in the middle, the one in the middle spins clockwise.

If you look at the dancer on the *right* and the one in the middle, the one in the middle spins counterclockwise.
12. Stare at the centre of the top image for 20 seconds then look at the bottom image...

More from All

How can we use language supervision to learn better visual representations for robotics?

Introducing Voltron: Language-Driven Representation Learning for Robotics!

Paper: https://t.co/gIsRPtSjKz
Models: https://t.co/NOB3cpATYG
Evaluation: https://t.co/aOzQu95J8z

🧵👇(1 / 12)


Videos of humans performing everyday tasks (Something-Something-v2, Ego4D) offer a rich and diverse resource for learning representations for robotic manipulation.

Yet, an underused part of these datasets are the rich, natural language annotations accompanying each video. (2/12)

The Voltron framework offers a simple way to use language supervision to shape representation learning, building off of prior work in representations for robotics like MVP (
https://t.co/Pb0mk9hb4i) and R3M (https://t.co/o2Fkc3fP0e).

The secret is *balance* (3/12)

Starting with a masked autoencoder over frames from these video clips, make a choice:

1) Condition on language and improve our ability to reconstruct the scene.

2) Generate language given the visual representation and improve our ability to describe what's happening. (4/12)

By trading off *conditioning* and *generation* we show that we can learn 1) better representations than prior methods, and 2) explicitly shape the balance of low and high-level features captured.

Why is the ability to shape this balance important? (5/12)

You May Also Like