BC DATA SCIENCE
Saved by @zmbnski

On Bayesianism, the Many Worlds Interpretation, and personal identity.

Some thoughts worked out in a letter to a friend, which is the kind of thing you do when off Twitter for a glorious week. (🧵)

 “Chance is ignorance”—the Bayesian story; all probabilities represent states of mind, not states of the world. One *could* put (some) chances “in the world”, but let’s take Occam’s Razor seriously...
That the probability of a fair coin coming up heads is 50% simply means that marginalizing (tracing, as the physicists say) over the hidden facts leaves you, nearly, maximally ignorant of the outcome.
Quantum uncertainty (access below!) poses an apparent challenge to this story. There seems to be nothing to be ignorant about when it comes to (say) electron spin—there is nothing “inside” the object.
https://t.co/DhHmN0ndjx
The electron is a simple object, in other words. So where does the uncertainty come from? One could follow David Wallace’s wonderful interpretation in terms of chaotic dynamics and decoherence, but let’s see if we can take another route...
It lies, finally, not in our lack of knowledge of what’s inside the electron (there is nothing there), but rather a lack of self-knowledge—we do not know which branch of the Universe we ended up in!
We lack knowledge, in other words, of the referent of a pronoun—which “I” I am. If you’re Saul Kripke, the rigid designator has detached—you must be re-baptized. For that reason, we should naturally refer to MWI as Born Again Quantum Theory (with the obvious pun).
The world is constantly forking, of course, but the vast majority of those forks are completely meaningless to us; they fall, for all intents and purposes, into the same equivalence class.
It’s only in rare cases (like those electrons at ANU) that we come directly into contact with these forks, where the equivalence class splits. Most classical uncertainty is simply further refining knowledge about the initial quantum state.
(I won’t tell you how my ANU quantum coin came up—ha ha! I know which branch we’re on, you don’t, but that’s just a classical, Bayesian matter.)
This is probably super-obvious to someone like @seanmcarroll, but there are two nice things about it.
First, it’s a nice way to get at the MWI from an unexpected direction. You don’t have to know about the Schrödinger Equation, decoherence, etc to realize the Universe *must* split.
That might help (depending on your philosophy of science) increase your confidence in the underlying metaphysical claims.
Second, it helps me understand why The Universe Splitter is a non-trivial device. It really does split universes... https://t.co/Uar00s1zmN
And it’s kind of cool to realize that it wasn’t until we learned to isolate and pay attention to quantum effects that the universes began to split!
Definitely a (classical) fact of the matter! The radioactive decay couples very quickly to the classical world—which means you’ve already split before you have time to wonder about his state. https://t.co/ffFcngLV3a
In any case, nearly all the forks that matter in human history happened long ago (at inflation, or perhaps reheating). I think. Can anyone think of a pre-twentieth century coupling to novel quantum uncertainty?
Most quantum effects are invisible to us—meaning that our ignorance of which universe we’re in is permanent, and therefore irrelevant. Perhaps when it comes to single-photon events—@DavidDeutschOxf’s frog in _Fabric of Reality_...
But did any decision, or memory, ever hang on the outcome on how a single photon interfered with itself? (Until today, when we basically, being humans, do it for the lulz!)
I’m a little worried I’m missing some massively obvious quantum influence, but one point in my favor is that this kind of world-splitting re-baptism took so long to discover. It’s not obvious at all.
And technically, we couldn’t know about it until Bell’s Inequality proved that there were no (relevant) hidden gears within the electron.
YES! I think this is meaningful. https://t.co/bKiU3y0cAX
It’s (nearly) all classical uncertainty. Those worlds exist, but are separated by a vast gulf—they split billions of years ago, well before any decision we might make.
Until someone uses the ANU device to hang some history on. There’s even a kind of odd utilitarian morality to it—if you are thinking about doing something bad, and hang it off ANU, you reduce the harm by a factor of two.
Nearly all personal identity splits happened (literal) eons ago. Laplace’s demon—we’re just discovering the consequences of the (decohered) initial conditions. https://t.co/pXX0YHIVJy
Those Universes separated so long ago that there’s no real sense in which Classical Simon1 and Classical Simon2 are comparable. You might as well line me up with Alpha Centauri Simon.
Nothing actually forks it. We’re emergent phenomena, our experiences equivalence classes over quantum states. ANU just happens (for the lulz) to split them, which I’m suggesting is actually super-rare in human history. https://t.co/hJ47tyaGIN
Definitely. My lamp tips over. That informs me about a sequence of classical events that goes back to the formation of the Earth, and much further. Now I know which path the atoms took after initial decoherence, but that was my ignorance. https://t.co/ig89rZCbcQ
Kripke semantics would say that a copy of the standard meter doesn’t have to “know” it’s not the standard meter for it to be distinct. https://t.co/Y6EzUTtgtP
This also helps me understand all those bits that ANU gathers but never serves to users. They (eventually) vanish (deleted for space), leaving no trace. Nobody will ever know how they turned out, and so our equivalence class can’t split.
Just realized that one source of universe-splitting started happening with (I think) cosmic ray errors in silicon. Where, in particular, the ray interacts is a quantum effect—causing one error over another, becoming visible to the operator.
You have to buy the Kripke story about how pronouns work. I, personally, think it’s intuitive and how I use them—but you may not! https://t.co/w5kHRVIc4K
I don’t know! I have Meillassoux on my desk (_After Finitude_) and would love any suggestions. https://t.co/JyY1yQsmzF
Oh, I think this works, yes. Sad, but true. Any happier examples? (Although in another sense, Max’s example *is* happy—there are yous that survive.) https://t.co/hErcyUtJ66

More from Simon DeDeo

Simon DeDeo
Simon DeDeo
@SimonDeDeo
One thing that goes unremarked about Wikipedia: the vast majority of the content was written over 12 years ago—which means (given turnover) that the editors dominant today were not directly involved in that creation.

Put another way, the editors who built the dominant nodes in this network...


...have little overlap with the ones who made this much more recent managerial flowchart.


Internet time runs at hundred-fold speed—the difference between the people who painted what's in the Uffizi, and the people in charge of keeping those paintings from deteriorating. Very different tasks, and (one presumes) very personalities as well. @PaulSkallas?
ALL
Simon DeDeo
Simon DeDeo
@SimonDeDeo
"I lied about my basic beliefs in order to keep a prestigious job. Now that it will be zero-cost to me, I have a few things to say."


We know that elite institutions like the one Flier was in (partial) charge of rely on irrelevant status markers like private school education, whiteness, legacy, and ability to charm an old white guy at an interview.

Harvard's discriminatory policies are becoming increasingly well known, across the political spectrum (see, e.g., the recent lawsuit on discrimination against East Asian applications.)

It's refreshing to hear a senior administrator admits to personally opposing policies that attempt to remedy these basic flaws. These are flaws that harm his institution's ability to do cutting-edge research and to serve the public.

Harvard is being eclipsed by institutions that have different ideas about how to run a 21st Century institution. Stanford, for one; the UC system; the "public Ivys".
LIFE
Advertisement
Simon DeDeo
Simon DeDeo
@SimonDeDeo
So—probability. Do we really need it? This has been on my mind since 2017, when I finally sat down to think through quantum theory. (/n)

One thing that’s always struck me is how *late* probability theory came in intellectual history. We had integral calculus before we had probability. And probability is insanely simple, mathematically!

I’m tempted to say that probability theory is not, in fact, Lindy. Frequentist probability is (for all the usual reasons) best understood as a heuristic. Bayesian interpretations, by contrast, take the remarkable step of tying it to mental states.

You have to work very hard to convince yourself that beliefs really are “degrees of belief in sets of events” (or whatever). It’s not natural—and I won’t rehearse the whole story about rational choice and decision theory...

So with those critiques in the back of my mind, when I read David Wallace’s decision-theoretic account of the Born Rule I was rather primed to say, hey, so what? Meaning...
PROBABILITY
Simon DeDeo
Simon DeDeo
@SimonDeDeo
This is a pretty valiant attempt to defend the "Feminist Glaciology" article, which says conventional wisdom is wrong, and this is a solid piece of scholarship. I'll beg to differ, because I think Jeffery, here, is confusing scholarship with "saying things that seem right".


The article is, at heart, deeply weird, even essentialist. Here, for example, is the claim that proposing climate engineering is a "man" thing. Also a "man" thing: attempting to get distance from a topic, approaching it in a disinterested fashion.


Also a "man" thing—physical courage. (I guess, not quite: physical courage "co-constitutes" masculinist glaciology along with nationalism and colonialism.)


There's criticism of a New York Times article that talks about glaciology adventures, which makes a similar point.


At the heart of this chunk is the claim that glaciology excludes women because of a narrative of scientific objectivity and physical adventure. This is a strong claim! It's not enough to say, hey, sure, sounds good. Is it true?
ALL
Simon DeDeo
Simon DeDeo
@SimonDeDeo
Someone tosses a coin ten times; it comes up heads every time. What's the probability it comes up heads on the next toss? (Pretty darn high—part of @nntaleb's work is unprogramming you from your high-school rules of thumb.) Now consider the (related) Gambler's fallacy...

In this case, it's a theory about compensation: the worse one's luck is, the more likely it is to see a reversal. On the surface, it's irrational. The more bad luck you have, the more you accumulate evidence that the system is rigged.

But there's also an anthropic component. If the luck is bad enough, it starts to become inconsistent with your survival. You've accumulated evidence for correlations in the environment, but these correlations (may be) inconsistent with (people like you) being in this environment.

An example. You're in a city where everyone takes public transport. You encounter a string of bad delays. It's reasonable to conclude they'll end—otherwise people wouldn't take public transport. It's unlikely that you happened to show up right when the network collapses.

Of course, that's a bad heuristic in a casino, which relies on a constant influx of losers. But in other environments, particularly with persistent populations and no evidence for sudden changes in the underlying laws, it makes sense.
CRYPTO

More from Data science

Sunrit Jana \U0001f680
Sunrit Jana 🚀
@JanaSunrise
Pandas is an amazing data analysis and manipulation library for python, Really popular when working with ML, Data science or more.

It has a robust data structure, Dataframe for manipulation and analyzing data.

Here's some tips to help you work better with pandas. Let's go! ↓

If you're not aware about what a Dataframe is, It's an optimized data structure for loading data, analysing it, manipulating data in it, and Mostly gathering insights.

It uses Cython backend which transpiles into C for optimized code.

Here's how a dataframe looks like,


Before we start, You need to ensure, you have pandas installed. If you don't, Do that before moving ahead!

Here are the tips, Let's go!


1/ Convert PD series to Dataframe

We all have struggled, when we deal with pandas series. It's always easier to work with Dataframes, rather than series. Here is how you can convert series to dataframe easily.


2/ How to create dummy Dataframe for testing

We always need dataframes for testing and analysing normally, if we do not have data ready. Here is how you can use Pandas API to generate different types of data.
CODING RESOURCE , DATA SCIENCE
John Myles White
John Myles White
@johnmyleswhite
This post is pretty bizarre, but it manages to hit on so many false beliefs that I've seen hurt junior data scientists that it deserves some explicit

(1) The notion that R is well-suited to "building web applications" seems totally out of left field. I don't feel like most R loyalists think this is a good idea, but it's worth calling out that no normal company will be glad you wrote your entire web app in R.

(2) It is true that Python had some issues historically with the 2-to-3 transition, but it's not such a big deal these days. On the flip side, I have found interesting R code that doesn't run in modern R interpreters because of changes in core operations (e.g. assignment syntax).

(3) "Most of the time we only need a latest, working interpreter with the latest packages to run the code" -- this is where things get real and reveal some things that hurt data scientists. If this sentence is true, it's likely because you don't share code with coworkers.

(3) Really is a broader issue in data science: people only think of what they need to do their work if no one else existed and code was never maintained. Junior data scientists almost always operate on projects they start from scratch and don't have to maintain for long.
DATA SCIENCE
Advertisement
Jeremy Howard
Jeremy Howard
@jeremyphoward
An amazing new project from @bearpelican was just released: https://t.co/DBov6sZTVS . A beautiful design; you can auto-generate a melody from chords, chords from a melody, and more.

It's technically brilliant, combining BERT, seq2seq, and Transformer XL
https://t.co/jF3mO5aXiu


It's also a wonderful example of leveraging and customizing the fastai framework in a deep & thoughtful way.


Here's the full set of blog posts diving in to this
DATA SCIENCE
Ryan J. Gallagher
Ryan J. Gallagher
@ryanjgallag
Tired of word clouds? Want to do better sentiment analysis? Not sure how to look at the words underneath your measures?

Our long overdue paper on generalized word shift graphs is finally here!
https://t.co/lIBXvbMJWX
https://t.co/vSL1REYT8V

So what are they?

1/n


If we have two texts, there are many ways we can compare them. Weighted averages are a particularly useful measure because they're flexible and interpretable

Proportions, Shannon entropy, the KLD, the JSD, and dictionary methods can all be written as weighted averages

2/n

But weighted avgs are also slippery. When we try to compress complex phenomena like happiness, surprise, divergence, or diversity into a single number, it can be unclear what we're measuring

If the measure goes up, what does that mean? Why did it do that? Can we trust it?

3/n

Very often, that's the end of the line and we're left with an uneasy feeling in the pit of our stomach that our weighted avg is actually picking up a data artifact or some other unintended peculiarity

Word shift graphs help us address those concerns

4/n

First, word shifts look under the hood of weighted averages to see what's going on

All weighted averages are a sum of contributions from individual words. We can pull out those words, and rank which ones contribute the most to the difference between two texts

5/n
DATA SCIENCE
Emil Wallner
Emil Wallner
@EmilWallner
Tips for AI writers:

1. Spend 30% of your effort on skimming all student ML papers (e.g. Stanford NLP CS224n) the past 3 years and prototype your favorites

The idea is everything. Pick an area you are interested in and ideally something that has a visual aspect to it

Most of my 'on the top of my mind' ideas were bad in retrospect. Skimming 100s of student papers will give you an overview of what's interesting.

Student papers are overlooked, easy to understand, and have good compute constraints.

2. Spend 30% on your effort on coding

Create an edge to the project. Apply it to something new and use FastAI or Keras to improve the accuracy with 5-30%.

3. Spend 30% writing an in-depth article

Have a north star article in terms of structure and quality. Find something that stretches you to your utmost capability. I used @copingbear’s Style transfer article:

4. Spend 10% marketing your project

Invest a week in studying the strategies to rank on sites like HN and Reddit, then use them. If you have an interesting result and a great article, you've done the hard work.
DATA SCIENCE

You May Also Like

\u0100yudhika
Ä€yudhika
@Satyamev1310
Ashta Siddhi

Ashta Siddhi is mentioned in Patanjali Yog sutra and can be obtained by very few through countless years of practice and devotion to all eight limbs of Ashtanga Yoga.

Siddhi can loosely be translated as accomplishment or a special power or unusual skill.


The eight Siddhis are:

1. Anima: Reducing one’s physical self to the size of an atom.

2. Mahima: Expanding one’s physical self to infinite level

3. Garima: Making one’s physical self so heavy as immovable by others

4. Laghima: Becoming almost weightless


5. Prapti: Being able travel anywhere in the Universe

6. Prakamya: Can know & understand what is going on in one’s mind. Can understand other person’s min.

7. Ishitva: Possessing title of Bhagwan

8. Vashitva: A seeker can subdue any person/thing

(Hanuman Jayanti is coming)


Hanumanji not only possessed all eight siddhis, but was also blessed by Sita mata as “Ashta Siddhi Nau Nidhi Ke Daata”.

When Hanumanji first reaches to Lanka on his mission to find Sita, he makes use of anima so as to be discrete in enemy territory.


He uses it again when he approaches Sita mata for the first time – reducing his size to that of a schoolboy, to avoid scaring her. He uses mahima to outwit & overpowers
the demons.
ALL
Dr Amanda Moehring
Dr Amanda Moehring
@FlyBehaviour
In Academia, people aren’t always supported when they need it. I want to share what @WesternU did when my husband died right after the pandemic shutdown. It should be shared with other uni’s as a model for empathy and proactive care when someone is in crisis.
1/
#AcademicChatter
SCIENCE
Advertisement
Alex Stamos
Alex Stamos
@alexstamos
The entire discussion around Facebook’s disclosures of what happened in 2016 is very frustrating. No exec stopped any investigations, but there were a lot of heated discussions about what to publish and when.


In the spring and summer of 2016, as reported by the Times, activity we traced to GRU was reported to the FBI. This was the standard model of interaction companies used for nation-state attacks against likely US targeted.

In the Spring of 2017, after a deep dive into the Fake News phenomena, the security team wanted to publish an update that covered what we had learned. At this point, we didn’t have any advertising content or the big IRA cluster, but we did know about the GRU model.

This report when through dozens of edits as different equities were represented. I did not have any meetings with Sheryl on the paper, but I can’t speak to whether she was in the loop with my higher-ups.

In the end, the difficult question of attribution was settled by us pointing to the DNI report instead of saying Russia or GRU directly. In my pre-briefs with members of Congress, I made it clear that we believed this action was GRU.
TECH
Mo Rajabifard
Mo Rajabifard
@morajabi
👨‍💻 Last resume I sent to a startup one year ago, sharing with you to get ideas:

- Forget what you don't have, make your strength bold
- Pick one work experience and explain what you did in detail w/ bullet points
- Write it towards the role you apply
- Give social proof

/thread


"But I got no work experience..."

Make a open source lib, make a small side project for yourself, do freelance work, ask friends to work with them, no friends? Find friends on Github, and Twitter.

Bonus points:

- Show you care about the company: I used the company's brand font and gradient for in the resume for my name and "Thank You" note.
- Don't list 15 things and libraries you worked with, pick the most related ones to the role you're applying.
-🙅‍♂️"copy cover letter"

"I got no firends, no work"

One practical way is to reach out to conferences and offer to make their website for free. But make sure to do it good. You'll get:

- a project for portfolio
- new friends
- work experience
- learnt new stuff
- new thing for Twitter bio

If you don't even have the skills yet, why not try your chance for @LambdaSchool? No? @freeCodeCamp. Still not? Pick something from here and learn https://t.co/7NPS1zbLTi
You'll feel very overwhelmed, no escape, just acknowledge it and keep pushing.
LIFE
Vibhu Vashisth
Vibhu Vashisth
@VIBHU_Tweet
THE UNTOLD TALE OF THE LESSER KNOWN WARRIORS:JOGRAJ GURJAR & RAMPYARI GURJAR AND HOW DID THEY DEFEAT THE CRUELEST ISLAMIC INVADER, TIMUR LANG.

Timur Lang, was the founder of Timurid Empire. He was born in April 1336 CE, somewhere in central asia.


During his reign, he conquered Persia, Egypt, Central Asia and emerged as the most powerful and heinous ruler. He was a religious fanatic like the rest of the Islamic invaders who tried to invade India.

Timur Lang decided to invade India in 1398 as he heard about India's splendid wealth and had a desire to conquer India which his ancestor Genghis Khan couldn't do.


After Firoz Shah's demise in1388, Delhi Sultanate was in a state of political turmoil.During this time, Timur sent his grandson Pir Mohammad to attack Indian front. He invaded Multan&was able to defeat Iqbal Khan's brother but when he met with resistance,he asked help from Timur.


Iqbal Khan secured his hold on Delhi under Muhammad Tughluq after Firoz Shah died.
Timur provided the required back-up to his grandson with 100000 men approx. Timur sacked and plundered all the cities coming in his way &later in October 1398 reunited with his grandson.
ALL