BC DATA SCIENCE

Saved by @Jacobtldr

Sophie Hill
@sophie_e_hill 4 years, 7 months ago 1270 views

Save to PDF Share See On Twitter

This is a more wonky thread about how I made this visualization in #Rstats using the awesome visNetwork

First step is to create the underlying network data. We need one file of "nodes" - i.e. the people and organizations. And one file of "edges" - i.e. the connections between them.

I created these by hand, based on excellent investigate journalism:

Now we can pull these together to create a network visualization!

You'll notice that I included a column for "type" in the nodes file. This allows me to use different icons for people vs firms vs political organizations.

All the icons are taken from @fontawesome. I *think* the visNetwork 📦 currently only works with fontawesome version 4.7, which is a bit limited – e.g. I decided to use a book icon to represent the fringe Evangelical Christian sect "Exclusive Brethren"! 😂

I very much enjoyed getting to use the "incognito" icon to represent all the unknown donors that have funded Tory MP Owen Paterson's overseas jaunts!

The icons are also scaled by how many "edges" connect to each "node".

Unsurprisingly, this means that the UK government and the Conservative party emerge as the most connected nodes in this network!

The great thing about visNetwork 📦 is that it's SO easy to make this visualization interactive with #RShiny.

You can add pop-up boxes ("tool-tips") that show more information when the user hovers over a node or edge – perfect for linking to the original reporting that I used.

Check out the full code and data on github! https://t.co/rWuCxbCnW3

More from Data science

Jeremy Howard
@jeremyphoward

An amazing new project from @bearpelican was just released: https://t.co/DBov6sZTVS . A beautiful design; you can auto-generate a melody from chords, chords from a melody, and more.

It's technically brilliant, combining BERT, seq2seq, and Transformer XL
https://t.co/jF3mO5aXiu

It's also a wonderful example of leveraging and customizing the fastai framework in a deep & thoughtful way.

Here's the full set of blog posts diving in to this

Greg Yang
@TheGregYang

1/ A ∞-wide NN of *any architecture* is a Gaussian process (GP) at init. The NN in fact evolves linearly in function space under SGD, so is a GP at *any time* during training. https://t.co/v1b6kndqCk With Tensor Programs, we can calculate this time-evolving GP w/o trainin any NN

2/ In this gif, narrow relu networks have high probability of initializing near the 0 function (because of relu) and getting stuck. This causes the function distribution to become multi-modal over time. However, for wide relu networks this is not an issue.

3/ This time-evolving GP depends on two kernels: the kernel describing the GP at init, and the kernel describing the linear evolution of this GP. The former is the NNGP kernel, and the latter is the Neural Tangent Kernel (NTK).

4/ Once we have these two kernels, we can derive the GP mean and covariance at any time t via straightforward linear algebra.

5/ So it remains to calculate the NNGP kernel and NT kernel for any given architecture. The first is described in https://t.co/cFWfNC5ALC and in this thread

Advertisement

Ryan J. Gallagher
@ryanjgallag

Tired of word clouds? Want to do better sentiment analysis? Not sure how to look at the words underneath your measures?

Our long overdue paper on generalized word shift graphs is finally here!
https://t.co/lIBXvbMJWX
https://t.co/vSL1REYT8V

So what are they?

1/n

If we have two texts, there are many ways we can compare them. Weighted averages are a particularly useful measure because they're flexible and interpretable

Proportions, Shannon entropy, the KLD, the JSD, and dictionary methods can all be written as weighted averages

2/n

But weighted avgs are also slippery. When we try to compress complex phenomena like happiness, surprise, divergence, or diversity into a single number, it can be unclear what we're measuring

If the measure goes up, what does that mean? Why did it do that? Can we trust it?

3/n

Very often, that's the end of the line and we're left with an uneasy feeling in the pit of our stomach that our weighted avg is actually picking up a data artifact or some other unintended peculiarity

Word shift graphs help us address those concerns

4/n

First, word shifts look under the hood of weighted averages to see what's going on

All weighted averages are a sum of contributions from individual words. We can pull out those words, and rank which ones contribute the most to the difference between two texts

5/n

Data Professor
@thedataprof

Cheat sheet that summarizes #DataScience in 10 pages
(Links in the comments below 👇)

2/ Link to the cheatsheet by Maverick

Goku Mohandas
@GokuMohandas

🔥 Putting ML in Production! We're going to publicly develop @madewithml's first ML service. Here is the broad curriculum:

- 📦 Product
- 🔢 Data
- 🤖 Modeling
- 📝 Scripting
- 🛠 API
- 🚀 Production

More details (lessons, task, etc.) here: https://t.co/xmMm9XGK9j

Thread 👇

Questions that this thread will answer:

- What is it?
- Who is this course for?
- What is the format?
- What makes this course unique?
- Why constrain to open source tools?
- What are my qualifications?
- Why is this free?
- What are the

What is it?

Putting ML in Production: a guide and code-driven case study on MLOps. We will be developing and deploying Made With ML's first ML service, from Product → ML → Production, with open source tools.

This ML service will act as a foundation for all future ML features and subsequent iterations. The first feature is tagifai - multilabel classification of tags for a project. We'll discuss the need and utility of this feature in the first lesson.

Who is this course for?

- ML developers looking to become end-to-end ML developers.
- Software engineers looking to learn how to responsibly deploy and monitor ML systems.
- Product managers who want to have a comprehensive understanding of the different stages of ML dev.

You May Also Like

$Pieter Levels \u2728$

Pieter Levels ✨
@levelsio

Joe Rogan's podcast is now is listened to 1.5+ billion times per year at around $50-100M/year revenue.

Independent and 100% owned by Joe, no networks, no middle men and a 100M+ people audience.

👏

https://t.co/RywAiBxA3s

Joe is the #1 / #2 podcast (depends per week) of all podcasts

120 million plays per month source https://t.co/k7L1LfDdcM

https://t.co/aGcYnVDpMu

$Anu Satheesh \U0001f1ee\U0001f1f3$

Anu Satheesh 🇮🇳...
@AnuSatheesh5

Thirumalai Murugan Kovil
#Panpoli
#TamilNaduTemples 🚩

Thirumalai Murugan Temple is located in Tenkasi district of Tamil Nadu. Muruga is worshipped as Thirumalai kumarasamy. Temple is situated near Kerala border and known to be where Shri Murugan gave darshan to Rishi Agasthiar

Devi is worshipped in the temple as Thirumalai Kaali amman

Sthala Puranam says that, there was a priest named Poovanbhattar of Thirumalai Kaali amman. Murugar appeared in a dream of the bhattar and said to find a Vigraham, lying in particular place which is of Thirumalaikumaran

Bhattar conveyed the news to the Pandalam Raja and they went to find out the vigraham. Surprisingly ants showed the way to find the Vigraham. Thus Murugan vigraham was found and Prathista was done here. There is a lake with pure water on the top of the hill

which is said to be created by Agasthiyar. It is believed that kannaki of
Chilapathikaram visited here before going to Kerala. Sapthamathrukkal also worshipped Murugan here. Kanthashashti Thiruvizha is very famous here.

Om Muruga
Muruganukku Harohara
🙏🕉🙏

Advertisement

History Of Rajputana
@KshatriyaItihas

**Thread on Bravery of Sikhs**
(I am forced to do this due to continuous hounding of Sikh Extremists since yesterday)

Rani Jindan Kaur, wife of Maharaja Ranjit Singh had illegitimate relations with Lal Singh (PM of Ranjit Singh). Along with Lal Singh, she attacked Jammu, burnt - https://t.co/EfjAq59AyI

Tomorrow again same thing happens bcoz fudus like you are creating a narrative oh Khalistan. when farmers are asking MSP. (RSS ki tatti khane wale Kerni sena ke kutte).
U kill sikhs in 1984 just politics. To BC low IQ fudu Saale entire history was politics.
— Ancient Economist (@_stock_tips) December 5, 2020

Hindu villages of Jasrota, caused rebellion in Jammu, attacked Kishtwar.

Ancestors of Raja Ranjit Singh, The Sansi Tribe used to give daughters as concubines to Jahangir.

The Ludhiana Political Agency (Later NW Fronties Prov) was formed by less than 4000 British soldiers who advanced from Delhi and reached Ludhiana, receiving submissions of all sikh chiefs along the way. The submission of the troops of Raja of Lahore (Ranjit Singh) at Ambala.

Dabistan a contemporary book on Sikh History tells us that Guru Hargobind broke Naina devi Idol Same source describes Guru Hargobind serving a eunuch
YarKhan. (ref was proudly shared by a sikh on twitter)
Gobind Singh followed Bahadur Shah to Deccan to fight for him.

In Zafarnama, Guru Gobind Singh states that the reason he was in conflict with the Hill Rajas was that while they were worshiping idols, while he was an idol-breaker.

And idiot Hindus place him along Maharana, Prithviraj and Shivaji as saviours of Dharma.

Vibhu Vashisth
@VIBHU_Tweet

शमशान में जब महर्षि दधीचि के मांसपिंड का दाह संस्कार हो रहा था तो उनकी पत्नी अपने पति का वियोग सहन नहीं कर पायी और पास में ही स्थित विशाल पीपल वृक्ष के कोटर में अपने तीन वर्ष के बालक को रख के स्वयं चिता पे बैठ कर सती हो गयी ।इस प्रकार ऋषी दधीचि और उनकी पत्नी की मुक्ति हो गयी।

परन्तु पीपल के कोटर में रखा बालक भूख प्यास से तड़पने लगा। जब कुछ नहीं मिला तो वो कोटर में पड़े पीपल के गोदों (फल) को खाकर बड़ा होने लगा। कालान्तर में पीपल के फलों और पत्तों को खाकर बालक का जीवन किसी प्रकार सुरक्षित रहा।

एक दिन देवर्षि नारद वहां से गुजर रहे थे ।नारद ने पीपल के कोटर में बालक को देख कर उसका परिचय मांगा -
नारद बोले - बालक तुम कौन हो?
बालक - यही तो मैं भी जानना चहता हूँ ।
नारद - तुम्हारे जनक कौन हैं?
बालक - यही तो मैं भी जानना चाहता हूँ ।

तब नारद ने आँखें बन्द कर ध्यान लगाया ।

तत्पश्चात आश्चर्यचकित हो कर बालक को बताया कि 'हे बालक! तुम महान दानी महर्षि दधीचि के पुत्र हो । तुम्हारे पिता की अस्थियों का वज्रास्त्र बनाकर ही देवताओं ने असुरों पर विजय पायी थी।तुम्हारे पिता की मृत्यु मात्र 31 वर्ष की वय में ही हो गयी थी'।

बालक - मेरे पिता की अकाल मृत्यु का क्या कारण था?
नारद - तुम्हारे पिता पर शनिदेव की महादशा थी।
बालक - मेरे उपर आयी विपत्ति का कारण क्या था?
नारद - शनिदेव की महादशा।
इतना बताकर देवर्षि नारद ने पीपल के पत्तों और गोदों को खाकर बड़े हुए उस बालक का नाम पिप्पलाद रखा और उसे दीक्षित किया।

Kirsti Miller
@KirstiMiller30

@FionaPearman @ScottMorrisonMP Morrison is our statue of unempathic neoliberalism - erected by evangelical and corporate Australia to celebrate their victory over compassion, equality and secular humanism.

Hopefully it gets pulled down like the statues of dubious heroes of oppression from an earlier age.

@ScottMorrisonMP The two-party-preferred system in
Australia politics isn’t working for people, and it sure isn’t working for the planet.

@ScottMorrisonMP My collapse of faith in our democracies isn’t an accident. It’s one of the central victories of the neoliberal project, delivered through two generations of privatisation, outsourcing and deregulation, underfunding of government services (locked in by tax cuts),...

@ScottMorrisonMP restricting freedom of information, targeting whistleblowers and raiding the media who report on them, delegitimising and gagging public interest advocacy, and criminalising protest.

@ScottMorrisonMP Politics in Australia today relies hugely on the fact that most people don’t know most of what’s going on so as to get away with stuff that couldn’t be done under real scrutiny we have seen a clear example of this with the National Coronvirus Cabinet.