BC DATA SCIENCE
Saved by @Jacobtldr

To my JVM friends looking to explore Machine Learning techniques - you don’t necessarily have to learn Python to do that. There are libraries you can use from the comfort of your JVM environment. 🧵👇

 https://t.co/EwwOzgfDca : Deep Learning framework in Java that supports the whole cycle: from data loading and preprocessing to building and tuning a variety deep learning networks.
https://t.co/J4qMzPAZ6u Framework for defining machine learning models, including feature generation and transformations, as directed acyclic graphs (DAGs).
https://t.co/9IgKkSxPCq a machine learning library in Java that provides multi-class classification, regression, clustering, anomaly detection and multi-label classification.
https://t.co/EAqn2YngIE : TensorFlow Java API (experimental)
https://t.co/7TY0viBfF5: ML algorithms, feature preprocessing and pipelines. Scalable through distributed computations.
https://t.co/9EVdIXwJuo: The toolkit for common NLP tasks, such as tokenization, sentence segmentation, part-of-speech tagging, named entity extraction, chunking, parsing, coreference resolution, language detection and more!
https://t.co/AnxgGmsux2: distributed linear algebra framework and mathematically expressive Scala DSL designed to let mathematicians, statisticians, and data scientists quickly implement their own algorithms.
https://t.co/fiexCElwRp : Statistical Machine Intelligence and Learning Engine: classification, regression, clustering, association rule mining, feature selection, manifold learning, multidimensional scaling, genetic algorithms, missing value imputation, nearest neighbor search..
https://t.co/kDGCjszAaA Kotlin∇ is a type-safe automatic differentiation framework in Kotlin. It allows users to express differentiable programs with higher-dimensional data structures and operators.
(Not yet released) automatic differentiation system for the Kotlin language: https://t.co/9ANDDIVW8o
https://t.co/jKeboC2z0V open-source, high-level, engine-agnostic Java framework for deep learning. DJL is designed to be easy to get started with and simple to use for Java developers.
https://t.co/pXkvxumzrw - a set of simple, scalable and efficient tools that allow the building of predictive Machine Learning models without costly data transfers.

More from Data science

Emil Wallner
Emil Wallner
@EmilWallner
Tips for AI writers:

1. Spend 30% of your effort on skimming all student ML papers (e.g. Stanford NLP CS224n) the past 3 years and prototype your favorites

The idea is everything. Pick an area you are interested in and ideally something that has a visual aspect to it

Most of my 'on the top of my mind' ideas were bad in retrospect. Skimming 100s of student papers will give you an overview of what's interesting.

Student papers are overlooked, easy to understand, and have good compute constraints.

2. Spend 30% on your effort on coding

Create an edge to the project. Apply it to something new and use FastAI or Keras to improve the accuracy with 5-30%.

3. Spend 30% writing an in-depth article

Have a north star article in terms of structure and quality. Find something that stretches you to your utmost capability. I used @copingbear’s Style transfer article:

4. Spend 10% marketing your project

Invest a week in studying the strategies to rank on sites like HN and Reddit, then use them. If you have an interesting result and a great article, you've done the hard work.
DATA SCIENCE
Sophie Hill
Sophie Hill
@sophie_e_hill
This is a more wonky thread about how I made this visualization in #Rstats using the awesome visNetwork

First step is to create the underlying network data. We need one file of "nodes" - i.e. the people and organizations. And one file of "edges" - i.e. the connections between them.

I created these by hand, based on excellent investigate journalism:


Now we can pull these together to create a network visualization!

You'll notice that I included a column for "type" in the nodes file. This allows me to use different icons for people vs firms vs political organizations.


All the icons are taken from @fontawesome. I *think* the visNetwork 📦 currently only works with fontawesome version 4.7, which is a bit limited – e.g. I decided to use a book icon to represent the fringe Evangelical Christian sect "Exclusive Brethren"! 😂


I very much enjoyed getting to use the "incognito" icon to represent all the unknown donors that have funded Tory MP Owen Paterson's overseas jaunts!
DATA SCIENCE
Advertisement
Ryan J. Gallagher
Ryan J. Gallagher
@ryanjgallag
Tired of word clouds? Want to do better sentiment analysis? Not sure how to look at the words underneath your measures?

Our long overdue paper on generalized word shift graphs is finally here!
https://t.co/lIBXvbMJWX
https://t.co/vSL1REYT8V

So what are they?

1/n


If we have two texts, there are many ways we can compare them. Weighted averages are a particularly useful measure because they're flexible and interpretable

Proportions, Shannon entropy, the KLD, the JSD, and dictionary methods can all be written as weighted averages

2/n

But weighted avgs are also slippery. When we try to compress complex phenomena like happiness, surprise, divergence, or diversity into a single number, it can be unclear what we're measuring

If the measure goes up, what does that mean? Why did it do that? Can we trust it?

3/n

Very often, that's the end of the line and we're left with an uneasy feeling in the pit of our stomach that our weighted avg is actually picking up a data artifact or some other unintended peculiarity

Word shift graphs help us address those concerns

4/n

First, word shifts look under the hood of weighted averages to see what's going on

All weighted averages are a sum of contributions from individual words. We can pull out those words, and rank which ones contribute the most to the difference between two texts

5/n
DATA SCIENCE
Simon DeDeo
Simon DeDeo
@SimonDeDeo
On Bayesianism, the Many Worlds Interpretation, and personal identity.

Some thoughts worked out in a letter to a friend, which is the kind of thing you do when off Twitter for a glorious week. (🧵)

“Chance is ignorance”—the Bayesian story; all probabilities represent states of mind, not states of the world. One *could* put (some) chances “in the world”, but let’s take Occam’s Razor seriously...

That the probability of a fair coin coming up heads is 50% simply means that marginalizing (tracing, as the physicists say) over the hidden facts leaves you, nearly, maximally ignorant of the outcome.

Quantum uncertainty (access below!) poses an apparent challenge to this story. There seems to be nothing to be ignorant about when it comes to (say) electron spin—there is nothing “inside” the

The electron is a simple object, in other words. So where does the uncertainty come from? One could follow David Wallace’s wonderful interpretation in terms of chaotic dynamics and decoherence, but let’s see if we can take another route...
DATA SCIENCE
Sunrit Jana \U0001f680
Sunrit Jana 🚀
@JanaSunrise
Pandas is an amazing data analysis and manipulation library for python, Really popular when working with ML, Data science or more.

It has a robust data structure, Dataframe for manipulation and analyzing data.

Here's some tips to help you work better with pandas. Let's go! ↓

If you're not aware about what a Dataframe is, It's an optimized data structure for loading data, analysing it, manipulating data in it, and Mostly gathering insights.

It uses Cython backend which transpiles into C for optimized code.

Here's how a dataframe looks like,


Before we start, You need to ensure, you have pandas installed. If you don't, Do that before moving ahead!

Here are the tips, Let's go!


1/ Convert PD series to Dataframe

We all have struggled, when we deal with pandas series. It's always easier to work with Dataframes, rather than series. Here is how you can convert series to dataframe easily.


2/ How to create dummy Dataframe for testing

We always need dataframes for testing and analysing normally, if we do not have data ready. Here is how you can use Pandas API to generate different types of data.
CODING RESOURCE , DATA SCIENCE

You May Also Like

Engineer Who
Engineer Who
@Engr_Who
A long but must read thread. Udaybhan Rathore and myth making in Maratha history: An analysis. This is the thread on Udaybhan Rathore, who he was and how over the time period, his life was portrayed in maratha chronicles and pseudo history. (1/n)

Udaybhan rathore was the head of Bhinai thikana (84 villages) in Ajmer. He was the direct descendant of the famous Rao Chandrasen, Raja of Marwar (4th generation) who resisted Akbar all his life and never made any alliance with mughals like Maharana Pratap. (2/n)

Later in 1783, Maharaja of Jodhpur gave title of Raja to Bhinai family for their military service. Bhinai family and their direct descendant Raja Sh Mayuraj Singh still lives in Ajmer. Anyway coming to Udaybhan Rathore and story of Tanaji. (3/n)

Jai Singh's march on Shivaji and treaty of Purandar (1665) is a well known episode to repeat here. After getting the hill forts from Shivaji under the treaty, Jai Singh didn't have enough man-power to man every one of the small forts because of his next (4/n)

campaign against Bijapur. Jai Singh personally took over a couple of important forts like Kondhana (Sinhgarh), Purandar etc. Others were given to some mughals or their fortification walls destroyed. Jai Singh died in 1667 near Burhanpur while enroute to the north. (5/n)
INDIA
\u2745\u1710\u170b\u1713\u170e
❅ᜐᜋᜓᜎ...
@uglyluhan
First thread of the year because I have time during MCO. As requested, a thread on the gods and spirits of Malay folk religion. Some are indigenous, some are of Indian origin, some have Islamic


Before I begin, it might be worth explaining the Malay conception of the spirit world. At its deepest level, Malay religious belief is animist. All living beings and even certain objects are said to have a soul. Natural phenomena are either controlled by or personified as spirits

Although these beings had to be respected, not all of them were powerful enough to be considered gods. Offerings would be made to the spirits that had greater influence on human life. Spells and incantations would invoke their


Two known examples of such elemental spirits that had god-like status are Raja Angin (king of the wind) and Mambang Tali Arus (spirit of river currents). There were undoubtedly many more which have been lost to time

Contact with ancient India brought the influence of Hinduism and Buddhism to SEA. What we now call Hinduism similarly developed in India out of native animism and the more formal Vedic tradition. This can be seen in the multitude of sacred animals and location-specific Hindu gods
RELIGION
Advertisement
STEALTH JEFF
STEALTH JEFF
@drawandstrike
So it's now October 10, 2018 and....Rod Rosenstein is STILL not fired.

He's STILL in charge of the Mueller investigation.

He's STILL refusing to hand over the McCabe memos.

He's STILL holding up the declassification of the #SpyGate documents & their release to the public.

I love a good cover story.......

The guy had a face-to-face with El Grande Trumpo himself on Air Force One just 2 days ago. Inside just about the most secure SCIF in the world.

And Trump came out of AF1 and gave ol' Rod a big thumbs up!

And so we're right back to 'that dirty rat Rosenstein!' 2 days later.

At this point it's clear some members of Congress are either in on this and helping the cover story or they haven't got a clue and are out in the cold.

Note the conflicting stories about 'Rosenstein cancelled meeting with Congress on Oct 11!"

First, rumors surfaced of a scheduled meeting on Oct. 11 between Rosenstein & members of Congress, and Rosenstein just cancelled it.
ALL
SK
SK
@sk_diary1
Andhakasuravadha Samharamurti -#story #Thread
Sculpture of Bhagwan Shiva as the destroyer of the Asura Andhaka - Cave 29,Ellora caves

Asura Andhaka hangs on to a trishula held by 6-armed Shiva.

Once Parvathi & Shiva were relaxing in the pleasant gardens of Mount Mandhara.


Bhagwan Shiva sat down there to enjoy the happiness.Parvati closed the eyes of Shiva playfully & darkness covered the whole universe.Parvati was perplexed & her palms were wet with perspiration.A few drops of her sweat mixed with sweat from Shiva’s body& fell to the ground.

From this sweat,a fierce creature was born,it started to roar.Child was born blind as Shiva's eyes were closed so was named as Andaka.Andha means darkness&also ignorance.Around the same time Asura Hiranyaksha was performing rigorous tapas Shiva for a boon of powerful son.

Bhagwan Shiva was pleased by tapas of Hiranyaksha & blessed him with darshan.Hiranyaksha asked for a powerful son,Shiva told him that he cannot have his own son,but can adopt a blind child who would become very powerful later.Shiva gave child Andaka to Hiranyaksha.

Hiranyaksha returned to his kingdom with Andaka.Later after the vadh of Hiranyaksha, Andaka is said to have lived with his cousins.He was ridiculed,so dejected Andaka went to forest.He did severe tapas for over many years towards Brahma Dev. Brahma dev appeared before him.
ALL
Matt Fuller
Matt Fuller
@MEPFuller
They’re shooting into the chamber.
POLITICS