BC DATA SCIENCE
Saved by @zmbnski

This post is pretty bizarre, but it manages to hit on so many false beliefs that I've seen hurt junior data scientists that it deserves some explicit

 (1) The notion that R is well-suited to "building web applications" seems totally out of left field. I don't feel like most R loyalists think this is a good idea, but it's worth calling out that no normal company will be glad you wrote your entire web app in R.
(2) It is true that Python had some issues historically with the 2-to-3 transition, but it's not such a big deal these days. On the flip side, I have found interesting R code that doesn't run in modern R interpreters because of changes in core operations (e.g. assignment syntax).
(3) "Most of the time we only need a latest, working interpreter with the latest packages to run the code" -- this is where things get real and reveal some things that hurt data scientists. If this sentence is true, it's likely because you don't share code with coworkers.
(3) Really is a broader issue in data science: people only think of what they need to do their work if no one else existed and code was never maintained. Junior data scientists almost always operate on projects they start from scratch and don't have to maintain for long.
(3) Especially astonishing is this claim, "The version incompatibility and package management issues would almost surely create technical, even political problems within large organizations." In reality, updating packages unnecessarily can itself be a source of problems.
(4) "To do this in R, we merely need to do b = a". The idea that assignment is intrinsically a copying operation seems to have just been made up. Making lots of copies is one of the things that slows R down and all R loyalists seem to admit this. Copying != purity.
(5) "as a functional programming language": Some folks keep claiming that R is a functional language, but they never define the term well. R is not pure by default. R code is riddled with mutations to the symbol table; library(foo) has to emit warnings for exactly that reason.
(6) "Eventually, such functional designs save human time — the more significant bottleneck in the long run." This belief is extremely common among R users and it really holds them back in situations in which performance does matter. Large projects often demand high performance.
(7) "In fact, the abstraction of vector, matrix, data frame, and list is brilliant." This belief really holds R users back when talking with engineers about implementations. At some point, everyone needs to learn what a hash table is, but its absence from base R confuses folks.
(8) "Beyond that, I also love the vector-oriented design and thinking in R. Everything is a vector:" This belief also seems common in the R community, even though the creator of R has said it's the biggest mistake they made. Scalars are always good and sometimes essential.
(9) If the most important of an IDE is an object inspector, maybe "No decent IDEs, ever" is true, but I think this is another case where the author has just never interacted with software engineers or understood their needs.
Putting it all together, there's a very troubling (and self-defeating) tendency in the data science world to embrace insularity and refuse to learn about the things software engineers know. Both communities have important forms of expertise; more sharing is the way forward.

More from Data science

Goku Mohandas
Goku Mohandas
@GokuMohandas
🔥 Putting ML in Production! We're going to publicly develop @madewithml's first ML service. Here is the broad curriculum:

- 📦 Product
- 🔢 Data
- 🤖 Modeling
- 📝 Scripting
- 🛠 API
- 🚀 Production

More details (lessons, task, etc.) here: https://t.co/xmMm9XGK9j

Thread 👇


Questions that this thread will answer:

- What is it?
- Who is this course for?
- What is the format?
- What makes this course unique?
- Why constrain to open source tools?
- What are my qualifications?
- Why is this free?
- What are the

What is it?

Putting ML in Production: a guide and code-driven case study on MLOps. We will be developing and deploying Made With ML's first ML service, from Product → ML → Production, with open source tools.

This ML service will act as a foundation for all future ML features and subsequent iterations. The first feature is tagifai - multilabel classification of tags for a project. We'll discuss the need and utility of this feature in the first lesson.

Who is this course for?

- ML developers looking to become end-to-end ML developers.
- Software engineers looking to learn how to responsibly deploy and monitor ML systems.
- Product managers who want to have a comprehensive understanding of the different stages of ML dev.
DATA SCIENCE
Emil Wallner
Emil Wallner
@EmilWallner
Tips for AI writers:

1. Spend 30% of your effort on skimming all student ML papers (e.g. Stanford NLP CS224n) the past 3 years and prototype your favorites

The idea is everything. Pick an area you are interested in and ideally something that has a visual aspect to it

Most of my 'on the top of my mind' ideas were bad in retrospect. Skimming 100s of student papers will give you an overview of what's interesting.

Student papers are overlooked, easy to understand, and have good compute constraints.

2. Spend 30% on your effort on coding

Create an edge to the project. Apply it to something new and use FastAI or Keras to improve the accuracy with 5-30%.

3. Spend 30% writing an in-depth article

Have a north star article in terms of structure and quality. Find something that stretches you to your utmost capability. I used @copingbear’s Style transfer article:

4. Spend 10% marketing your project

Invest a week in studying the strategies to rank on sites like HN and Reddit, then use them. If you have an interesting result and a great article, you've done the hard work.
DATA SCIENCE
Advertisement
Pat Schloss
Pat Schloss
@PatSchloss
Wellll... A few weeks back I started working on a tutorial for our lab's Code Club on how to make shitty graphs. It was too dispiriting and I balked. A twitter workshop with figures and code:


Here's the code to generate the data frame. You can get the "raw" data from https://t.co/jcTE5t0uBT


Obligatory stacked bar chart that hides any sense of variation in the data


Obligatory stacked bar chart that shows all the things and yet shows absolutely nothing at the same time


STACKED Donut plot. Who doesn't want a donut? Who wouldn't want a stack of them!?! This took forever to render and looked worse than it should because coord_polar doesn't do scales="free_x".
DATA SCIENCE
Sunrit Jana \U0001f680
Sunrit Jana 🚀
@JanaSunrise
Pandas is an amazing data analysis and manipulation library for python, Really popular when working with ML, Data science or more.

It has a robust data structure, Dataframe for manipulation and analyzing data.

Here's some tips to help you work better with pandas. Let's go! ↓

If you're not aware about what a Dataframe is, It's an optimized data structure for loading data, analysing it, manipulating data in it, and Mostly gathering insights.

It uses Cython backend which transpiles into C for optimized code.

Here's how a dataframe looks like,


Before we start, You need to ensure, you have pandas installed. If you don't, Do that before moving ahead!

Here are the tips, Let's go!


1/ Convert PD series to Dataframe

We all have struggled, when we deal with pandas series. It's always easier to work with Dataframes, rather than series. Here is how you can convert series to dataframe easily.


2/ How to create dummy Dataframe for testing

We always need dataframes for testing and analysing normally, if we do not have data ready. Here is how you can use Pandas API to generate different types of data.
CODING RESOURCE , DATA SCIENCE
elvis
elvis
@omarsar0
I have always emphasized on the importance of mathematics in machine learning.

Here is a compilation of resources (books, videos & papers) to get you going.

(Note: It's not an exhaustive list but I have carefully curated it based on my experience and observations)

📘 Mathematics for Machine Learning

by Marc Peter Deisenroth, A. Aldo Faisal, and Cheng Soon Ong

https://t.co/zSpp67kJSg

Note: this is probably the place you want to start. Start slowly and work on some examples. Pay close attention to the notation and get comfortable with it.


📘 Pattern Recognition and Machine Learning

by Christopher Bishop

Note: Prior to the book above, this is the book that I used to recommend to get familiar with math-related concepts used in machine learning. A very solid book in my view and it's heavily referenced in academia.


📘 The Elements of Statistical Learning

by Jerome H. Friedman, Robert Tibshirani, and Trevor Hastie

Mote: machine learning deals with data and in turn uncertainty which is what statistics teach. Get comfortable with topics like estimators, statistical significance,...


📘 Probability Theory: The Logic of Science

by E. T. Jaynes

Note: In machine learning, we are interested in building probabilistic models and thus you will come across concepts from probability theory like conditional probability and different probability distributions.
DATA SCIENCE

You May Also Like

Jaya_Upadhyaya
Jaya_Upadhyaya
@Jayalko1
SRI SWETHA VINAYAGAR, THIRUVALANCHUZHI, KUMBAKONAM
(TN)
#bharatmandir

While main deity is Shiva as Kapartheeswarar, the kshetram is famous for Ganesha, known as Swetha/Vellai Vinayagar (white Vinayak)

During samudra manthan, Vasuki snake (used as rope) started spewing venom.


Unable to bear the intense heat, Devas rushed to Siva. He told them that this was because the task was started without getting Ganesha’s approval.
So the Devas created a Ganesha murti from white sea foam and worshipped it.
It was later taken by Indra to Indralok.
@GunduHuDuGa


But once Indra had to come to Earth to pray to Shiva to seek relief from a curse inflicted on him. So he brought the murti of Ganesha with him. When he came here, he wanted to take bath before puja. So he gave the murti to a boy to hold for sometime. The boy was actually Shiva.


He kept the murti down and vanished. Indra could not lift it again and a divine voice told him to let Vinayagar stay there and visit every Ganesh Chaturthi to pray.
Since Vinayagar is made of foam, no abhishekam is done here. Only punugu is applied n camphor powder is sprinkled
ALL
Emma Hilton
Emma Hilton
@FondOfBeetles
This is Kuinini ‘Nini’ Manumua, the woman who was ultimately displaced by inclusion of Laurel Hubbard.

She’s 21, and it would have been her first Olympics.
ALL
Advertisement
Sevak Sathaya
Sevak Sathaya
@Sevakofmata
Sharing one incident... After Modi's Trichy youth conference, the very next morning when police were clearing up their mini-control room, they found 5 strange boys who were roaming there with bags. When police enquired them "Sir, we are from Subramaniapuram in Trichy.

Whatever political meeting or conference is held in this ground, we come here on the same night or morning hours to collect the Liquor bottles to sell in the scrap shop for 50 paisa to 1 rupee per bottle and we used to earn Rs 200 to Rs 400 on each such event.

Even in the last DMK meeting the very next day we collected around 1500 bottles. But for Modi's BJP meeting, we could not find even a single bottle in the whole ground. We are coming around and around and not a single bottle in any corner of the G Corner ground in Trichy,

we are much disappointed, sir!". Police seem were stunned and pleasantly surprised. This is what Modi magic does in this nation. Modi is the one who can lead our nation and make everyone prosper with hardwork in right direction and proper approach.

This funny but interesting anecdote was published by a statewide local daily Dinamalar. I have just translated and posting it here for rest of the nation;
INDIA
Anu Satheesh \U0001f1ee\U0001f1f3
Anu Satheesh 🇮🇳...
@AnuSatheesh5
Thiruvizha Mahadeva Kshetram
#Alappuzha 
#Keralatemples 🚩

Thiruvizha Mahadeva Kshetram is located in Cherthala and it is believed that Prathishta of temple was done by Vilwamangalam Swamy. Paramashiva is Swayambhu here and is worshipped as Kalakandha which means who swallowed


Halahala visham to save the world during Samudra mathanam. 

It is a famous temple where people seek the blessings, for curing the Kaivisham. The poison given by someone to destroy a person is made to vomit here. This is removed by making them vomit the poison by a special


medicine.
The medicine for vomiting is made from a plant near temple by Palodathu family. The milk offered to Bhagwan is mixed with the extracts of the plant.

Story says that once this place was a dense forest, and a woman was looking for the presence of a tortoise in the pond


and the tip of her stick hit the bottom and it started bleeding in the pond. 
Frightened, the lady informed every one and after searching in pond people found Swayambhu Lingam inside the pond. Thus Prathishta was done here.

Om Namah Shivaye
Shambo Mahadeva
🙏🕉🙏
ALL
Enigma
Enigma
@ainittomai
On December 25 Mr Pool retweeted August 16 message about the Phoenix and that the worst was still on the horizon to come. 1/*


Maybe now we can assume that November 3 message meant "FUD" nor "FUN". Putting the word in capital letters seems to indicate the aspect the word fud has in our space, FUD. 2/*


Brad started it on December 22 (1/3 posts (Don't say? Sure) = 13 = Plan B). 3/*


And immediately the SEC followed dropping the bomb (1.3 billions (Don't say? Sure) = 13 = Plan B). 4/*


FUD materializes, Bitstamp is one of the first that haltes XRP trading and so on. 5/*
FOR LATER READ