BC MACHINE LEARNING

Saved by @CodyyyGardner

Santiago
@svpino 5 years, 7 months ago 1229 views

Save to PDF Share See On Twitter

For a long time, I didn't understand how to use Virtual Environments in Python 🐍.

If this is just, let's end it here and now: 🧵👇

[2] Virtual Environments let you deal with the dependencies that your code has with external Python libraries.

It avoids having conflicts when your projects depend on different versions of the same library.

👇

[3] Let's imagine that you are building your first Python project and you install the "requests" library:

pip install requests

You get version 2.24.0 installed in your system.

👇

[4] A month later, you decide to work on your second project. It also needs the "requests" library.

But the latest version is not 2.24.0 anymore.

Now version 3 is available, and that's the one you want to use!

👇

[5] You could upgrade your entire system to version 3, but then you'll be potentially breaking the first project you built that depends on 2.24.0!

Can you imagine this happening on a server with many more applications running?

👇

[6] Virtual environments solve this problem.

The first step for every new project is to create a virtual environment for it.

Some people have a central location where they store all environments. I prefer to keep them inside the project folder.

👇

[7] You can create a new virtual environment with Python 3 using the following command:

python3 -m venv .myvenv

Then, you can use "source" to activate the environment.

At this point, you'll have full isolation for your project.

👇

[8] If you install any libraries within a virtual environment, they will never mess with the libraries installed at the system level or other virtual environments.

And this is great!

Here is a @realpython's article covering virtual environments: https://t.co/lgXqJDUlKw

[9] The built-in "venv" module is not the only way to create virtual environments. Here are other options:

- conda
- pipenv
- virtualenv

What's your choice?

More from Santiago

Santiago
@svpino

11 key concepts of Machine Learning.

— Supervised Learning Edition —

🧵👇

😜

Before starting, remember that, if you follow me, one of your enemies will be immediately destroyed (and you'll get to read more of these threads, of course.)

And if you don't follow me, well, you just hurt my feelings.

😜

1. Labels

(Also referred to as "y")

The label is the piece of information that we are predicting.

For example:

- the animal that's shown in a picture
- the price of a house
- whether a message is spam or not

👇

2. Features

(Also referred to as "x")

These are the input variables to our problem. We use these features to predict the "label."

For example:

- pixels of a picture
- number of bedrooms of a house
- square footage of a house

👇

3. Samples

(This is also known as "examples.")

A sample is a particular instance of data (features or "x.") It could be "labeled" or "unlabeled."

👇

Santiago
@svpino

My recommendations to start with machine learning math:

• Statistics 110: Probability — Harvard University
• Essence of Linear Algebra — 3Blue1Brown
• Multivariate Calculus — Coursera

Links and 3 additional free resources here: https://t.co/fEmpmRKEvJ

If you are looking for more machine learning content, give me a follow and I’ll keep your feed interesting 😉.

Advertisement

Santiago
@svpino

My recommendation to start learning how to deal with structured data: Kaggle's Pandas Tutorial.

• Creating, Reading, Writing
• Indexing, Selecting, Assigning
• Summary Functions, Maps
• Grouping, Sorting
• Data Types, Missing Values
• Renaming, Combining

100% Python 🐍.

Santiago
@svpino

Machine learning education is broken.

If you are preparing for a research position, you are good. If you are looking to get out there and start solving problems, not even close.

Here are some thoughts so you can get ahead.

↓

Most classes, courses, and books cover the same road.

They start with a dataset. They finish with a working model. The focus is always on everything that happens in between.

Dataset → Model.

This is great, but not enough.

Real-life situations rarely start with a dataset, and they never end after you finish building your model.

Applying machine learning successfully is hard.

Here are a few examples that you should keep in mind.

First challenge: Properly framing up the problem.

If you don't understand the problem, you can't determine what data you need. If you don't understand the data, you can't build a good model.

I've never seen a company that had their data ready to go.

In fact, most of them don't even have data at all and need you to determine what exactly they should start collecting.

You usually have to go Problem → Potential Solution → Data.

Santiago
@svpino

20 machine learning questions that will make you think.

(Cool questions. Not the regular, introductory stuff that you find everywhere.)

🧵👇

1. Why is it important to introduce non-linearities in a neural network?

2. What are the differences between a multi-class classification problem and a multi-label classification problem?

3. Why does the use of Dropout work as a regularizer?

👇

4. Why you shouldn't use a softmax output activation function in a multi-label classification problem when using a one-hot-encoded target?

5. Does the use of Dropout in your model slow down or speed up the training process? Why?

👇

6. In a Linear or Logistic Regression problem, do all Gradient Descent algorithms lead to the same model, provided you let them run long enough?

7. Explain the difference between Batch Gradient Descent, Stochastic Gradient Descent, and Mini-batch Gradient Descent.

👇

8. What are the advantages of Convolution Neural Networks (CNN) over a fully connected network for image classification?

9. What are the advantages of Recurrent Neural Networks (RNN) over a fully connected network when working with text data?

👇

More from Machine learning

$Fionna O'Leary, \U0001f56f\U0001f1ea\U0001f1fa$

Fionna O'Leary, 🕯🇪🇺...
@fascinatorfun

Thanks for this incredibly helpful analysis @dgurdasani1

Two questions. 1/ Does this summarise the AZ published data :
The plan is to extend the time interval for all age groups despite it being largely untested on the over 55yrs, although the full data is not yet published

SUMMARY: the Oxford/Astra trial examined dosing with gaps between 4-12 wks- although longer gaps appear to be limited mostly to younger participants. There was no difference reported in published data between these & efficacy from the 1st dose seems high for severe disease.
— Deepti Gurdasani (@dgurdasani1) December 31, 2020

Do we have the actual numbers of over 55yr olds given a 2nd dose at c12 weeks and the accompanying efficacy data?

Not to mention the efficacy data of the full first dose over that same period?

I’d quite like to know whether I am to be a guinea pig & the ongoing risks to manage

You attached photos of excerpts from a paper. Could you attach the link?

Re Pfizer. As I understand it the most efficacious interval for dosing was investigated at the start of the trial.

Discussions of 1 vs 2 doses suggest many are not aware of Pfizer's trials which evaluated 1 vs 2 dose immunogenicity, assessed multiple formulations (BNT162b1 BNT162b2 etc) & conducted dose-ranging in both young & old adults at the start. Saw "clear benefit of booster at day 21" pic.twitter.com/mpyxu9xFSF
— Dr Nicole E Basta (@IDEpiPhD) December 31, 2020

Here’s the link to the

I’ve got to say that this way of making and announcing decisions is not inspiring confidence in me and I am very pro vaccination as a matter of principle, not least because my brother caught polio before vaccinations available.

Alejandro Piad Morffis
@AlejandroPiad

This is a Twitter series on #FoundationsOfML.

❓ Today, I want to start discussing the different types of Machine Learning flavors we can find.

This is a very high-level overview. In later threads, we'll dive deeper into each paradigm... 👇🧵

Last time we talked about how Machine Learning works.

Basically, it's about having some source of experience E for solving a given task T, that allows us to find a program P which is (hopefully) optimal w.r.t. some metric

I'm starting a Twitter series on #FoundationsOfML. Today, I want to answer this simple question.

\u2753 What is Machine Learning?

This is my preferred way of explaining it... \U0001f447\U0001f9f5
— Alejandro Piad Morffis (@AlejandroPiad) January 12, 2021

According to the nature of that experience, we can define different formulations, or flavors, of the learning process.

A useful distinction is whether we have an explicit goal or desired output, which gives rise to the definitions of 1️⃣ Supervised and 2️⃣ Unsupervised Learning 👇

1️⃣ Supervised Learning

In this formulation, the experience E is a collection of input/output pairs, and the task T is defined as a function that produces the right output for any given input.

👉 The underlying assumption is that there is some correlation (or, in general, a computable relation) between the structure of an input and its corresponding output and that it is possible to infer that function or mapping from a sufficiently large number of examples.

Advertisement

IM POCUS Focus
@IMPOCUSFocus

A tweetorial on optimal machine settings for B line image acquisition, with a focus on: focal position at pleura, harmonics off, and increased far gain.

Inspired/based on the recent article - https://t.co/vv2xBSZm6N
@cameron_baston @IsaacMatthiasM1

#POCUS #IMPOCUS

1/18

Let's start with some polls
We will stick to low frequency probes here (i.e. curvilinear and phased array - linear has its own purpose for detailed pleural assessment)

Which preset do you prefer for B line assessment?

2/

What depth do you typically set?

3/

After selecting preset and selecting depth, do you ever adjust any other machine settings to optimize B line assessment?

4/

Importantly, there is no right answer to the above questions!

We won't discuss much about preset or probe type. But we will discuss machine settings to optimize B line quality, based on
1) Theory based on physical basis of B lines
2) In vitro study
3) Study in patients

5/

Santiago
@svpino

20 machine learning questions that will make you think.

(Cool questions. Not the regular, introductory stuff that you find everywhere.)

🧵👇

1. Why is it important to introduce non-linearities in a neural network?

2. What are the differences between a multi-class classification problem and a multi-label classification problem?

3. Why does the use of Dropout work as a regularizer?

👇

4. Why you shouldn't use a softmax output activation function in a multi-label classification problem when using a one-hot-encoded target?

5. Does the use of Dropout in your model slow down or speed up the training process? Why?

👇

6. In a Linear or Logistic Regression problem, do all Gradient Descent algorithms lead to the same model, provided you let them run long enough?

7. Explain the difference between Batch Gradient Descent, Stochastic Gradient Descent, and Mini-batch Gradient Descent.

👇

8. What are the advantages of Convolution Neural Networks (CNN) over a fully connected network for image classification?

9. What are the advantages of Recurrent Neural Networks (RNN) over a fully connected network when working with text data?

👇

Caio Rolla
@caio_rolla

Starting a new project using #Angular? Here is a list of all the stuff i use to launch my projects the fastest i can.

A THREAD 👇

Have you heard about Monorepo? I created one with all my Angular (and Nest) projects using https://t.co/aY5llDtXg8.

I can share A LOT of code with it. Ex: Everytime i start a new project, i just need to import an Auth lib, that i created, and all Auth related stuff is set up.

Everyone in the Angular community knows about https://t.co/kDnunQZnxE. It's not the most beautiful component library out there, but it's good and easy to work with.

There's a bunch of state management solutions for Angular, but https://t.co/RJwpn74Qev is by far my favorite.

There's a lot of boilerplate, but you can solve this with the built-in schematics and/or with your own schematics

Are you not using custom schematics yet? Take a look at this:

https://t.co/iLrIaHVafm
https://t.co/3382Tn2k7C

You can automate all the boilerplate with hundreds of files associates with creating a new feature.

You May Also Like

Anu Satheesh
@AnuSatheesh5

Importance of Famous Payyannur Pavithra Mothiram or Ring

Payyanur Sri Subramanya Swami Temple 🚩
Kerala

Temple, constructed by Parasurama is known as the 'Pazhani' of Kerala.The place got its name from 'Payyante Ooru' where Payyan is another name by which Subramanya was called.

There are references about this temple in Brahmanda purana. Muni Garga mentions this temple and the place to the Pandavas when they were in Vanavasa. Temple was destroyed two times, once due to fire and then during the attack of Tipu Sultan.

Important tradition here is wearing of Pavithram by the temple priest. Pavithram is a sort of ring worn during performing Vedic rituals or during the "pithrubali". Usually worn while performing Tarpana or Shradham. The traditional Pavitram is usually made of Dharbha grass

Simon DeDeo
@SimonDeDeo

"I lied about my basic beliefs in order to keep a prestigious job. Now that it will be zero-cost to me, I have a few things to say."

As a dean of a major academic institution, I could not have said this. But I will now. Requiring such statements in applications for appointments and promotions is an affront to academic freedom, and diminishes the true value of diversity, equity of inclusion by trivializing it. https://t.co/NfcI5VLODi
— Jeffrey Flier (@jflier) November 10, 2018

We know that elite institutions like the one Flier was in (partial) charge of rely on irrelevant status markers like private school education, whiteness, legacy, and ability to charm an old white guy at an interview.

Harvard's discriminatory policies are becoming increasingly well known, across the political spectrum (see, e.g., the recent lawsuit on discrimination against East Asian applications.)

It's refreshing to hear a senior administrator admits to personally opposing policies that attempt to remedy these basic flaws. These are flaws that harm his institution's ability to do cutting-edge research and to serve the public.

Harvard is being eclipsed by institutions that have different ideas about how to run a 21st Century institution. Stanford, for one; the UC system; the "public Ivys".

Advertisement

Sumit Grrg
@sumitgrrg

These 10 threads will teach you more than reading 100 books

Five billionaires share their top lessons on startups, life and entrepreneurship (1/10)

I interviewed 5 billionaires this week

I asked them to share their lessons learned on startups, life and entrepreneurship:

Here's what they told me:
— GREG ISENBERG (@gregisenberg) January 23, 2021

10 competitive advantages that will trump talent (2/10)

To outperform, you need serious competitive advantages.

But contrary to what you have been told, most of them don't require talent.

10 competitive advantages that you can start developing today:
— Sahil Bloom (@SahilBloom) March 20, 2021

Some harsh truths you probably don’t want to hear (3/10)

I\u2019ve gotten a lot of bad advice in my career and I see even more of it here on Twitter.

Time for a stiff drink and some truth you probably dont want to hear.

\U0001f447\U0001f447
— Nick Huber (@sweatystartup) January 3, 2021

10 significant lies you’re told about the world (4/10)

THREAD: 10 significant lies you're told about the world.

On startups, writing, and your career:
— Julian Shapiro (@Julian) January 9, 2021

Jaynesh Kasliwal
@JayneshKasliwal

A simple #swingtrading strategy
1. Whenever you see a stock in strong uptrend it will tend to take support on its 21 ema.
2. Always look whether the stock has taken support previously.
@kuttrapali @rohanshah619 @chartmojo @chartworldat
#adaniports #balajiamine #jswsteel

3. 21 ema will act as dynamic support in a trending market
4. Risk: Reward is favourable in such setups
5. 50 ema can also act as support which can be kept as stoploss for swing trading
6. Volume should be less during pullbacks .
#nifty50 #stockmarket #CHARTS

Reshu Nath
@ReshuNath

'Tera mera rishta kya, hindu, hindu,hindutva' is a clear take on 'tera mera rishta kya,la ilaha illallah'. As much as Hindutva hates the monotheistic religions especially Islam, there's a strange wistfulness and subliminal need at display now, to BE that they hate. 1

Charlie Hebdo doesn’t come up as a cautionary tale now but rather 'why cant we be like that'?
Growing up, Hanuman was an adorable deity for us, who swallowed the sun, or who couldn’t figure out what was Sanjeevani booti so he picked up a whole mountain and came back with it. 2

Or he was loyal, admirable and when he cleaved his chest, you saw both Ram and Sita. Now we have a lot of “Angry Hanuman” stickers. Why is a cute childlike God angry? We don’t know. It's a convenient blank space where to paint all the angst of Hindu Khatre mein hain narrative. 3

The other strange thing that has started happening is pictures of Ram appearing sans Sita. “Jai Siya Ram” has become “Jai Shri Ram”. Some people disingenuously explain it as being the same thing - because Shri is a name of Lakshmi. Not really. Siya is an apbhransh of Sita. 4

Shri is a prefix of respect in this case. Hinduism is being militarised. A woman/Sita has no place in it. Even the militaristic Goddess that is Durga has no place in this conception of neo-Hindu divinity, as evidenced by Dilip Mandal wondering where Durga came from. 5