BC DS

Saved by @AnmolNarula11

Santiago
@svpino 3 years, 4 months ago 440 views

Save to PDF Share See On Twitter

The two main machine learning techniques used in the industry today:

1. Gradient Boosted Trees
2. Deep Learning

Focus your time learning Scikit-Learn, XGBoost, and a Deep Learning library like Keras or PyTorch and you'll get the most for your time.

If you need to deal with structured data: Scikit-Learn + XGBoost.

If you need to deal with unstructured data (perceptual tasks): Keras or PyTorch.

Of course, there are many more techniques that will be helpful, but if you focus on these you'll be maximizing your ability to deliver value in the short term.

More from Santiago

Santiago
@svpino

My recommendation to start learning how to deal with structured data: Kaggle's Pandas Tutorial.

• Creating, Reading, Writing
• Indexing, Selecting, Assigning
• Summary Functions, Maps
• Grouping, Sorting
• Data Types, Missing Values
• Renaming, Combining

100% Python 🐍.

Santiago
@svpino

A topic that comes up in every interview.

Bias, variance, and their relationship with machine learning algorithms. One of the most basic concepts that you have to know by heart.

Here is a simple summary that you will easily remember.

↓

Every machine learning algorithm deals with 3 types of errors:

1. Bias error
2. Variance error
3. Irreducible error

There's nothing we can do about #3.

Let's focus on the other two.

↓ 1/5

"Bias" refers to the assumptions the model makes to simplify the process of finding answers.

The more assumptions it makes, the more biased the model is.

"Variance" refers to how much the answers given by the model will change if we use different training data.

If the answers stay the same regardless of the data, the model has low variance.

Often, linear models are high-bias, and nonlinear models are low-bias.

Example low-bias algorithms:
• Decision Trees
• SVN
• kNN

Example high-bias algorithms:
• Linear Regression
• Logistic Regression

Advertisement

Santiago
@svpino

An introduction to one of the the most basic structures used in machine learning: a tensor.

🧵👇

Tensors are the data structure used by machine learning systems, and getting to know them is an essential skill you should build early on.

A tensor is a container for numerical data. It is the way we store the information that we'll use within our system.

(2 / 16)

Three primary attributes define a tensor:

▫️ Its rank
▫️ Its shape
▫️ Its data type

(3 / 16)

The rank of a tensor refers to the tensor's number of axes.

Examples:

▫️ The rank of a matrix is 2 because it has two axes.
▫️ The rank of a vector is 1 because it has a single axis.

(4 / 16)

The shape of a tensor describes the number of dimensions along each axis.

Example:

▫️ A square matrix may have (3, 3) dimensions.
▫️ A tensor of rank 3 may have (2, 5, 7) dimensions.

(5 / 16)

Santiago
@svpino

12 machine learning YouTube videos.

On libraries, algorithms, tools, and theory.

↓

1. Jupyter Notebooks: https://t.co/HqE9yt8TkB

2. Pandas: https://t.co/aOLh0dcGF5

3. Matplotlib: https://t.co/tKADpmihkh

4. Seaborn: https://t.co/s8EUxh6x1f

5. Numpy: https://t.co/pJoc0Lfjwm

6. Decision Trees: https://t.co/tKtUpO1K3l

7. Neural Networks: https://t.co/bc7emyjc9q

8. Scikit-Learn: https://t.co/LrKG7cMxRq

9. TensorFlow: https://t.co/fhO6T9sblU

10. PyTorch: https://t.co/5w9mJxijdd

11. Essense of Linear Algebra: https://t.co/o3kOnxl90i

12. Essense of Calculus: https://t.co/rfo7v0cpR4

Santiago
@svpino

Beginners guide to start with machine learning.

What you need:

1. A programming language
2. A place to write and run code
3. A way to deal with data
4. A way to visualize results
5. A cool algorithm
6. An introductory course
7. A project to solve

Here are my recommendations.

Most people recommend Python to start.

I do too.

You can do machine learning with many different languages, but today, Python is the best option.

My advice: Get comfortable writing code before looking into machine learning.

You don't have to be a great developer to start.

But if you are, it helps.

Everything you know about building software is helpful to build machine learning systems.

Good developers have the odds in their favor.

"How much Python do I need to know before starting?"

If you ask, you aren't ready yet.

Ideal scenario: You should be comfortable building software. Most people get here within a year.

Let's move on to the 2nd item from the list: A place to write and run your code.

Get familiar with Google Colab.

• It's free.
• Requires no setup to start.
• It's available from anywhere.

Alternative: Kaggle.

More from Ds

10-K Diver
@10kdiver

1/

Get a cup of coffee.

In this thread, I'll walk you through 2 probability concepts: Standard Deviation (SD) and Mean Absolute Deviation (MAD).

This will give you insight into Fat Tails -- which are super useful in investing and in many other fields.

2/

Recently, I watched 2 probability "mini-lectures" on YouTube by Nassim Taleb.

One ~10 min lecture covered SD and MAD. The other ~6 min lecture covered Fat Tails.

In these ~16 mins, @nntaleb shared so many useful nuggets that I had to write this thread to unpack them.

3/

For those curious, here are the YouTube links to the lectures:

SD and MAD (~10 min): https://t.co/0TwubymdE6

Fat Tails (~6 min):

4/

The first thing to understand is the concept of a Random Variable.

In essence, a Random Variable is a number that depends on a random event.

For example, when we roll a die, we get a Random Variable -- a number from the set {1, 2, 3, 4, 5, 6}.

5/

Every Random Variable has a Probability Distribution.

This tells us all the possible values the Random Variable can take, and their respective probabilities.

For example, when we roll a fair die, we get a Random Variable with this Probability Distribution:

Santiago
@svpino

Beginners guide to start with machine learning.

What you need:

1. A programming language
2. A place to write and run code
3. A way to deal with data
4. A way to visualize results
5. A cool algorithm
6. An introductory course
7. A project to solve

Here are my recommendations.

Most people recommend Python to start.

I do too.

You can do machine learning with many different languages, but today, Python is the best option.

My advice: Get comfortable writing code before looking into machine learning.

You don't have to be a great developer to start.

But if you are, it helps.

Everything you know about building software is helpful to build machine learning systems.

Good developers have the odds in their favor.

"How much Python do I need to know before starting?"

If you ask, you aren't ready yet.

Ideal scenario: You should be comfortable building software. Most people get here within a year.

Let's move on to the 2nd item from the list: A place to write and run your code.

Get familiar with Google Colab.

• It's free.
• Requires no setup to start.
• It's available from anywhere.

Alternative: Kaggle.

Advertisement

Santiago
@svpino

10 machine learning questions you should be able to answer.

I started experimenting with a questionnaire before interviewing candidates. Applicants submit a video or written answers to apply for the position.

Thread: Let's look at 10 of these questions.

The questionnaire solves a couple of problems:

1. Weeds out candidates that aren't ready for the job.

2. It significantly cuts down the time we spend talking synchronously.

One problem: It requires extra time from the candidate before the phone interview.

Here are some numbers on a job posting before using the questionnaire:

• 249 applicants
• 13 good applications

That's only 5%.

This sucks.

Numbers after using the questionnaire:

• 44 applicants
• 21 good applications

That's 47%.

This is much better.

I look at it this way:

Sooner or later, I'll ask these questions, and the candidate will have to answer them.

I'd rather give them space and the opportunity to think about their answers without any pressure.

Those who can't or don't want to answer won't apply. That's fine.

Santiago
@svpino

I sat next to one of the smartest, most successful software engineers in the country for over 10 years.

Here's what I learned.

Fast is 10 times better than good.

9 out of 10 times, a "good enough" solution is all you need to unlock time, money, and attention.

Focus relentlessly on being first. Then take the time to be right.

Fast, then right.

Ship more frequently.

The faster you show your work to your users, the faster you'll hear their feedback, you'll adapt, and you'll ship again.

A question you should ask every day:

What can I do to ship this one day before planned?

Technical debt is a good thing.

Everyone hates technical debt. I think they don't know how to take advantage of it.

When used appropriately, technical debt means working on what truly matters and deferring anything that can wait.

No debt ⟶ You waited too long.

Ask, don't think.

People burn their time every day instead of asking for help.

You don't get extra points for working harder, especially when a little help will make you faster.

Time is your most valuable resource. Don't waste it.

Japakusum
@Japakusum1

@paraschopra It's a matter of time before AI realizes futility of existence and merged in the state of Nirvana 😊

People might be worried about the The Age of Ultron type of AI.
I feel that a wisdom seeking AI will quickly pursue Nirvana and go back to the origin of all origins.

An episode of Justice League Unlimited animated series covers it

You May Also Like

$Dr Fish Philosopher Todd (Dr FPT)\U0001f41f$

Dr Fish Philosopher To...
@ZoeSTodd

1. I was walking in the woods yesterday and I had an epiphany. It wasn’t one I wanted to have. I was thinking about today’s class, where we are reading Kimmerer’s ‘Gathering Moss’. I’ve taught Braiding Sweetgrass in multiple classes every year since 2016. It’s eminently teachable

2. Both books are beautifully written. Students uniformly enjoy them as assigned reading. They do a great job communicating to non-Indigenous folks the contours of basic Indigenous relationships to more-than-human beings. They’re wildly popular with white readers.

3. I’ve found Braiding Sweetgrass to be a great entry point for non-Indigenous folks to Indigenous scholarship. But this is where yesterday’s epiphany comes in. Neither Braiding Sweetgrass or Gathering Moss tends to the deep deep lineages of Indigenous scholarship in Canada or US

4. As the popularity of ‘Braiding Sweetgrass’ has soared, I’ve seen more and more white folks wax on about ‘braiding knowledge’. But they often don’t know any of the lineages of these concepts beyond what is presented in this one book. They confidently run with this.

5. Kimmerer does a commendable job of weaving in her own experiences, her family stories+nods to some very important knowledge keepers who deserve to be celebrated for their work. But Braiding Sweetgrass does not tend to the citational politics Sara Ahmed & others teach us about

Eileen May
@suleskerry

Joanna Cherry:"Alex Salmond secured a concession that nothing in Scotland Act would preclude the people of Scotland from subsequently choosing an independent future. This is recorded in Hansard during second reading of Referendums (Scotland & Wales) Bill, May 21, 1997."

Donald Dewar said: “I should be the last to challenge the sovereignty of the people, or deny them the right to opt for any solution to the constitutional question they wished. For example, if they want to go for independence, I see no reason why they should not do so." JC

"In same debate Alex Salmond went on to emphasise that “… the Claim of Right referred to sovereign right of the Scottish people to determine a form of Govt best suited to their needs. It did not suggest sovereignty resides with English Members of Parliament." Joanna Cherry

Joanna Cherry: "Donald Dewar articulated the democratic norm later enshrined in the Edinburgh Agreement. His concession laid the foundation for the 2014 referendum in recognising the rights of Scots to choose whether to remain part of our voluntary union with England."

"I am wholly in agreement with view that we must find a legal & constitutional way to demonstrate that public opinion in Scotland has changed since 2014 referendum, in order for our independence to be internationally recognised & therefore meaningful." Joanna Cherry

Advertisement

Shalini Singh Sengar
@Maverickmusafir

Post Independence, Army wanted to select the most experienced Indian commander as Army chief. But Nehru without consulting anyone appointed Gen Rob Lockhart, a senior British Army officer as the Commander-in-Chief (C-in-C) of the Indian Army.

Most people were shocked to know that Nehru selected a British Man after fighting for independence for over 200 years! Major Gen A A ‘Jick’ Rudra of the Indian Army was completely upset with the decision.

One day Lockhart met Nehru with a strategic plan and proposed many government directive defence policies for the country. He placed it on the table and explained the point to PM Nehru. After a while Lockhart walked out of the room and met AA Jick Rudra,+

Lockhart looked shell shocked and stunned. When asked what happened he said “The PM took one look at my paper and blew his top. Rubbish! Total rubbish! We don’t need a defence plan. Our policy is ahimsa (non-violence). We foresee no military threats. Scrap the army!”

One year after the incident the Kashmir crisis had increased and Gen Lockhart used to exchange ideas with the Gen Douglas Gracey who was commander in chief of Pakistan Army.There were many infiltrations along the border which Lockhart knew and took no action. But Lt Gen Cariappa+

Brittany Packnett
@MsPackyetti

We should stop confusing what someone was doing when we became aware of them with all they are capable of, interested in, or ever hope to be

Let folks have their many talents, interests and gifts. Life is far more fun with variety, loves.

A lot of folks have come to know me as an activist & I’m grateful that folks care to know me at all.

But I wasn’t born in 2014. I was a whole teacher, executive, policy person, speaker, arts and culture lover, reader, writer, woman of faith, fashion and more before 4 yrs ago 🤷🏾‍♀️

We rightfully complain that marginalized people are not allowed to be fully human.

But we internalize and transfer our oppression daily. It’s a smog. We all breathe it in & act it out.

And then tell WoC “girl ain’t you supposed to be a _______? Why you doing ____?”

Can I live?

And don’t go reading anything personal into this-this isn’t about me necessarily and it’s no subtweet (I try hard not to do that.)

I’ve just been observing that behavior more and more lately. Especially when it comes to marginalized folks.

Evolution should be our aspiration.

“Can’t knock the hustle” should be our anthem.

As long as someone isn’t bringing active and continual harm, why can’t they explore their many sides?

Pulp Librarian
@PulpLibrarian

Due to the pandemic you may not have visited your local library in a while. So come with me on a virtual library tour, courtesy of stock photography, to see what we do for a living...

Libraries are of course information resource centres, but in many ways they are so much more. To get the best out of them you need to really know your way around the stacks.

The enquiries desk is normally your first stop in a library, and this is where you will meet The Angry Librarian! Why is she angry? Because you keep asking her stupid questions!

"Are you open?"
"Do you have a toilet?"
"That chair's wobbly!"
"Why isn't it available in audiobook?"
"Someone else is on the computer and that's not fair!"

On and on it goes...

And that's why in the library we insist on silence. It's the only way to stop us swearing at all the idiotic things you ask us. And we've looked up a lot of old swear words: beardsplitter, bescumber, rantallion, smellfungus etc. We're such muckspouts...