BC MACHINE LEARNING
Saved by @Alex1Powell

Here's how I got started with my first machine learning project and you can too.
Let's take a look.

(This thread will take from zero to being a hero in machine learning, trust me)

(1 / 22)
🧵👇

 Getting started with your first machine learning project might actually much easier than it seems, if I can do it, certainly anyone can.

I did not use:
- Any Math
- An expensive computer
- Complex programming concepts

(2 / 22)
Here's what I did use:

- A free GPU on Google Colab
- Python
- TensorFlow
- Numpy
- Pandas
- Kaggle
- Scikit-Learn
- Google
- StackOverFlow

(3 / 22)
This project was actually a Kaggle challenge based on the MNIST dataset which is a collection images of 70,000 hand written digits.

You can find the dataset here👇
🔗//kaggle.com/c/digit-recognizer

(4 / 22)
Before we go over the code of this project, it is highly reccomended that you complete this free course on YouTube👇

Machine Learning foundations course
🔗//youtu.be/_Z9TRANg4c0

Code👇
🔗//colab.research.google.com/github/PrasoonPratham/Kaggle/blob/main/MNIST.ipynb

(5 / 22)
Now let's look at the code.

We'll first download the dataset for this project using the kaggle API for Python.
Keep in mind that you'll have to provide an API key so that this code works.

(6 / 22)
There are some issues with the names of the files, so we'll rename and then unzip them using the zip library.

(7 / 22)
We'll end with 3 files, we can discard the sample_submission.csv as we won't need it. test.csv and train.csv is what we are interested in.

The train.csv will be used for training our neural and test. csv will be used for making predictions.
(8 / 22)
The prediction will be sent to kaggle.

Using pandas we can load both of them as dataframes, which basically converts .csv file data(excel like data) python arrays so that we can put them in our neural network.
We'll also import TensorFlow and Numpy while we are here.

(9 / 22)
Let's look at the data, train.csv is what we are interested in.

The training data set, (train.csv), has 785 columns. The first column, called "label", is the digit that was drawn by the user. The rest of the columns contain the pixel-values of the associated image

(10 / 22)
Each image is 28 pixels in height and 28 pixels in width, for a total of 784 pixels in total. Each pixel has a single pixel-value associated with it, indicating the lightness or darkness of that pixel, with higher numbers meaning darker.

(11 / 22)
This pixel-value is an integer between 0 and 255, inclusive. We will pass the pixel values in our neural net and exclude the label, we don't want it to know what number is in the image! It'll have to learn that on its own.

(12 / 22)
This code "drops" the label column and stores it in the Y_train variable, we will also divide each pixel value by 255 to make it a value between 0-1 as neural networks perform better with these values and now we "reshape" the values which go into our neural net.

(13 / 22)
Remember how I said, we'll only use the train.csv for training our neural net? We'll split the train.csv into 2 parts, one for actual training and the other for validating how well our neural net did at the end of each iteration.This boosts the accuracy of our model.

(14 / 22)
Note that here I have chosen 10% of our dataset for validation and the rest for training, you can experiment with the values yourself if you wish to do so.

(15 / 22)
Here comes the fun part, we'll now define our neural network. The images will pass through these and our model will be trained. We'll be using this thing called a "convolution" and "pooling".

(16 / 22)
A convolution in simple terms is like applying a filter (like you do on instagram) to a photo, this increases some of the details in the images and helps improve our neural network's accuracy.

(17 / 22)
Pooling does a similar thing by taking the most prominent pixel in an area and throwing out the others.

I found this amazing thread on convolutions by @aumbark which you should definately check out👇

https://t.co/CnsQvMpHZE

(18 / 22)
Now we simply pass our data 15 times (aka epochs) through our neural network and validate it each time using the validation data we made earlier.

(19 / 22)
You'll notice that we get certain metrics in the output, at the end you should see a loss and accuracy similar to the one in the photo.

(20 / 22)
Congrats!🥳 You've trained the neural network, now can make the predictions on the test data and store them in a csv file which we'll submit to kaggle. (You can use the file icon in the left to browse through the files)

(21 / 22)
You've learnt a lot by this point, be proud of yourself and dive deeper into machine learning, good luck! 🙌

(22 / 22 🎉)

More from Pratham Prasoon 🚀

Pratham
Pratham
@PrasoonPratham
Everyone tells you how important math is in machine learning.

But I believe that if you want to learn machine learning today, there are things more important than math which very few people will tell you about.

Here are 5 of them.

🧵 👇🏻

The field of machine learning has been very academic which is why there is so much emphasis on learning math for it.

But, today with the frameworks that we have, not knowing how to multiply matrices is far less of an issue than knowing how to use the tools in this list 👇🏻

Yes, I know; you have R, Julia, and whatnot for machine learning but as of today, Python is the industry standard.

Get your data structures and algorithms right in Python because you will need them, here are some concepts worth learning 👇🏻


Let's say you're building the next big GPT-3 powered app that's going to take over the world.

You add a new feature to your app but it breaks the entire thing, what do you do now?

Learn Git, the ultimate version control tool.

I use this cheat sheet for all my git needs 👇🏻


You will be constantly be working on multiple packages which specific python version requirements 🐍

Virtual environments like Anaconda or Poetry will make this process much easier for you.

Who likes to see broken dependencies while running code?
ALL
Pratham Prasoon
Pratham Prasoon
@PrasoonPratham
A simple guide on how to train your first neural network in under 10 minutes to kick-start your machine learning journey.

(+ no setup required and free extra resources)
🧵👇

For this exercise, you'll need :
- A computer/phone
- An internet connection
- Very basic Python knowledge
- Willingness to learn

What you do not need:
- Complex math
- An expensive computer
- A PhD

Math will come later on in your machine learning journey :)

(2 / 15)

Here's our problem,we are given data in which we are given the number of flats in a house and its corresponding price. Like a house with one flat is worth 10000, and 20000 for a house with 2 flats.

(3 / 15)


We can clearly tell that the price of the house increases by 10000 per extra flat however our computer does not know this and we won't it tell it about this, it'll have to figure things out on its own.

(4 / 15)

Here's the code👇

(5 / 15)
MACHINE LEARNING
Advertisement
Pratham Prasoon
Pratham Prasoon
@PrasoonPratham
Are you planning to learn to Python for machine learning this year?

Here's everything you need to get started.
🧵👇

In this thread we'll look at all the concepts in Python you need to know for machine learning along with free resources to help you out.

All of this is based on my experience of successfully teaching 300+ students how to code using Python.

(2 / 19

You can use many languages for machine learning, why Python?

Because of 2 reasons:
- Comparatively easier to learn than other languages
- Has the biggest and most mature community

This makes Python a no-brainer to learn for machine learning as a beginner.

(3 / 19)

These are the absolute basics which you must know about:

- Basic terminal commands
- Basic arithmetic (+,-,/,*)
- Accepting user input
- For & While loops
- Exception handling
- If-Else statements
- Functions, modules & Imports

(4 / 19)

Then comes the more tougher concepts which you must know about:

- Object oriented programming in Python:Classes, Objects, Methods
- PIP (Pypi)
- List slicing
- String formatting
- Dictionaries & Tuples
- Managing environments
- Dunder methods like __init__

(5 / 19)
MACHINE LEARNING , PYTHONML
Pratham Prasoon
Pratham Prasoon
@PrasoonPratham
Are you planning to learning machine learning this year?

These are the Python frameworks you need to learn as an absolute beginner.

🧵👇

It can be overwhelming seeing all the machine learning frameworks at once and not even knowing what they do.

I made this thread so that your machine learning journey becomes just a little bit easier.

(2 / 11)

This thread will only focus on Python frameworks.

Why?
Because Python is the most common path into machine learning.

( If you have experience with any other language then learning Python will not be difficult at all. )

(3 / 11)

Here's the entire list:

- Pandas
- Numpy
- Matplotlib
- TensorFlow
- PyTorch
- Keras
- Scikit Learn

Let's see what they do.

(4 / 11)

You'll have to interact with csv files or databases on a regular basis to access data in machine learning, pandas helps you do just that.

The cool thing about Pandas is that it actually doesn't change the original data...

(5 / 11
MACHINE LEARNING
Pratham Prasoon
Pratham Prasoon
@PrasoonPratham
Machine learning terms you must know about as a beginner.

🧵👇

These terms won't mean anything unless you know what Machine learning is all about.

> Machine learning is the process of making a program which allows a computer to learn from data.

The data could be anything, images, audio or even text.

(2 / 11)

In machine learning we use something called a neural network, this is essentially an imitation of the human brain.

> Neural Networks are a digital imitation of the neurons you see in the human brain.

(3 / 11)


In these neural networks, data flows through them and each neuron (the circle) has a numerical value which will change.

> The value of a neuron gets changes to something which is close to what we want each time the data passes through the neural network.

(4 / 11)


Think of the neurons as dials on a lock, you have to tune every dial to open the lock.

It is almost impossible for a human to tune thousands of dials like these, but a computer certainly can.

(5 / 11)
MACHINE LEARNING

More from Machine learning

Alejandro Piad Morffis
Alejandro Piad Morffis
@AlejandroPiad
This is a Twitter series on #FoundationsOfML.

❓ Today, I want to start discussing the different types of Machine Learning flavors we can find.

This is a very high-level overview. In later threads, we'll dive deeper into each paradigm... 👇🧵

Last time we talked about how Machine Learning works.

Basically, it's about having some source of experience E for solving a given task T, that allows us to find a program P which is (hopefully) optimal w.r.t. some metric


According to the nature of that experience, we can define different formulations, or flavors, of the learning process.

A useful distinction is whether we have an explicit goal or desired output, which gives rise to the definitions of 1️⃣ Supervised and 2️⃣ Unsupervised Learning 👇

1️⃣ Supervised Learning

In this formulation, the experience E is a collection of input/output pairs, and the task T is defined as a function that produces the right output for any given input.

👉 The underlying assumption is that there is some correlation (or, in general, a computable relation) between the structure of an input and its corresponding output and that it is possible to infer that function or mapping from a sufficiently large number of examples.
MACHINE LEARNING
Madison Kanna
Madison Kanna
@Madisonkanna
With hard work and determination, anyone can learn to code.

Here’s a list of my favorites resources if you’re learning to code in 2021.

👇

1. freeCodeCamp.

I’d suggest picking one of the projects in the curriculum to tackle and then completing the lessons on syntax when you get stuck. This way you know *why* you’re learning what you’re learning, and you're building things

2. https://t.co/7XC50GlIaa is a hidden gem. Things I love about it:

1) You can see the most upvoted solutions so you can read really good code

2) You can ask questions in the discussion section if you're stuck, and people often answer. Free

3. https://t.co/V9gcXqqLN6 and https://t.co/KbEYGL21iE

On stackoverflow you can find answers to almost every problem you encounter. On GitHub you can read so much great code. You can build so much just from using these two resources and a blank text editor.

4. https://t.co/xX2J00fSrT @eggheadio specifically for frontend dev.

Their tutorials are designed to maximize your time, so you never feel overwhelmed by a 14-hour course. Also, the amount of prep they put into making great courses is unlike any other online course I've seen.
MACHINE LEARNING
Advertisement
Quant@Python
Quant@Python
@BeingHorizontal
Thread for beginners; How to learn machine learning.

Let’s start with something really simple and useful not just for Machine Learning.

Start with a Python library called pandas. It’s a huge library but it's mostly fun for traders because it's kind of rewarding to learn each function and how it gonna affect the way you handle the financial data.

Then learn some basic stuff about Python library called NumPy. Pandas is built on NumPy. Numpy is huge, you just need to understand some basic NumPy functions like NumPy shapes and NumPy arrays

If you understand pandas then you will understand NumPy arrays and shapes easily. Side note: Numpy shapes gonna play an important part in the deep learning model called LSTM - mainly used for time-series analysis(such as financial data) and Natural Language Processing (NLP)
MACHINE LEARNING
Pratham Prasoon
Pratham Prasoon
@PrasoonPratham
Can you get a job in data science and machine learning without a college degree?

🧵👇

Short Answer: Yes.

Long Answer, keep reading 👇

(Advice from industry experts who I talked to.)

Companies are looking for people who add value.
In order to add value, you'll need skills. Simple as that.

Get the skills to provide value and you'll get the job.

In the age of the internet where everything is pretty much free, why do college degrees matter?

A college degree makes it easier to get the skills to get a job in machine learning or data science.

College degrees also help you make many useful connections and provides many opportunities in the form of internships and whatnot.

College degrees have their own place
MACHINE LEARNING
Pratham Prasoon
Pratham Prasoon
@PrasoonPratham
These are the tools you will need for machine learning in Python.

🧵👇

Anaconda

When you work in python, you'll be working with several frameworks and many of them work only on specific versions of python.

(2 / 13)

Now imagine downloading a new version of python and then installing it for every framework you want to work with 😬.

Meet Anaconda which allows you to run several versions of python. It comes pre-installed with several data science and machine learning frameworks.

(3 / 13)

Pip-env is also a way of maintaining several versions of Python and comes pre installed with Python.
You can use pip env or Anaconda, whichever works for you.

(4 / 13)

Jupyter Notebooks

Jupyter notebooks is an IDE just like VS code or Sublime. The special thing about jupyter is that you can parts of code in mini code editors called cells. This is great for prototyping and testing code.

(5 / 13)
MACHINE LEARNING

You May Also Like

:Billy-Don :I-AM
:Billy-Don :I-AM
@ValiantThor12
1) 💜 THE EVENT 2020 - THE 1221 MULTIDIMENSIONAL STARGATE 💜
PLEIADIAN LIGHT FORCES TRANSMISSIONS - 12182020
CHANNELED BY MICHAEL LOVE
A SPECIAL MESSAGE TO THE STARSEEDS OF NEW EARTH, FOR IMMEDIATE PLANETARY BROADCAST…
PRELUDE:
THE FOLLOWING INFORMATION IS DERIVED FROM DIRECT,

2) DECODED ETHERIC TRANSMISSIONS FROM BENEVOLENT LIGHT FORCES DOCKED IN EARTH’S SOLAR SYSTEM AND SOME OF THE DATA COMES DIRECTLY FROM CERTAIN INSIDE EARTH ALLIANCE MEMBERS KNOWN AS THE WHITE HATS, AND THE GREAT WHITE BROTHERHOOD STRATEGICALLY PLACED IN KEY POSITIONS OF POWER BY

3) THE GALACTICS ON THE SURFACE OF PLANET EARTH!
THE DATA HEREIN IS RECEIVED AND TRANSMITTED FROM THE 5D LEVEL! THIS MESSAGE IS INTENDED ONLY FOR THE STARSEEDS OF EARTH!
GREAT ONES,
WE HAVE SPOKEN OF THE EVENT 2020 THIS ENTIRE EARTH YEAR AS ALL PLEIADIAN AND EARTH ALLIANCE INTEL

4) SHOWS INDEED THAT A MAJOR COSMIC EVENT IS GOING TO OCCUR IN ONLY 3 EARTH DAYS FROM NOW!
ON DECEMBER 21, 2020, A MAGNIFICENT CELESTIAL STARGATE WILL OPEN IN THE HEAVENS WHICH MARKS THE DAWN OF THE NEW GOLDEN AGE OF AQUARIUS AND THE 1ST DAY OF THE SATYUGA OF CENTRAL SUNLIGHT!

5) IN THE MORNING HOURS OF THE WINTER SOLSTICE, THE LONG-AWAITED NEW ERA OF LIGHT WILL FINALLY DAWN AND THE NEW 5D EARTH WILL BE BORN!
THE COSMIC GATES WILL BE FULLY OPENED ON 12/21/20 ALLOWING POWERFUL STREAMS OF COSMIC LIGHT TO ENTER EARTH'S ATMOSPHERE, UPGRADING ALL SENTIENT
ECONOMY
Invest Like the Best
Invest Like the Best
@InvestLikeBest
In 1937, a trucker got frustrated waiting for his cargo to be unloaded. He later sold his company for $1.1 billion.

Here’s the story of how Malcom McLean made a billion dollars and which startup could be following in his footsteps. (Inspired by our episode with @laurabehrenswu)


In the early 1950s, the shipping industry was a dying business.

New York’s docks were handling half as much domestic cargo in the early 1950s as they had been in the depressed 1930s.

In thirty years, no one had invested significant money in coastal shipping.

Why?

As McLean found out, loading ships was difficult and slow.

A truck or train would deliver items to the port. Each item was unloaded separately, recorded, and carried to storage.

When a ship was ready, each item was taken from storage, counted again, and hauled on-board.


The cost of this labor was significant. As one expert at the time explained:

“A four-thousand-mile voyage for a shipment might consume 50 percent of its costs in covering just the two ten-mile movements through two ports.”


Yet, despite the industry’s issues, it felt little pressure to change.

Foreigners were barred from operating domestically. Cartels ran international routes. And gov. subsidies eased the pain of labor costs.

Reshaping the industry needed an outsider.

Enter Malcolm McLean.
HISTORY
Advertisement
Tinker \u274e
Tinker ❎
@TinkerSec
Singing the Blues:
Taking Down an Insider Threat

"I had all of the advantages. I was already inside the network. No one suspected me. But they found my hack, kicked me off the network...

...and physically hunted me down."


Many pentests start from the outside, wanting to see how the perimeter might be breached.

This pentest started from the inside. My client wanted to assume they had already been breached, and, if breached, how far could an attacker go.

Could they stop me once I was inside?

So they snuck me in. Disguised me as a new employee. Gave me a work computer, an ID badge, an account in their system... hell, I even had a cubicle w/my assumed name on it.

The only person who knew who I really was was their CISO. Everyone else thought I was Jeremy in Marketing.

During most of the first morning, I completed onboarding, made introductions, and completed menial tasks.

But I had to act quick. I only had a week onsite. I had to hack their network while not raising suspicion.

So I set about it.

You have to understand... most "Internal Pentests" are straight forward. The hard part is breaching the network, but once you're inside, it's a target rich environment. End of Life computers, default passwords, everyone a Local Administrator...
TECH
Billy Bostickson \U0001f3f4\U0001f441&\U0001f441 \U0001f193
Billy Bostickson 🏴👁&👁 ...
@BillyBostickson
@EricTopol @NBA @StephenKissler @yhgrad B.1.1.7 reveals clearly that SARS-CoV-2 is reverting to its original pre-outbreak condition, i.e. adapted to transgenic hACE2 mice (either Baric's BALB/c ones or others used at WIV labs during chimeric bat coronavirus experiments aimed at developing a pan betacoronavirus vaccine)

@NBA @StephenKissler @yhgrad 1. From Day 1, SARS-COV-2 was very well adapted to humans .....and transgenic hACE2 Mice


@NBA @StephenKissler @yhgrad 2. High Probability of serial passaging in Transgenic Mice expressing hACE2 in genesis of SARS-COV-2


@NBA @StephenKissler @yhgrad B.1.1.7 has an unusually large number of genetic changes, ... found to date in mouse-adapted SARS-CoV2 and is also seen in ferret infections.
https://t.co/9Z4oJmkcKj


@NBA @StephenKissler @yhgrad We adapted a clinical isolate of SARS-CoV-2 by serial passaging in the ... Thus, this mouse-adapted strain and associated challenge model should be ... (B) SARS-CoV-2 genomic RNA loads in mouse lung homogenates at P0 to P6.
https://t.co/I90OOCJg7o
ALL
Vibhu Vashisth \U0001f1ee\U0001f1f3
Vibhu Vashisth 🇮🇳...
@VIBHU_Tweet
In the Hindu Epic Mahabharata, Ashwatthama or Drauni is the son of Dronacharya and the grandson of the Bharadwaj Rishi. Ashwatthama was a Maharathi who fought alongside the Kauravas against the Pandavas in the Kurukshetra War.


According to the Mahabharata, Ashwatthama means the sacred sound associated with the sound of a horse. He was given the name Ashwatthama because when he was born, he cried like a horse.

Here are some interesting facts about Ashwatthama.

- Ashwathama is one of the Ashta Chiranjeevi, Eight Immortals. Ashwatthama was born with a jewel on his forehead, giving him power over all living beings lower than humans. The jewel protected him from hunger, thirst, and fatigue.


- His strength is almost equal to Arjuna’s, especially in archery. Among the Kuru princes, he was good friends with Duryodhan, the eldest son of Dhritarashtra. They both have jealousy towards the Pandavas.


Duryodhan felt that Yudhisthir was his obstacle in inheriting the throne of Hastinapur, while Arjun’s talent made Ashwatthama jealous because he felt that his father’s love had been divided. After all, Arjuna was Drona’s favourite student.
ALL