BC HISTORICAL DATA CAPTURE METHODOLOGY
Saved by @kirankio1996

Most beginners when building a trading strategy simply use current info and test with it, they don't know How to Get Historical Stock Futures lot size, list of stocks that are part of index like Nifty 50, Nifty 500 historically, I will share all such info in this thread

 Please note that there is no way to get the historical lot size of stocks futures, NSE don't publish it directly, so we need to do some calculated steps to get that data. Download Market Activity report https://t.co/HKLkSVtXEI
The zip file contains multiple files, open the second file.
The file will contain stock symbol, expiry date, OHLC data, along with that you get traded quantity and No of contracts traded, using this data we can calculate the lot size of every stock symbol. Simply divide Traded QTY / NO of contracts gives you the lot size.
So to get the historical stock futures data, all you need to do is change the date in the below link

https://t.co/xIBXsPpIVt For an example, to get the historical stock futures lot size data for Sep 2016, use https://t.co/Criu7S3Fi5
If you want to download the FnO stocks and their lot size for current month, you can simply go to https://t.co/imuJA3Nmj7
When you are designing a stock trading system based on certain universe like Nifty 50, Nifty 500 etc, it is important to test the strategy with list of stocks that are part of these indices historically.
If you test the strategy with current Nifty 50 or Nifty 500 stocks, you will get extraordinary results due to survivorship bias. Don't do that mistake. Stocks like DLF, RCOM, UNITECH were part of Nifty 50 in 2008, not any more.
To get Historical constituents of Nifty Index data, go to https://t.co/qbCBz0w7P0 which will show you current month list of stocks that are part of different indices. Click on Archive
Select Indices - Market Capitalization from drop down and select historical month/year, click on submit. It will generate a zip file which will contain the required information.
Not only for Nifty 50, Nifty 500, you can get the list of stocks that are part of each index.
Once you open the PDF file, you can see the stock symbol, full name, which industry it belongs to and their weightage with respect to index.
So to get the historical stocks list for different indices, all you need to do is change the month/year in the below link

https://t.co/MVN1wrKt4z

For an example, to get the historical constituents of all index for Aug 2013, i will use https://t.co/k79hR372dW
The top 10 stocks of Nifty 50 determines the over all direction of the markets And this top 10 varies at frequent intervals. So to get the historical TOP 10 Nifty 50 stocks, all you need to do is change the date/month/year in the below link

https://t.co/bNMunOr74B
You can download end of the data from NSE for all equity cash segment stocks Go to https://t.co/Vo3DHGP1f0

enter the stock symbol and date criteria for which you want to download the data
To get the stock futures historical data, go to the below link select the symbol, year, expiry period and time period for which you wan to download the data

https://t.co/hjyUDNVwZ2
To get the Index spot data, go to below link and select the index from drop down and give the time period.

https://t.co/Ny8T1X8Xee
List of all ETFs:

To get the list of all Exchange Traded funds listed in NSE, just go this link https://t.co/XSqmXhmxJN
In last 25 years there were many stocks which was included in Nifty 50 and stocks that did not perform well were removed from Nifty 50. List of stocks that were added to different index and removed from different index data is available in this link

https://t.co/0Dn036xifc
The complete information has been drafted as a blog post and shared here, check it out. https://t.co/ccwXC11TnH

More from Kirubakaran Rajendran

Kirubakaran Rajendran
Kirubakaran Rajendran
@kirubaakaran
I have shared multiple information related to trading and investing through my historical data analysis by writing various articles, here's the master thread that contains all my work in one place.🧵

https://t.co/pc1jr1xBlI


https://t.co/KZJ1FKCXSp


https://t.co/pTnbkjVpr0


https://t.co/3QXmND1x6Y
THREAD
Kirubakaran Rajendran
Kirubakaran Rajendran
@kirubaakaran
A small thread on Mindset of a successful trader. What differentiates best traders from the bad ones? Why 95% of the traders don’t make money? Trading is an unpredictable game, how could one win in that? 1/n


Many people think some magical strategy or indicators is all they need to be successful at Trading. But what really goes in the minds of a successful trader? Professor Hichman Benjelloun did a research on this.

Successful traders have poker face. If you talk to successful traders or chat with them, you can’t figure out if they are happy or sad. Having good time or bad time.

For them making money or losing money is same thing, as they say a good trader feels great after a good trade, but a great trader feels NOTHING after a great trade. They control their emotions not only in trading but also outside their trading life. They are highly disciplined

Whether they are making money or losing money, they continue with their daily routine, going to gym, cycling etc they don’t skip it because of a losing trade. It doesn’t affect them. They have probability mind set. What does that mean?
ALL
Advertisement
Kirubakaran Rajendran
Kirubakaran Rajendran
@kirubaakaran
Earlier many traders were trading based on discretionary without any rules based approach. Now a lot of traders are ready to move to algo trading but confused with a lot of options. When you are bombarded with tons of different trading systems, how do you choose the best one?

Many traders still think winning accuracy is the most important parameter in a trading system. But is it really true? Let's check this example. Consider, we have three different trading systems.
System A,
System B and
System C.


System A has 90% winning accuracy,
System B has 10% winning accuracy and
System C has 50% accuracy.
When given a choice, most traders will opt for System A as it has the highest winning accuracy of all with 90%.

But System A is not the right choice. The average profit in a winning trade is Rs.1000, that is 90% of the time System A is capable of making Rs.1000 profit. But remaining 10% of the time when the system is making a loss, it loses a lot. So after 100 trades, net result is -10,000

System B, The average profit in a winning trade is Rs.10,000, that is 10% of the time System B is capable of making Rs.10K profit, which is ten times higher than its losing trade. The average loss in a losing trade is Rs.1,000 but 90% of the time the system will continue to lose.
ALL
Kirubakaran Rajendran
Kirubakaran Rajendran
@kirubaakaran
Analyzed last 12 years of historical data to check if there are any patterns we can observe to find the best time to invest in stocks for long term. #Nifty50 #investing #stocks 1/10


This is how Nifty moved in last 15 years with three major corrections, in the year 2008,then around 2016 and then year 2020 due to Coronavirus. Only when we look back with hindsight bias we could say those were the best time to invest. But is there really any quantitative method?


200 day moving average is something that is widely used by many investors to check for long term trend. Where investors consider if stocks trades above 200 DMA, its in bullish phase and if it trades below 200 DMA its in bearish phase.

We shall run an analysis to find out of Nifty 50 stocks, how many number of stocks trades above 200 day moving average, higher the number, stronger the market. we need correct data, we cannot test it with current Nifty 50 stocks,

we need list of Nifty 50 stocks that are part of index historically, so when we run for Jan 2008, stocks like RPL, RNRL, UNITECH were part of Nifty 50, so it is essential to test it with correct datasets.
TRADING
Kirubakaran Rajendran
Kirubakaran Rajendran
@kirubaakaran
I have watched lot of movies but only few movies would change your perspective towards life, here’s the 10 movies that really changed my mindset

1.The Theory of Everything

Brilliant acting , truly mesmerising portrayal on life of Stephen Hawking, never felt bored even for a sec


2. Rush - it’s a film about F1 racer James Hunt & Nikki Lauda, excellent narration and incredible acting. The dialogues were truly masterpiece and it’s still stays in mind even after 9 years


3. The Founder - This movie released at the right time in my life, when I was about to quit my job and focus full time on my startup. This movie is all about single man Ray Kroc who built a billion dollar empire McDonalds. This is the best entrepreneurship movie ever made.


4. The Imitation Game - I watched this movie when I started my rule based trading journey in 2014, struggled a lot during my initial phase with code, unable to get any breakthrough, this film gave my that ray of hope. It’s about a mathematician who broke the code n won the war


5. The Pursuit of Happyness - any favourite Movie list would be incomplete without this movie. Will Smith, damn what an actor he is. I watched this movie when I was in college days, still remember the day, I was crying non stop during the interview scene. Brilliant film.
MOVIES BUCKET

You May Also Like

XVIII Airborne Corps\U0001f409
XVIII Airborne Corps🐉...
@18airbornecorps
1 of 16: WE ARE ALL JEWS HERE: THE STORY OF RODDIE EDMONDS

One of the most moving and relevant stories of the Battle of the Bulge, or any American Soldier in any war, is that of Master Sergeant Roddie Edmonds, a Knoxville, Tennessee native, who served with the 106th Infantry.


2 of 16:

Roddie was captured early on in the Battle of the Bulge, on December 19th, when Panzer forces plowed through his unit.

He, along with almost his entire regiment, was forced to surrender.


3 of 16:

The men were transported to the Stalag IX-A POW camp in Ziegenhain, Germany.

Roddie was the senior enlisted American Soldier at the site. As such, he was the conduit between all American Soldiers and their German captors.


4 of 16:

In late January, the camp’s commandant, Major Siegmann [pictured here], ordered Roddie, a Christian, to identify all Jewish Soldiers and order them to stand in formation by themselves the next day.

[Jewish Soldiers were a minority within American units]


5 of 16:

Throughout WWII, captured Jewish Soldiers were often tortured and then killed by their German captors.

In fact, Jewish Soldiers had been told to bury their dog tags before capture. The dog tag identified Jews with the letter “H” for Hebrew.
SOCIETY
Patrick McKenzie
Patrick McKenzie
@patio11
Most software founders, particularly in B2B, need to get radically better at sales. @Steli , who is the best person for explaining the scrappy stages in the beginning and then building out a team with scripts and processes, wrote a guide to:

For technical founders it is irrationally, obscenely hard to reverse years of programming (ba dum bum) that sales is a value-destroying activity. Sales is CLEARLY a value-creating activity, contingent on you have a value-creating product.

The world will not drop what they are doing to adopt your work. This is particularly true in B2B, where simply building a better mousetrap won't overcome the activation energy required to get people with additional non-mice problems to prioritize changing mousetraps today.

This is very non-obvious for founders because founders are not often people who *want* to be sold to. We often come from a background where trying out tools is a bit of a fun hobby. We like looking at all the options, making charts, and ripping out partially complete tests.

"This week I unsuccessfully trialed four software options for automating that thing that has been killing us. Our actual production process remains the same as last week. Don't worry; this was a great use of time." is not a thing you want to write in a progress report to manager.
TECH
Advertisement
James Clear
James Clear
@JamesClear
My top 10 tweets of the year

A thread 👇

https://t.co/xj4js6shhy


https://t.co/b81zoW6u1d


https://t.co/1147it02zs


https://t.co/A7XCU5fC2m
BUSINESS , ALL
Chuck Wendig
Chuck Wendig
@ChuckWendig
TRUMP: "I've decided to eat babies."

PEOPLE: "He can't eat babies, that's super illegal."

TRUMP, on TV, eating babies, not even cooking them first: "People are saying that I really am the best baby-eater, folks."

NYT: "Trump Vs. Babies: The Rhetoric On Both Sides Must Stop"

Jeff Flake tweets: "It is a sad day in America when this callous man can eat babies live on TV"

Jeff Flake, 10 seconds later, votes to help him install a series of 4,000 new judges that are very, very pro-babyphagia.

Judge Kavanaugh, found drunk in a Capitol Hill closet: "I LIKE BEER. OKAY? I LIKE BEER AND I LIKE BABIES AND THAT'S NOT SO WRONG. THAT'S RIGHT. I LIKE BABIES DIPPED IN BEER. I JUST DIP EM. IN THE BEER. THE BABIES. THE BABIES I EAT. OKAY? THAT'S AMERICA."

Mike Pence, wringing his hands about the baby-eating: "We must take care of our children. Our youngest must be protected on this troubling day."

Mike Pence then invites a Baby Chef to say a prayer.

Twitter Users: "It's a distraction technique! Trump eating babies is trying to DISTRACT YOU from ALL THE OTHER HORRORS, which are themselves distractions from the BABY-EATING. It's DISTRACTIONS ALL THE WAY DOWN."

Trump: *eats tons of babies at a rally*

*literal tons of babies*
POLITICS
Anshul Pandey
Anshul Pandey
@Anshulspiritual
SHAKTA DHARMA AND THEIR ACHARYAS

Śhākta or Shakti or Devi pooja is not a new upasana. It is being carried out right from the time of Vedic period. Puran's tell us that Rishi Vashishth would worship Tara devi. Parshuram ji worshipped Tripura devi,


Agastya learned the secrets of Shri Vidya from Vishnu ji in Hayagriva avtaar. Bhagwan Ram, Laxman and Krishna too learned the tantrik vidya. Even Rig Ved 7.103.5 Sayan Bhasya also mentions about Śhākta/शाक्त(शाक्तस्येव शक्तिमतः).

Then we find that in the Harrappan excavations many figurines depicting Shakti were found. So in that age too, which was supposedly an urban city shakti was being worshipped. So naturally this tradition would be prevalent in rural areas too.

It is wrong to say that shakti puja originated from Bengal although it was popular there. Matsyendranath received this vidya from Maheshwari herself in Kamrup. We know that Shakti pooja is practised all over India.

Not much is known about the Śhākta saints in other parts of India in the middle ages.

Adi Shankaracharya wrote Pramanech saar named book on tantra and Anand lahri book on Devi strotras. Then there were Acharya Shankar, Bhaskar Rai, Laxman, Deshikendra, Raghav Bhatt, Krishnand,
ALL