“Cardinality” is a mathematical term: it’s *the number of elements in a set*... boring! So why tf does anybody care??
Well, because people think they need it, then suddenly, "$$$$$$$."
0/ When large eng orgs rely on metrics for both monitoring *and* observability, they struggle with cardinality.
This is a thread about “the two drivers of cardinality.” And which one of those we should kill. :)
🧵👇
“Cardinality” is a mathematical term: it’s *the number of elements in a set*... boring! So why tf does anybody care??
Well, because people think they need it, then suddenly, "$$$$$$$."
E.g., when I was working on Monarch at Google, there was a single gmail metric that became over 300,000,000 (!!!) distinct time series. In a TSDB, that cardinality is the unit of cost.
So again, “$$$$$$$.”
A) Monitoring: more detailed *health measurements*
B) Observability: more detailed *explanations of changes*
Let’s take these one at a time…
Consider an RPC metric that counts errors. You need to independently monitor the error rate for different methods. And so – voila – someone adds a “method” tag, and now there’s 10x the cardinality for that metric.
Put another way, you might rightly have different error budgets for different RPC methods, so their statistics must be separable.
This is the real culprit! And, frankly, should be abolished. :) Metrics cardinality is the wrong way to do observability – to explain changes.
More on that…
But this is unsustainable: each incident reveals a new failure mode, devs keep adding tags, and before long your metrics bill is out of control.
Distributed systems can fail for a staggeringly large number of reasons. *You can't use metrics cardinality to isolate each one.*
Understanding change is the central problem of observability. Effective workflows might *start* with metrics, but they must pivot towards a multi-telemetry, multi-service guided analysis.
PPS: If you’d like to discuss/debate/request-more-detail any of the above, reply to this thread or DM me!
0/ I\u2019m tired of hearing about observability replacing monitoring. It\u2019s not going to, and that\u2019s because it shouldn\u2019t.
— Ben Sigelman (@el_bhs) January 13, 2021
Observability will not _replace_ monitoring, it will _augment_ monitoring.
Here\u2019s a thread about observability, and how monitoring can evolve to fit in: \U0001f447 pic.twitter.com/lhb1WmKKMF
More from Society
Sandbank Danger, A Thread
Controversy Has Been Caused By The Digging Of A Narrow Channel By A Resort On A Sandbank Near K. Hinmafushi.
Hinmafushi Council President Shan Ibrahim Stated To Sun That The Resort, Which Dug The Trench Creating A River On The Sandbank, Did Not Have Ownership Over The Sandbank.
Officials From The Island Of Hinmafushi Had Traveled To The Sandbank To Stop The Process Of Digging The Trench When They Became Aware Of It, Said Shan.
Officials Were Now Redepositing The Sand Removed From The Sandbank.
Controversy Has Been Caused By The Digging Of A Narrow Channel By A Resort On A Sandbank Near K. Hinmafushi.
Hinmafushi Council President Shan Ibrahim Stated To Sun That The Resort, Which Dug The Trench Creating A River On The Sandbank, Did Not Have Ownership Over The Sandbank.
Officials From The Island Of Hinmafushi Had Traveled To The Sandbank To Stop The Process Of Digging The Trench When They Became Aware Of It, Said Shan.
Officials Were Now Redepositing The Sand Removed From The Sandbank.
— Ahmed Aznil (@AhmedAznil) January 21, 2021
I've seen many news articles cite that "the UK variant could be the dominant strain by March". This is emphasized by @CDCDirector.
While this will likely to be the case, this should not be an automatic cause for concern. Cases could still remain contained.
Here's how: 🧵
One of @CDCgov's own models has tracked the true decline in cases quite accurately thus far.
Their projection shows that the B.1.1.7 variant will become the dominant variant in March. But interestingly... there's no fourth wave. Cases simply level out:
https://t.co/tDce0MwO61
Just because a variant becomes the dominant strain does not automatically mean we will see a repeat of Fall 2020.
Let's look at UK and South Africa, where cases have been falling for the past month, in unison with the US (albeit with tougher restrictions):
Furthermore, the claim that the "variant is doubling every 10 days" is false. It's the *proportion of the variant* that is doubling every 10 days.
If overall prevalence drops during the studied time period, the true doubling time of the variant is actually much longer 10 days.
Simple example:
Day 0: 10 variant / 100 cases -> 10% variant
Day 10: 15 variant / 75 cases -> 20% variant
Day 20: 20 variant / 50 cases -> 40% variant
1) Proportion of variant doubles every 10 days
2) Doubling time of variant is actually 20 days
3) Total cases still drop by 50%
While this will likely to be the case, this should not be an automatic cause for concern. Cases could still remain contained.
Here's how: 🧵
One of @CDCgov's own models has tracked the true decline in cases quite accurately thus far.
Their projection shows that the B.1.1.7 variant will become the dominant variant in March. But interestingly... there's no fourth wave. Cases simply level out:
https://t.co/tDce0MwO61
Just because a variant becomes the dominant strain does not automatically mean we will see a repeat of Fall 2020.
Let's look at UK and South Africa, where cases have been falling for the past month, in unison with the US (albeit with tougher restrictions):
Furthermore, the claim that the "variant is doubling every 10 days" is false. It's the *proportion of the variant* that is doubling every 10 days.
If overall prevalence drops during the studied time period, the true doubling time of the variant is actually much longer 10 days.
Simple example:
Day 0: 10 variant / 100 cases -> 10% variant
Day 10: 15 variant / 75 cases -> 20% variant
Day 20: 20 variant / 50 cases -> 40% variant
1) Proportion of variant doubles every 10 days
2) Doubling time of variant is actually 20 days
3) Total cases still drop by 50%
Two things can be true at once:
1. There is an issue with hostility some academics have faced on some issues
2. Another academic who himself uses threats of legal action to bully colleagues into silence is not a good faith champion of the free speech cause
I have kept quiet about Matthew's recent outpourings on here but as my estwhile co-author has now seen fit to portray me as an enabler of oppression I think I have a right to reply. So I will.
I consider Matthew to be a colleague and a friend, and we had a longstanding agreement not to engage in disputes on twitter. I disagree with much in the article @UOzkirimli wrote on his research in @openDemocracy but I strongly support his right to express such critical views
I therefore find it outrageous that Matthew saw fit to bully @openDemocracy with legal threats, seeking it seems to stifle criticism of his own work. Such behaviour is simply wrong, and completely inconsistent with an academic commitment to free speech.
I am not embroiling myself in the various other cases Matt lists because, unlike him, I think attention to the detail matters and I don't have time to research each of these cases in detail.
1. There is an issue with hostility some academics have faced on some issues
2. Another academic who himself uses threats of legal action to bully colleagues into silence is not a good faith champion of the free speech cause
How about Selina Todd, Kathleen Stock, Jo Phoenix, Rachel Ara, Sarah Honeychurch, Michele Moore, Nina Power, Joanna Williams, Jenny Murray, Julia Gasper ...
— Matt Goodwin (@GoodwinMJ) February 17, 2021
Or is it only Eric you pop at?
Are they all making it up too Rob?
Are they "beyond parody"? https://t.co/drQssTD0OL
I have kept quiet about Matthew's recent outpourings on here but as my estwhile co-author has now seen fit to portray me as an enabler of oppression I think I have a right to reply. So I will.
I consider Matthew to be a colleague and a friend, and we had a longstanding agreement not to engage in disputes on twitter. I disagree with much in the article @UOzkirimli wrote on his research in @openDemocracy but I strongly support his right to express such critical views
I therefore find it outrageous that Matthew saw fit to bully @openDemocracy with legal threats, seeking it seems to stifle criticism of his own work. Such behaviour is simply wrong, and completely inconsistent with an academic commitment to free speech.
I am not embroiling myself in the various other cases Matt lists because, unlike him, I think attention to the detail matters and I don't have time to research each of these cases in detail.
You May Also Like
Master Thread of all my threads!
Hello!! 👋
• I have curated some of the best tweets from the best traders we know of.
• Making one master thread and will keep posting all my threads under this.
• Go through this for super learning/value totally free of cost! 😃
1. 7 FREE OPTION TRADING COURSES FOR
2. THE ABSOLUTE BEST 15 SCANNERS EXPERTS ARE USING
Got these scanners from the following accounts:
1. @Pathik_Trader
2. @sanjufunda
3. @sanstocktrader
4. @SouravSenguptaI
5. @Rishikesh_ADX
3. 12 TRADING SETUPS which experts are using.
These setups I found from the following 4 accounts:
1. @Pathik_Trader
2. @sourabhsiso19
3. @ITRADE191
4.
4. Curated tweets on HOW TO SELL STRADDLES.
Everything covered in this thread.
1. Management
2. How to initiate
3. When to exit straddles
4. Examples
5. Videos on
Hello!! 👋
• I have curated some of the best tweets from the best traders we know of.
• Making one master thread and will keep posting all my threads under this.
• Go through this for super learning/value totally free of cost! 😃
1. 7 FREE OPTION TRADING COURSES FOR
A THREAD:
— Aditya Todmal (@AdityaTodmal) November 28, 2020
7 FREE OPTION TRADING COURSES FOR BEGINNERS.
Been getting lot of dm's from people telling me they want to learn option trading and need some recommendations.
Here I'm listing the resources every beginner should go through to shorten their learning curve.
(1/10)
2. THE ABSOLUTE BEST 15 SCANNERS EXPERTS ARE USING
Got these scanners from the following accounts:
1. @Pathik_Trader
2. @sanjufunda
3. @sanstocktrader
4. @SouravSenguptaI
5. @Rishikesh_ADX
The absolute best 15 scanners which experts are using.
— Aditya Todmal (@AdityaTodmal) January 29, 2021
Got these scanners from the following accounts:
1. @Pathik_Trader
2. @sanjufunda
3. @sanstocktrader
4. @SouravSenguptaI
5. @Rishikesh_ADX
Share for the benefit of everyone.
3. 12 TRADING SETUPS which experts are using.
These setups I found from the following 4 accounts:
1. @Pathik_Trader
2. @sourabhsiso19
3. @ITRADE191
4.
12 TRADING SETUPS which experts are using.
— Aditya Todmal (@AdityaTodmal) February 7, 2021
These setups I found from the following 4 accounts:
1. @Pathik_Trader
2. @sourabhsiso19
3. @ITRADE191
4. @DillikiBiili
Share for the benefit of everyone.
4. Curated tweets on HOW TO SELL STRADDLES.
Everything covered in this thread.
1. Management
2. How to initiate
3. When to exit straddles
4. Examples
5. Videos on
Curated tweets on How to Sell Straddles
— Aditya Todmal (@AdityaTodmal) February 21, 2021
Everything covered in this thread.
1. Management
2. How to initiate
3. When to exit straddles
4. Examples
5. Videos on Straddles
Share if you find this knowledgeable for the benefit of others.
Trump is gonna let the Mueller investigation end all on it's own. It's obvious. All the hysteria of the past 2 weeks about his supposed impending firing of Mueller was a distraction. He was never going to fire Mueller and he's not going to
Mueller's officially end his investigation all on his own and he's gonna say he found no evidence of Trump campaign/Russian collusion during the 2016 election.
Democrats & DNC Media are going to LITERALLY have nothing coherent to say in response to that.
Mueller's team was 100% partisan.
That's why it's brilliant. NOBODY will be able to claim this team of partisan Democrats didn't go the EXTRA 20 MILES looking for ANY evidence they could find of Trump campaign/Russian collusion during the 2016 election
They looked high.
They looked low.
They looked underneath every rock, behind every tree, into every bush.
And they found...NOTHING.
Those saying Mueller will file obstruction charges against Trump: laughable.
What documents did Trump tell the Mueller team it couldn't have? What witnesses were withheld and never interviewed?
THERE WEREN'T ANY.
Mueller got full 100% cooperation as the record will show.
BREAKING: President Donald Trump has submitted his answers to questions from special counsel Robert Mueller
— Ryan Saavedra (@RealSaavedra) November 20, 2018
Mueller's officially end his investigation all on his own and he's gonna say he found no evidence of Trump campaign/Russian collusion during the 2016 election.
Democrats & DNC Media are going to LITERALLY have nothing coherent to say in response to that.
Mueller's team was 100% partisan.
That's why it's brilliant. NOBODY will be able to claim this team of partisan Democrats didn't go the EXTRA 20 MILES looking for ANY evidence they could find of Trump campaign/Russian collusion during the 2016 election
They looked high.
They looked low.
They looked underneath every rock, behind every tree, into every bush.
And they found...NOTHING.
Those saying Mueller will file obstruction charges against Trump: laughable.
What documents did Trump tell the Mueller team it couldn't have? What witnesses were withheld and never interviewed?
THERE WEREN'T ANY.
Mueller got full 100% cooperation as the record will show.