Great session by @MarcJBrooker earlier on building technology standards at Amazon scale, and some interesting tidbits about the secret sauce behind Lambda and how they make technology choices - e.g. in whether to use Rust for the stateful load balancer v2 for Lambda.

🧵

Nice shout out to some of the benefits of Rust - no GC (good for p99+ percentile latency), memory safety with its ownership system https://t.co/2ShIC786S5 great support for multi-threading (which still works with the ownership system)
And why not to use Rust.

The interesting Q is how to balance technical strengths vs weaknesses that are more organizational.
And it all boils down to this..

which is basically the same question that organizations all over the world have to answer when they consider adopting #serverless technologies like Lambda.
And I love Marc's answer - to innovate (ie. try new things) with guard rails that mitigate the risks.

As a consultant, I often find myself being one of those guard rails for organizations that want to adopt #Serverless

(nice plug, self hi-five! ✋)
Ha, I have heard @heitor_lessa mention "tenets" many times.

This line about avoiding baking language-specific choices into your contract and data is so important. It gives you an easier path to back out of that language choice if it turns out to be wrong.
Which, actually reminds me of what Bezos said in this article about the 2 types of decisions - one-way (aka, "no coming back from this decision!") and two-way doors.

https://t.co/qBh6wgGuz1
"Baking these tensions into tenets and making it really obvious to everyone means we're upfront about the conversation that we're really having"

👍👍👍
Standards: top-down decision, comes with risk (e.g. limits upside - losing ideas that are better than what's baked into the standards)

"We use standards very sparingly, only in areas where we deeply understand the context and innovation has little upside"
"It all starts with the right incentives"

This, so much this👆

Why? because incentives drive outcomes.
And then there's ownership - because people making these decisions are on the hook for its long term success.

That's why the ivory tower architect is such a bad model - they make all the decisions but you're on the hook for it.
Yup, 100% agree here. A leader's job is to provide the necessary context so that others can make the best decisions they can. A leader's job is NOT to make all the decisions for others.
And then Marc describes his job as enabling end-to-end understanding of the business and technology and getting teams talking to each other so they can make the best decisions without those technical standards.
So did they end up using Rust?

Yes!
"When you try new things and they turn out to be successful, then you double down on those. And take the learnings of what's great and make sure you can multiply that"

And that's how many organizations has adopted #serverless successfully, starting with one success story.
And that's also been the story of the adoption of Rust at AWS. Both Firecracker and BottleRocket are built with Rust.
And great to see they're investing into the community itself, doubling down both internally and externally.

Love to see more details on how formal methods is applied here.
btw, AWS uses formal methods all over the place, I hear that TLA+ is widely used by its service teams. Someone told me that they used it to find a bug in DynamoDB during design that would have resulted in data loss in extremely rare cases.

https://t.co/6p5MfXCyfR
"Building technology standards is a short-term thing that limits a company's creativity. Setting up incentives and helping people understand the decisions they're making and giving them full ownership of those decisions is the way I like to think about tech standards."
Well, that was great!

Make sure to catch this on a replay or when it becomes available on-demand.

More from Education

** Schools have been getting ready for this: a thread **

In many ways, I don't blame folks who tweet things like this. The media coverage of the schools situation in Covid-19 rarely talks about the quiet, day-in-day-out work that schools have been doing these past 9 months. 1/


Instead, the coverage focused on the dramatic, last minute policy announcements by the government, or of dramatic stories of school closures, often accompanied by photos of socially distanced classrooms that those of us in schools this past term know are from a fantasy land. 2/


If that's all you see & hear, it's no wonder that you may not know what has actually been happening in schools to meet the challenges. So, if you'd like a glimpse behind the curtain, then read on. For this is something of what teachers & schools leaders have been up to. 3/

It started last March with trying to meet the challenges of lockdown, being thrown into the deep end, with only a few days' notice, to try to learn to teach remotely during the first lockdown. 4/

https://t.co/S39EWuap3b


I wrote a policy document for our staff the weekend before our training as we anticipated what was to come, a document I shared freely & widely as the education community across the land started to reach out to one another for ideas and support. 5/
https://t.co/m1QsxlPaV4
Our preprint on the impact of reopening schools on reproduction number in England is now available online: https://t.co/CpfUGzAJ2S. With @Jarvis_Stats @amyg225 @kerrylmwong @KevinvZandvoort @sbfnk + John Edmunds. NOT YET PEER REVIEWED. 1/


We used contact survey data collected by CoMix (
https://t.co/ezbCIOgRa1) to quantify differences in contact patterns during November (Schools open) and January (Schools closed) 'Lockdown periods'. NOT YET PEER REVIEWED 2/

We combined this analysis with estimates of susceptibility and infectiousness of children relative to adults from literature. We also inferred relative susceptibility by fitting R estimates from CoMix to EpiForecasts estimates(https://t.co/6lUM2wK0bn). NOT YET PEER REVIEWED 3/


We estimated that reopening all schools would increase R by between 20% to 90% whereas reopening primary or secondary schools alone would increase R by 10% to 40%, depending on the infectiousness/susceptibility profile we used. NOT YET PEER REVIEWED 4/


Assuming a current R of 0.8 (in line with Govt. estimates: https://t.co/ZZhCe79zC4). Reopening all schools would increase R to between 1.0 and 1.5 and reopening either primary or secondary schools would increase R to between 0.9 and 1.2. NOT YET PEER REVIEWED 5/

You May Also Like