T-1 Psychology behind the formation of a candle - personally I feel that if one is aware of psychology behind the formation of candle than chart starts talking to you. So, here I am starting my journey of 🧵 with how actually candles form. Small but important for beginners 👇

So there's a class of puzzles called "river crossing puzzles" which involve having to cross a river on a boat/bridge containing some set of individuals/items with restrictions on which ones can be on the boat/left on each shore, right?

and the most common subclass of these problems is the one where you have 3 items/animals to cross with.
This is alternatively called the "fox, goose, and bag of beans" or "wolf, goat, and cabbage" puzzle.

the idea is that your boat can only carry one item at a time, but if you leave the wolf/fox unattended with the goat/goose, the wolf/fox will eat the goat/goose.
and similarly, the goose/goat will eat the beans/cabbage if left alone

so you have to set up a set of actions that never leaves either side of the river in one of the lose-states.

the solution to this variant being:
1. take the goat/goose over
2. return empty
3. take the wolf/fox over
4. return with the goat/goose
5. take the cabbage/beans over
6. return empty
7. take the goat/goose over

Important paper from Google on large batch optimization. They do impressively careful experiments measuring # iterations needed to achieve target validation error at various batch sizes. The main "surprise" is the lack of surprises. [thread]

https://t.co/7QIx5CFdfJ

The paper is a good example of lots of elements of good experimental design. They validate their metric by showing lots of variants give consistent results. They tune hyperparamters separately for each condition, check that optimum isn't at the endpoints, and measure sensitivity.

They have separate experiments where the hold fixed # iterations and # epochs, which (as they explain) measure very different things. They avoid confounds, such as batch norm's artificial dependence between batch size and regularization strength.

When the experiments are done carefully enough, the results are remarkably consistent between different datasets and architectures. Qualitatively, MNIST behaves just like ImageNet.

Importantly, they don't find any evidence for a "sharp/flat optima" effect whereby better optimization leads to worse final results. They have a good discussion of experimental artifacts/confounds in past papers where such effects were reported.

Cherthala Karthyayani Kshetram
#Alappuzha, Kerala
#KeralaTemples 🚩

Cherthala Karthyayani Temple Prathishta was done by Vilwamangalam Swamy. Chertala Pooram is very famous. Devi is Mangalya Dayini here removes obstacles relating to marriages. Sthala Puranam says that, once 👇

Vilwamangalam Swamiyar was passing this area after Prathista of Padmananbhaswamy Temple, he felt Devi chaitanyam and recognized as Karthyayani Devi. But Devi seeing Vilwamangalam went inside the pond. Swamy searched for Devi continously for 6 days and on 7th day Vilwamangalam

got hold of Devi's hair. Thus only Devi's head is Prathishta here. Devotees do Kozhi parathal ( offering cock) here as an offering to Karthyayani Devi.

Karthyayaniamme Sharanam
🙏🕉🙏

1. I was walking in the woods yesterday and I had an epiphany. It wasn’t one I wanted to have. I was thinking about today’s class, where we are reading Kimmerer’s ‘Gathering Moss’. I’ve taught Braiding Sweetgrass in multiple classes every year since 2016. It’s eminently teachable

2. Both books are beautifully written. Students uniformly enjoy them as assigned reading. They do a great job communicating to non-Indigenous folks the contours of basic Indigenous relationships to more-than-human beings. They’re wildly popular with white readers.

3. I’ve found Braiding Sweetgrass to be a great entry point for non-Indigenous folks to Indigenous scholarship. But this is where yesterday’s epiphany comes in. Neither Braiding Sweetgrass or Gathering Moss tends to the deep deep lineages of Indigenous scholarship in Canada or US

4. As the popularity of ‘Braiding Sweetgrass’ has soared, I’ve seen more and more white folks wax on about ‘braiding knowledge’. But they often don’t know any of the lineages of these concepts beyond what is presented in this one book. They confidently run with this.

5. Kimmerer does a commendable job of weaving in her own experiences, her family stories+nods to some very important knowledge keepers who deserve to be celebrated for their work. But Braiding Sweetgrass does not tend to the citational politics Sara Ahmed & others teach us about