#LTI-5782

Update

1 There's a chasm between an NLP technology that works well in the research lab and something that works for applications that real people use. This was eye-opening when I started my career, and every time I talk to an NLP engineer at @textio, it continues to strike me even now.

2 Research conditions are theoretical and/or idealized. A huge problem for so-called NLP or AI startups with highly credentialed academic founders is that they bring limited knowledge of what it takes to build real products outside the lab.

3 A product is ultimately a thing that people pay for - not just cool technology or user experience. But I’m not even talking about knowledge gaps in go-to-market work. I'm talking purely technical gaps: how you go from science project to performant + delightful user experience.

4 Most commoditized NLP packages solve well-understood problems in standard ways that sacrifice either precision or performance. In a research lab, this is not usually a hard trade-off; in general, no one is using what you make, so performance is less important than precision.

5 In software, when you’re making something for real people to use, these tradeoffs are a big deal. Especially if you’re asking those people to pay for what you’ve made (can’t get away from that pesky GTM thinking). They expect quality, which includes precision AND performance.

Can we control the output of neural generation systems?
Can we build a better chatbot using this control?
And what makes a good conversation anyway?

Check out the blog post for our NAACL paper:

https://t.co/UAAUxSeA0L

#AI #NLProc #DeepLearning #ConversationalAI @facebookai

This post got a little delayed since the paper's publication, but the intervening time has given me an opportunity to reflect.

So this post has some extra thoughts regarding more recent NLG developments - e.g., pretrained models like GPT(2), and the suitability of beam search.

1/ The first 18 months of starting a company is often life or death. I must've made 5 different companies that each failed within 9 mo. 😭 Each time the company failed I figured out what I could do better. Eventually startup #6 got to $40K/mo by month 18. Here’s what I learned...

2/ Stay focused! Ignore things that are a waste of time: meetups & conferences, meetings with no clear agenda, fundraising if you're not fundraising, reading lots of tech media articles, etc. Every week should feel like significant progress in the first year.

3/ Your first 5 hires will be the difference between life or death. Choose carefully. Be picky. Many of the things we do at the company still are a result of those early hires' legacy. Have fun as a tight knit team. It will change & evolve as you get bigger so enjoy this moment.

4/ Growth may be flat for the first 9 months. It's gonna be okay. Almost every company has experienced this: Airbnb had to sell cereal in-between, Slack failed as a gaming company first, Tesla sold only 147 cars after 6 years! You probably won't be an overnight success either.

5/ In the beginning, do customer support yourself. You will learn a lot about why your product sucks. I did 5,000+ support tickets when it was the two of us. Delight customers & fix things fast while you learn. It will help you build an amazing intuition about your customers.

MUST READ TILL END:
FB POST BY MR PRABEER BASU,
IAS-1976(BIHAR)
" Received a hurtful post from an old friend and colleague. He was on my daily Broadcast list of WhatsApp. He requested that I do not send him any of my posts on 'political' issues. I gave him a long explaination
>2

2/29
on why I write and what I write. But he was not convinced.

Being alerted by him thus, I felt I should clarify to all who read my posts on what exactly I think and do.

The charge against me is that I wrongly support our current Prime Minister, Shri Narendra Modi..
>3

3/29
and that it establishes I am not rational and impartial anymore.
Let me try and explain.First and foremost,I do not write on 'political' issues. I write on 'national' issues. For example, I have no opinion on whether Rahul Gandhi should be President of his party or not.
>4

4/29

Similarly, I have no views whether BJP is a better party than Congress or vice versa.
Even after 36 years in the IAS I have no MLA, MP or anyone involved in politics whom I can classify as my friend or even acquaintance.
>5

5/29
So, naturally I don't care which party wins or loses as long as the winning party runs an honest government doing good to my nation.
Now, why I speak in favour of Shri Modi:

1. Ever since the beginning of my service I realised that Planning Commission was not serving..

>6

Pretending that voting for Trump or denying climate change or suggesting the solution to every problem is more guns is a legitimate point of view, worthy of respect is not "how America works." It is how it dies.

People in a free society are entitled to any point of view no matter how obviously wrong or outlandish or destructive provided they do not impose their views on others.

But suggesting that something ignorant or divorced from reality warrants the same kind of treatment in public debate as something based in fact or at least credible is absurd and when done on behalf of a society in public media or academic settings it is self-destructive.

We would not grant media coverage or much bandwidth at all to a group that argued that unicorns exist or that there was a pot of gold at the end of the rainbow. Yet views like denying climate change or basing policy decisions on sweeping, obvious lies, are just as unsound.

Somewhere, somehow, judgments must be made. Some behaviors are wrong and must be condemned. Someone must challenge lies and demand facts. Coddling people who embrace idiocies does not help them no matter how loudly they demand to be coddled.