19-05-01 Research Failure Stories
Category: Idea Lists (Upon Request)
<!-- gdoc-inlined -->
Aspects of a valuable ‘failure in research’ event:
- 1 on 1 personal failure stories - partner up, talking to your person about an example where you took on a research project that failed in some sense
- Speakers with quality stories of struggling in research share the story with an audience.
- Interview / conversation, where a junior scientist talks to a senior scientist (or something like it)
- Round of insights, where there’s a sweep through everyone’s most valueable
- Round of questions, questions people are most curious to have answered by the event
- Contrarian truth,
- In 1 on 1s, tell story of the failure that had the most positive impact
- Ex., from which the most was learned
- Ex., from which you bonded with the person who would become a great influence
- In 1 on 1s, tell story of the failure that had the most negative impact
- Ex., from which your reputation never recovered
- Ex., which you lost years of your life to
- Split into small groups, each with a person with many stories worth telling. Engage in that context with some interview / prompts / free form conversation, and then switch to another set of small groups.
- My vulnerable truth about research is…
- How much do you work on research you believe in, relative to research that advances career / status / income?
Do we need a re-frame from failure? What forms of failure exist?
- An idea you expected to work did not work.
- A system you thought could be implemented could not be implemented.
- A project you thought was accomplishable in a given span of time actually took orders of magnitude more time.
- Nothing was learned.
Why is this interesting?
-
Ever present example of violated intuition. ‘This should have worked but didn’t’ points to a breakdown in our model of how a system works, and guarantees an update in our beliefs if the reason our expectation was violated can be discovered.
-
This is information that’s not communicated, due to shame, reputation, selection bias and more. It’s taboo and rare and so full of richness.
-
30-40 minutes of warm 1 on 1, opening with vulnerable stories / uncomfortable truths.
- Want a bunch of high quality people to talk - limit it to 10-20m after.
-
4 stories, 5 minutes each.
-
20m of unstructured conversations.
-
Circles of 5 with uncomfortable truths. Can also do introductions.
- 25-40m. Writing everything on a board?
- Each group presents 2 truths.
-
End the event, and let people chat.
-
Talk into the night.
Invitations: Turns out we just need 4 high quality stories. Everything else is group work or 1 on 1.
Who to invite?
Jeremy:
- Ilya Sutskever
- Samy Bengio
- Ian Goodfellow
- Ray Kurzweil
- Stuart Russell
- Andrew Ng
- Greg Brockman Laura:
- Saul Villeda
- Nathaniel David
- Cynthia Kenyon
- Jasper Rine
- Daphne Koller
- Vijay Pande
- Andy Dillin
Setup logistics:
- Email invitations
- Paperless Press
- Overall invite list
- Composition?
- Fraction of machine learners / CS researchers vs. Biology / Longevity researchers vs other (ex., physicists)
- ⅓ ⅓ ⅓ ?
- Fraction of machine learners / CS researchers vs. Biology / Longevity researchers vs other (ex., physicists)
- Speakers
- Invite 3 each - LD + JN
- Composition?
- Fb Event?
- Event Description / Motivation
- Come hear and describe the most uncomfortable and contrarian truths in your field and hear inside stories of research failures and victories from a handful of phenomenal scientists. You’ll all be extremely interesting people.
Order of events:
- June 25th. Laura and Jeremy sent out 3 invitations each. In the face of a rejection, send out a new invite.
- June ~27th. Send out invitations to ~25 people, ⅓ ⅓ ⅓ ML / Bio / other.
- Send out an invitation that gets a response / commitment quickly, so we can invite more people in the face of conflicts / rejections.
- July 7th - Final logistics setup / low level decisions about exactly which prompts to use and when to follow when.
- July 8th [Day Of] - Food/Snacks - LD
- July 8th [Day Of] - Manning Door / Greeter - LD / JN / NS
Source: Original Google Doc