Thinking / Modeling
- Models Worth Creating
- Distinctions in Conceptual Style
- Algorithmic Thinking
- Munger
- Meta-Modeling
- How to Think
- Cognitive Categorization
<!-- gdoc-inlined -->
1. Best practices for research by mining biographies of great scientists 2. Rank decades against one another 3. Interestingness Maximization 4. Trans X and the levels below it (tiers of progress, categories of progress) 5. Take every philosophical transhumanist goal and discover / create concrete paths (curriculum + plan of action). Begin with:
- Machine Superintelligence
- Gene Editing
- Existential Risk
- Brain-Computer Interfaces
- Anti-Aging Pathways
- Write down the competition between hierarchies
- How to Become Batman
- Giving of agency to to the non-agentic
- What do the tears understand?
- What does circling want?
- Meditations on moloch
- Memetics
- When thinkers are way ahead of their time, how are they ahead, and how can that be replicated?
- How to make your emotions work for you, consistently.
- Mastery
- Arrogance
- Judgmentalness
- Learning from Criticism
- Using People
- Control
- The mechanics of Ego
- Empirical Observations of my Sexuality
- Decompose Identity (Christianity as making identity about beliefs, not grounded in reality)
- Differences between thinking in Narrative vs. thinking Conceptually / Analytically / Statistically
- Meaning Maximization
- Oh my god. How have I not created this yet? It its most beautiful form?
- Groundedness / Ungroundedness
- Refers to levels of analysis, map / territory conflict
- Self-awareness
- What is self-awareness?
- How to maximize self-awareness?
- Why ranking is the most dark thing that happens all the time (almost necessarily, tacitly)
- Invalidation of specialness narratives at scale. Better than, worse than, not enough. Creates deep feelings of inadequacy.
- How not to get trapped in a thought loop
- How to see thought loops
- Deconstruct ‘Values’
- Intuition pumps, different definitions, connotations, contexts in which it varies, meta-values, etc.
- Meta-Identity
- Question Generators
- Meta-Generation
- Superforecasting
- To Create: Fundamental Questions in Representation Learning
- I want to create a curriculum for representation learning that’s OLD. Exclusively papers from 2000 or earlier. (Hint: Old papers only cite other old papers. And check ICA.)
- Take every objective in ‘What Makes a Representation Good’, add my own objectives, and for each one specify:
- A way (or set of ways) to measure the objective
- Distinguish between the concept of the objective and the mathematical instantiation of the objective (unless they’re truly identical)
- The downstream consequences of doing better or worse on the objective
- Compare two different networks over the objective
- The rationale (and intuition pumps) for the objective
- The counterarguments
- Apply inversion to all of the ideas in a frontline paper in representation learning. When it works well, you’ve discovered something you think is true that others disagree with. And if it’s a foundational assumption, you can get started on making progress.
- How do we know what we claim to know in Representation learning? Ask this of a shortlist of ‘sacred beliefs’.
- Create a ‘sacred beliefs’ in representation learning list.
- Create a ‘consistently questioned beliefs’ in representation learning list.
- Why learn Discrete / Sparse Representations? Be able to give a fully fledged, fully throated defence and attack.
- Why ‘representation’ is this crazily important concept. The dramatic, windfall differences that come out of slightly different representations.
- Survey all possible papers I could push hard at in Abstract Representation Learning
- Explicate all my categories of idea as low level ideas
- Generate new categories of idea
- List out all of the goals for representation learning as a field and multiple pathways that would fulfill each goal
- Order the goals in terms of importance
- List out the unknowns, the missing categories, the assumptions behind the goals, and the mistakes
- List of likely to be true / likely to be false assumptions, and ways to prove or disprove each assumption
- Transfer between each related field and representation learning
- Decide what the goal is. Work backwards to research paths that accomplish the goal. Value parts of the research frontier insofar as they relate to the goal.
- What would a benevolent authoritarian do with governmental control?
- Creation of umpteen programs creating citizens with valuable skillsets.
- Believability is such an important concept.
- My own lack of it is destroying me. It’s destroying my goal setting, destroying my ability to execute.
- It’s why people don’t trust x: she’s not believable.
- It’s what I’ve been trying to build with reputation, but it’s not equivalent to reputation. Reputation can be fake. Believability is real.
- It’s about the state of your models and how they interact with reality.
- It’s about whether what you say will happen happens.
- What is generalization? Is there a right answer to how to operate “out of domain?”
- Map out existing value systems
- Holes / weaknesses in existing value systems
- This visualization technique (first walking through the motions of the necessary action in your mind, and then treat real life as just another vivid visualization) is extremely powerful and symmetric.
- Apply sys creativity to it. And use it, over and over again.
- Arguments have statistical properties. Map out the properties of common forms of argument.
- For example, person1 won’t take action1, he belongs to category1. (Implicit, other agents in category1 tend not to / can’t / won’t take action1, this is an example of generalization) One could treat this as an inductive prediction and use the
- Emotional Transmogrification
- Redirection
- Map out emotional space
- Language patterns / body language for each emotion
- Systematizing systematizing
- Planning
- Optimal Sleep
- Falling asleep
- Setting up for sleep
- Sleeping deeply
- Dreaming
- Lucidity
- As creativity
- As problem solving
- Getting to sleep on time
- Getting out of bed upon waking
- AI Memespace
- Emotional foundations to all of the memes that propagate amongst ML researchers
- Cult Leadership Playbook
- Deconstructing Incentive Structures
- Reputation systems
- Equilibria in Uber / Lyft ratings
- Lack of incentives to rate
- Use of gains in reputation to motivate
- Open source contribution
- Sharing in social networks
- Publishing
- Market Mechanism
- Blockchain
- Bitcoin Mining
- Skin in the Game
- This is about creating downside risk - it’s fear of loss, not hope for gain.
- Auctions
- Prediction Markets
- Peer-to-Peer
- Credit Assignment in Research
- Citation
- Other forms of credit
- Insurance
1. Education as insurance
2. Abstract and generalize - what is actually about a sense of security / safety, that people say is about something else?
- Salary
- Psychological interactions with all of these mechanisms 1. Use of fear in reputation - fear of loss
- Invert 1. Fear of loss vs. gains 2. Reward vs. Punishment
- Convenience 1. Underrated, extremely important 2. Easiest to perform action as Default 3. Abstraction as source of money - create a nice interface to harsh reality
- Organizational incentive structures, how to get promotion, how to get status, etc. 1. This literature exists. And it’s evolved over centuries.
- The impact of measurability on all of these
1. In reputation systems, other people’s opinions are competence
2. Distinction between mechanisms in reality vs. social reality.
- Reality is skin in the game, often. Social reality is a layer over reality that often destroys skin in the game
- Social reality has evolved, itself. It’s cooperation. But it has to stay at a lower level (individuals), not a higher level (firms)
- Scalable vs. Non-Scalable Mechanisms
Source: Original Google Doc