EN 中

2 minute read

NotebookAnalogy DiversityNo. 00

My reason for keeping this notebook is simple. I want a record.

My starting point is that a lot of research may never turn into a complete paper.

A while ago I read an interview with Terence Tao. As I remember it, he talked about why AI could destroy mathematics: when mathematicians try to prove or disprove a conjecture, the result is often not the point. New mathematical problems come up along the way, and those become directions worth studying.

I also listened to an interview Saining Xie did with Zhang Xiaojun a long time ago. One thing I found interesting is his line that research is an endless game. That fits with what Tao said. My own reading is that, at least for now, human thinking is more divergent than a model’s, in every sense. People have intuition, and models are weaker there.

Later I heard a senior engineer from Anthropic speak at a Physics AI panel at Stanford. The point was that before the models get stronger, we should think about what kind of research we should do. Everyone has seen what AI can do, but this is only the early part of an exponential, and what comes after is wide open. I feel honored to take part in thinking about where AI should be steered.

That is why I think my research process is worth keeping as a diary. My attempts may never become a paper, but they mean something, and they can be dug into further.

How this notebook works

The structure is simple: a short report each day.

I write the hypotheses I came up with that day on a whiteboard. The ones I have tested get crossed out, not erased. New ones go underneath. Some ideas just show up and I cannot explain why I thought of them, so I write them down as they came.

Then I pick one hypothesis and design an experiment for it, one experiment a day. I run it, report what came out, and end with a little insight.

Research is not only a dry process of hypotheses being falsified. It can also be quiet time to think. I once asked friends in my group about this, because I was curious what they do outside research. Some write poetry, some draw. For me, it is music. I put music on before I start thinking about hypotheses, and music is one of the places my ideas come from. So each entry ends with a song I was listening to that day.

I really like Phil Collins’s drumming. You can tell it is him right away. Today it was his “Another Day in Paradise,” a song that stays with me every time I hear it. He looks at life closely, and he has a lot of compassion. A day that feels plain and ordinary to us might be paradise for many people whose lives are harder. Thinking about that, I feel very lucky.