AfterthoughtsSign in
All writing

A diary you can actually search

Most journals are write-only. Here is why being able to find an old entry changes what a diary is for, and what makes one searchable in practice.

5 min read

Try this with whatever diary you keep. Find the first time you mentioned the person you currently see most often.

With a paper notebook it is an afternoon's work, assuming you still have the right volume. With a folder of voice memos it is not possible at all. With most journalling apps you can search for a word, which gets you somewhere, as long as you happen to guess the word you used — and people's diaries are full of "her", "that whole thing", and "the meeting".

This is the quiet problem with almost every diary: it is write-only. Entries go in and effectively nothing comes out, and once you have worked that out, even half-consciously, the habit starts to feel like filing paperwork for an office that never opens.

What a searchable diary is for

A diary you can look things up in stops being a record and starts being a reference. The uses are more practical than you might expect.

You can settle facts. When did we move in. How long was I at that job, really. Was the car trouble before or after the wedding. Human memory compresses time badly and confidently — events from two years ago and four years ago sit at roughly the same distance — and a dated record is the only thing that argues back.

You can reconstruct a period. Reading everything from one particular month, in order, is a different experience from remembering it. You get the small things memory has thrown out: that you were eating the same lunch every day, that it rained constantly, that the thing you now describe as a difficult year was mostly unremarkable with three bad weeks in it.

You can follow one thread. Everything you ever said about a person, or a city, or the flat. This is the one people underestimate before they have it. A friendship read in order, from the first mention to last week, is a fairly extraordinary document, and nobody has ever had one before roughly now.

And you can answer the ordinary questions that occur to you anyway. When did I last see my brother. How many weekends did I actually spend at home this autumn. What was I doing a year ago today.

Why search normally fails

If you have tried this with a notes app, you will know the results are patchy. Four reasons, all fixable:

You searched for a word you never used. You look for "promotion" and you had written "the new title thing". Keyword search can only ever find the words you happened to say, and diaries are written in private shorthand.

Names are not spelled consistently. Half the entries say Priya, some say P, one says "my manager". Each spelling is a separate island.

There is no structure to search within. Searching an entire diary for "home" returns four hundred results and is therefore the same as returning none. What you needed was "home, in September, in the entries that are also about my mother".

The audio was never written out. If you keep a spoken diary with a plain voice recorder, there is nothing to search at all. This is the biggest failure of the lot, and it is why so many people's voice journals quietly end after six weeks.

What makes one work

The fixes are not complicated, and they are mostly about what happens to an entry after you make it.

The entry has to become text. Everything else depends on it. A spoken diary needs transcription, automatically and immediately, not as a thing you will get round to.

Entries need to be tagged with the things in them. Not tags you apply by hand — nobody sustains that past a fortnight — but the people, places, topics and events pulled out of what you actually said. Once each entry knows that Priya and Gurgaon and the exams came up, "every night Priya came up" becomes a real query rather than a guess at a spelling.

There has to be a time axis you can move along. A timeline, not just a search box, so you can go to a week rather than to a keyword, and read it in order.

And search should be forgiving. Looking for "when did I last mention my sister" should work even if you have never once used the word sister, because you have always used her name. Getting from the one to the other is the whole job.

That is the shape of Afterthoughts, if you want a concrete example: you talk for as long as you like, it writes the night out, notes who and what and where came up, and puts it on a timeline you can search by a name or a word. That part — recording, transcripts, the timeline, search — is free. There is also a paid section called Ask, at $4 a month, where you put the question in plain words and get back the nights the answer came from, so you can check it against your own words rather than take ours. The free search is the thing most people need; Ask is for when you would rather ask a question than build one.

Searchable and private are not opposites

The obvious worry about a diary that can be searched is that a searchable thing is an exposed thing. It is a fair instinct, and it is worth knowing what to ask about.

Searchability is a property of how your own entries are stored and indexed, not of who can see them. The questions that matter are different ones: who else can read this, where does the audio live, and is anything in it used for anything beyond showing it back to you. Those have specific answers in any product that takes them seriously, and if you cannot find the answers, that is itself the answer.

For what it is worth, ours: audio sits in a private bucket, every table has row-level security so one account cannot read another's rows, and transcripts are never written to our logs. Nothing you record is used to train anything. Searching your own diary is not a loosening of any of that; it is just an index over rows that were already yours alone.

Start from the questions

If you are choosing where to keep a diary, or wondering whether the one you keep is doing its job, the test is not how it feels to write in. It is whether you can get anything back out.

So take the questions you would actually ask. When did this start. How long did that last. Who was around that year. What was I like in the spring of the bad job. Then see whether the thing you are using could answer any of them in under a minute.

If it cannot, the entries you are making tonight are going somewhere you will never look. That is not a reason to stop keeping a diary. It is a reason to keep it somewhere with a way out as well as a way in.