Existing mediums for note-taking (Evernote, Notion, Roam Research) are not sufficient for doing knowledge work over long periods of time. The functions these incumbents serve are primarily as “stores of knowledge” that we save because it’s interesting in the moment but never read through or “scratchpads” that we use once and never get rid of, which end up cluttering our information space like a junk drawer full of shopping lists and knick-knacks.
Serious thought involves more than just collections and associations: mastery requires repetition, creativity requires serendipitous discovery, and productive output requires flow states. It’s also a matter of acknowledging the fact that “units of knowledge” do not exist on their own: all knowledge is embedded in context (or “deeply intertwingled”, in the words of Ted Nelson), and without context, metaphor, and nuance, we cannot form meaningful connections. By baking these attributes into the medium itself, it’s possible to build an information space that’s simple to explore, can surface information when you need it, can augment the mind’s naturally ability to form connections, and can get out of the way the rest of the time.
Couldn't you just say "I'm working on this specific thing for this specific purpose that works this specific way" ? Sigh.
Sorry for the negativity, but this post is the perfect example of the wishy-washy rhetoric that people interested in this domain always use.
For examples of what I'm talking about, browse this tedious litany [1] (roam-whitepaper), see if you manage to get pass the first paragraph [2]. BTW, the price for the "Believer" plan of roam [1] is $500 dollars. Roam itself is advertised with the hashtag "#roamcult". Pretty strong BS signals coming from this one.
You know, the trouble is, you're absolutely right. I _could_ have just said "I'm working on a note-taking app", but nothing about that seems particularly weird or hard.
To address the poetic waxing more directly, it's important to remember that we still don't have very good language to talk about the "primitives of knowledge work", which is why I phrased my statement the way I did. We know it almost certainly doesn't involve the concept of "notes" (at least in the way we think about right now) and calling them simply "ideas" is altogether too vague.
As far as the #roamcult is concerned, we are overwhelmingly in agreement :)
Like most note-taking app developers, you don't seem to be concerned with the fundamental questions of what notes are and why we take them. In a certain sense everything we create physically or digitally can be considered a note.
Many write-only "scratchpad" notes are useful because they helped the mind focus and organize information. They can often be safely archived or discarded.
I've seen many people on HN struggle with this issue. I've bookmarked this post from a few months ago and enjoyed reading it and trying some of the ideas out: https://news.ycombinator.com/item?id=22000791
I very much like the idea of the hierarchy and the content just being the file system.
I’m less excited about the connection to Zettelkasten because that smells of fad.
If there were an app that would make useful sense out of a few tens of gigabytes of stuff kept in a plain folder hierarchy, I’d be a potential customer. In a way Dropbox tries to do this, and it’s better than nothing (for me) but I still wish for some kind of magical portal into my messy attic.
I started working on the app way before Zettelkasten became a thing. My goal is to not force a specific workflow. If you would like to use it as Zettelkasten, it'll work. If you prefer a different system, you can have the app adapt to your needs. It's all just files & folders underneath, only the representation varies.
I'm curious about your folder hierarchy. What kind of files do you keep there to get to tens of gigabytes and what type of knowledge would you like to extract/what type of connections to form?
I'm currently at about 100 MB for roughly 1,400 individual notes (text and images).
Text, images, videos up to and including the occasional rare film, lots of PDFs (usually small), sometimes a PowerPoint or an Excel spreadsheet, used to also do source code and builds and stuff before GitHub... and if I had faith in them being more useful, as opposed to just backed up, I'd probably dump a whole bunch more in my semi-organized DropBox folder.
So for my use-case the Organizer App would have to be able to deal with lots and lots of data of various types, occasionally including multi-gig files like the rough cut of a film, and also know when I "mv this ~/Organizer/that/" -- a tall order, I know. But with storage so cheap these days, I still dream of that.
Re: semi-organized DropBox folder: this came up here recently and might be of help to organize your files: https://johnnydecimal.com
The app I'm working is more focused on capturing knowledge as structured notes. It sounds like a good full text search could already be of help in your case. That maybe combined with slowly categorizing your content with a system like Johhny.Decimal or something similar.
You've described the problem really eloquently. You've obviously put a lot of thought into this. I don't see contact info for you. My email is in my profile. I'd love to chat if you're interested.
I’m not working on this problem actively but about once a year I go into a frenzy of brainstorming about it.
What I wish for is a useful melding of easy stuff like Notes.app, structured stuff like a custom database, and my reams of notes taken on physical paper. Oh and scrapbooks, web clippings, etc.
At the end of every brainstorm I throw up my hands, say this is too complicated to ever be worth doing, and resolve to change the way I gather and generate information.
Are you working on a solution in that field? I've been thinking about the same problem lately, especially how information can resurface contextually while typing or searching for knowledge.
I'm curious how is your solution different from the Zettelkasten-inspired note taking tools?
You've very eloquently put to words my disappointing experiences with that. I hope that someone who understands the problem that well that they can state the problem so unambiguosly, will be able to deliver a novel solution.
Have you already done anything towards this goal? This is something I’ve been thinking about for several years and I’m about to tackle as a side project so would love to chat with you if you want.
I tried so many tools in this category (currently using Trilium Notes). Quite a few times I almost embarked on making my own. Your approach resonates strongly.
Is there a mailing list or some other place to track progress?
All of these work more like scratchpads and, well, note books. That's fine if I want to put information down for later retrieval and even for low key exploration of past thought. But that's just the digitization of pre-21st century information management. What is now sought after is the next, previously impossible step.
What I envision is more of a knowledge space navigator that lives from connections and links (Wikipedia!) but allows a personal state of information and annotation/augmentation on top of it.
I want something that digitally represents my state of thought while augmenting it with a clean version of the world's knowledge and related information, if that makes sense.
Imagine writing a crypto algorithm - a browser with 30 tabs open and a note app plus my IDE feel like a clumsy and ineffective way to truly put my mind and thoughts into the context of work. It simply feels like doing digitally what people did in the 1960s with pen and paper, encyclopedias and books on their desk.
However, the internet and our hardware today feel like they allow to add at least one another dimension. For many, it's a hunch and a revolutionary product waiting to happen.
I worked with someone in 2013 who I'm still convinced solved this problem. But he was an absolute terror to work with. A petty authoritarian who would look over every website I'd go to and have screen monitoring and key logging software.
I kid you not. I left after 6 weeks. I snuck out the work with me (I wasn't "allowed" to bring it home.) If you're interested I'd be more than happy to share the code.
I think it was really revolutionary.
Essentially it used grammatical structures to arrange text in a navigable 2d space which he needed because he was a highly visual and spatial learner.
But what it allowed for is a nonlinear and a nonsequential arrangement of ideas using Wikipedia text, not just some simple mindmap stuff.
I used Wikipedia as an example in a prototype engine I made.
Articles Flowed Into each other through a continuous navigable space. You could interact and engage to go cognitively deeper and expand a new path, as opposed to a series of documents. Wikipedia became one continuous thing that you could endlessly navigate through a 2d space of.
The content wasn't large blocks of text but broken up using a separate visual language so that there'd only be a few words then a relation to another group and so on. This kept the concepts spatially relative and made the distinction of pages disappear.
It did it all automatically. Really amazing stuff. I also worked with Ted Nelson, this guy's methods were better. No question.
He developed the techniques over about 20 years manually and had transferred textbooks to rolls of butcher paper that he kept in cabinets. He totally didn't understand the value of his process as something as transformative as Vannevar Bush's As We May Think.
Instead he wanted to make it a proprietary format with proprietary content under a private publishing company for childhood education. He wanted a kludgy editor to make new content with and then a kludgy viewer for single topic things. He wanted to dictate the interface, keystrokes...
Because once again he's an authoritarian pedant. Bah, he didn't see what he made.
Ideas need to be controlled at the right level of abstraction and liberated at the others. That's what Linus knows that RMS doesn't. That's what TBL knows that Nelson doesn't. That's what Jobs knew but Apple doesn't.
I wanted to run with the idea but yeah, 7 years ago and I've done nothing. I got everything still.
I should stop everything and finish it. It's really something radically different. I think it will change at least the way I personally learn things.
The campaign to convince others, yeah well, no guarantees there.
Serious thought involves more than just collections and associations: mastery requires repetition, creativity requires serendipitous discovery, and productive output requires flow states. It’s also a matter of acknowledging the fact that “units of knowledge” do not exist on their own: all knowledge is embedded in context (or “deeply intertwingled”, in the words of Ted Nelson), and without context, metaphor, and nuance, we cannot form meaningful connections. By baking these attributes into the medium itself, it’s possible to build an information space that’s simple to explore, can surface information when you need it, can augment the mind’s naturally ability to form connections, and can get out of the way the rest of the time.