You don't have to install anything or register

keeping aURL will not by itself help you remember or understand what's there, even though it mayfeel that way

What would a secure Federated PMK / archive network backed by a minimal blockchain look like?

I also think being able to self-host and export parts of your data to share with others would be great.

Internet gets more reliable

my main frustrations are around the lack of the very basic things that computers can do extremely well: data retrieval and search. I'll carry on, just listing some examples. Let's see if any of them resonate with you:

youtube videos, even though most of them have subtitles hence allowing for full text search?

the tool I've developed

I want URLs to address information and represent relations. The current URL experience is far from ideal for this.

a more realistic and plausible target: using my digital trace (such as browser history, webpage annotations and my personal wiki) to make up for my limited memory

or try the very page you're reading now

gravity on the poles in a bit larger

Why did that happen? The schema was wrong. We shouldn't have relied on ids: they are kind of an artifact of the relational model. One way of getting around it is "unnormalizing":

This is an easy case, and you can just retrieve all over again every time. Example: Pinboard API, there are just a few megabytes of data you have on Pinboard and API doesn't prevent you from retrieving all of it at once.

Now, remember I mentioned that Reddit only gives you the latest 1000 items, so I end up with overlapping data slices? To get a full view of my data, I'm simply going through individual JSON files in chronological order and merging together in accumulate method. [optional] caching layer I've got Reddit data way into past and export it every day, so merging together all these files during data access can indeed take a noticeable time. I'm overcoming this by using a @cachew annotation on the comments() method.

sometimes you vaguely recall reading about something or seeing a link, but don't remember where exactly. Was it on stackoverflow? Or in some github issue? Or in a conversation with friend?

to be capable of always remembering and instantly recalling information

I don't understand how does it not bother you!

So I am working on a personal project for which I am collecting all the URLs I even visited

There are some potential short term benefits: makes you more resilient Something along the lines of #prepping. Realistically though, in modern world, it's nice to be able to run after a bus or up the stairs, but it's quite questionable if running, say, even 5K is useful. makes you appear better physically Nice bonus, but I don't find it as a good value for time spent. feeling better immediately after exercise I used to get that, but it seems that the body adapted and I can't feel endorphine kick anymore. There is some good feeling about yourself having willpower to stick to routine, but I'd rather not have the routine in the first place. feeling better generally (less stressed, better sleep etc) I suppose I'm lucky to feel good anyway, so I don't feel subjective impact of exercise on my well being. Objectively, I tried to find correlations between amount of exercise and sleep, and failed to find any. (I'll write about it in more details later) I absolutely hate it. It's a massive drain of time and willpower. In addition, it comes with all sorts of logistical difficulties: gym outfit, shower, backpack, eating, weather.

store in a text file for further processing

Yes, I know, it’s not meant for geeks, it’s for normal people who love mouseclicks. I’m still puzzled by how people who develop that stuff use their own product though

First of all, Chromium bookmark adding menu was a bit shit and still is. You get to choose among the five most recently used folders only; if you want anything specific, you have to mouse click all the way through (using Tab on keyboard with my 100+ folders was just not doable). You can’t search when you add bookmark either. Yes, I know, it’s not meant for geeks, it’s for normal people who love mouseclicks. I’m still puzzled by how people who develop that stuff use their own product though.

mixer•last monthIt's a pity you didn't mention Zotero. It's such a great tool for many purposes. Also Calibre now supports highlighting in .djvu and .pdf files. It works well and covers all of my book/research papers related highlighting needs. Check it out!

А Вы не пробовали ripgrep-all (https://github.com/phiresky/ripgrep-all)? Это враппер над rg для поиска по документам. Он вообще всеядный: работает с pdf/.doc/.docx, sqlite, архивами, etc.

The only thing that's left is restricting the search to git repositories only. Ripgrep relies on regexes, so we can't do something like Xpath queries and tell it to only search in directories, that contain .git directory. I ended up using a two step approach: first, my/code-targets returns all git repositories it can reach from my/git-repos-search-root. I'm using fd to go through the disk and collect all candidate git repositories. Even though fd is already ridiculously fast, this step still takes some time, so I'm caching the repositories. Cache is refreshed in the background every five minutes so we don't have to crawl the filesystem every time. That saves me few seconds on every search. then, my/search-code keybindings invokes ripgrep against all my directories with code, defined in my/code-targets function.

some sort of search engine, over my personal data, with uniform and always available way of accessing it.

Why does it bother me?

Awesome collection. I've spent a lot of time looking into this myself. I'm a heavy Instapaper user, using this Chrome extension to export annotations to Roam (not Roam-specific): https://github.com/houshuang/instapaper-exporter-extension. However, it's really frustrating that Instapaper isn't better... Highlighting on iPhone is jarring, it often jumps randomly when I long-press, I can't capture images etc. And the API is useless - no way of getting more than the first 200 items, which is why the extension above scrapes their website... Looked into Pocket, but they don't even allow entering your own notes. I also recently looked into RSS - Feedly pro (not cheap) allows annotations and has an API - I'll experiment with the API later, but I might also just tag articles and have them sent to Instapaper... Wallabag looks cool, wish I was an iOS developer so I could add the stuff I want :)

Android browsers via bookmarklet.

using Hypothesis on your phone, tablet, or other mobile device

e: Annotation Is Now a Web Standard, or try the very page you're reading now.

¶3 Your data is vanishing Things I listed above are frustrating enough as they are. There is another aspect to this: your data is slipping away.

The sad state of personal data and infrastructure [see within blog graph] Why can't we have nice digital things?

sidebar is not necessarily convenient for social commenting

tart with (if

~.polar directory holds all the data, which makes it easy to share among your computers (e.g. via git, or if you keep it on Dropbox and symlink)

Annotation is the process of adding a layer of personal (with a potential for sharing) metadata on top of existing content such as highlights, notes, anchors etc.

Examples of exobrains 'Everything I know' wiki by Nikita Voloboev xxiivv by Devine Lu Linvega h0p3's Wiki Braindump by Jethro Kuan 'One Hundred Ideas for Computing' repository by Sam Squire more wiki examples from Nikita Voloboev

Human brains seem to be best for generating new ideas. I want to learn more, think faster, distract less, interact and visualize, effortlessly remember everything; not memorize and do routine information processing, which computers seem better at.

Extended mind is the idea that your mind isn't limited by your physical body, but augmented by external means. Paper notes & diaries, data in your computer/phone/cloud – all these things contribute to your cognitive process, thinking and help you navigate the landscape of ideas.

How to annotate literally everything

I started using Cronicle a few weeks ago and really like it. Runs on a server... https://github.com/jhuckaby/Cronicle

RUNDECK

huginn: great example of a user-friendly tool

Sadly, most of them are pretty heavy: often distributed, aiming at orchestrating clusters and grids, which is quite an overkill for my humble personal needs.

Running all that manually (more than 100 scripts across all devices) is an awful job for a human. I want to set them up once and more or less forget about it, only checking now and then.

on Google groups, they are meaningful and address specific discussions and messages:

¶Telegram

was planning to correlate them with monzo/HSBC transactions, but haven't got to it yet

mount your Google Drive (e.g. via google-drive-ocamlfuse)

I want to argue very strongly against forcing the data in the database, unless it's really inevitable.

This is until you realize you're probably using at least ten different services, and they all have different purposes, with various kinds of data, endpoints and restrictions.

beepb00p.xyz

This is until you realize you're probably using at least ten different services, and they all have different purposes, with various kinds of data, endpoints and restrictions. Even if you have the capacity and are willing to do it, it's still damn hard.

Hopefully we can agree that the current situation isn't so great. But I am a software engineer. And chances that if you're reading it, you're very likely a programmer as well. Surely we can deal with that and implement, right? Kind of, but it's really hard to retrieve data created by you.

ambitious

That also makes annotations resilient to document markup changes, and if they can't locate your annotations it would be still shown in metadata as 'orphaned', so you never lose your notes.

I'm tired of mediocre search experience

Why when something like 'mind palace' is literally possible with VR technology, we don't see any in use?

How to annotate literally everything

mobile Firefox,

plain list items

Comprehensive overview of existing tools, strategies and thoughts on interacting with your data Table of Contents

Fiction books are not an exception: I tend to highlight use of language I liked, inspirational things

unsolved problem

other apps

I'm trying to fight my perfectionism so figured a special page for posts in progress is a good compromise!

I feel that if people had better digital projections of their minds it'd be way easier to get to know them, find shared interests and have meaningful conversations

By the way, what's up with Iterator everywhere?

supporting this field is extremely easy If you keep raw data, it's just a matter of adding a getter method to the Article class.

@property
def highlights(self) -> Sequence[Highlight]:
    default = [] # defensive to handle older export formats that had no annotations
    jsons = self.json.get('annotations', default)
    return list(map(Highlight, jsons))

query language doesn't necessarily mean a database. E.g. see pandas which is capable of what SQL is capable of, and even more convenient than SQL for our data exploration purposes.

cachew lets you cache function calls into an sqlite database on your disk in a matter of single decorator (similar to functools.lru_cache). The difference from functools.lru_cache is that cached data is persisted between program runs, so next time you call your function, it will only be a matter of reading from the cache.

I want to have a choice whether to forget or remember events, and I'd like to be able to potentially access forgotten ones.

Even ignoring quality of life you are looking at a 3-7 fold return on every minute you spend exercising in extended life,[1] perhaps even exceeding that if you are making optimal use of your time. Something just clicked and I was consistent since reading this. Even 1-fold return would worth it: basically you gain free consciousness (quality of thinking is shit when I exercise, but it's better than nothing).

Exobrain, or "second brain", or "brain dump" is something like public wiki where you can keep your notes, ideas and thoughts.

Annotation is the process of adding a layer of personal (with a potential for sharing) metadata on top of existing content such as highlights, notes, anchors etc.

Human brains seem to be best for generating new ideas. I want to learn more, think faster, distract less, interact and visualize, effortlessly remember everything; not memorize and do routine information processing, which computers seem better at.

Extended mind is the idea that your mind isn't limited by your physical body, but augmented by external means. Paper notes & diaries, data in your computer/phone/cloud – all these things contribute to your cognitive process, thinking and help you navigate the landscape of ideas. One of the biggest motivations to start dumping my brain out here, write and share is to offload my mind a bit and interact with people even in my physical absence.

I can't imagine going on a run without my HR monitor, because whatever the benefit exercise has and however exhausting run would be, at least I'll have a data point. learning about routine and trying to optimize routine is also way more fun than doing the actual routine Human body is fragile and needs constant care, but it's still a fascinating mechanism.

Imagine that you're using a database to export them, so your schema is: TABLE Article(STRING id, STRING url, STRING title, DATETIME added). One day, the developers expose highlights (or annotations) from the private API and your export script stats receiving it in the response JSON. It's quite useful data to have! However, your database can't just magically change to conform to the new field.

Storage saved by using a database instead of plaintext is marginal and not worth the effort.

if necessary use databases as an intermediate layer to speed access up and as an additional interface to your data Nothing wrong with using databases for caching if you need it!

I want to argue very strongly against forcing the data in the database, unless it's really inevitable.

We use itertools.tee here so we don't have to pollute our code with temporary lists.

elaborate on a

distracting on low-level details

exposes

has

I've got a handy Emacs binding which appends a child note with a timestamp and enters edit mode, so the whole process is smooth.

I realized I didn't remember most of the books/papers/posts/videos I had consumed few years before

SuperMemo with its Incremental Video

You don't have to install anything or register, it's just a widget embedded in the page, but do make sure to allow JS. You should see yellow highlights and the sidebar on the right.

Another cool feature is that you can choose to make your annotations public and see other people's annotations or create a private group if you want to share them among specific people only.

Another cool feature is that you can choose to make your annotations public and see other people's annotations or create a private group if you want to share them among specific people only.

Hypothesis is simply awesome and my favorite web annotation tool.