54 Matching Annotations
  1. Jun 2022
    1. Convenção de Magos e Bruxas de Paranapiacaba 2022

      Wow. I loved watching this video (made possible by the modern marvels of speech recognition and machine translation), and the sense of community that these people have. While some might consider their beliefs in witchcraft and spells "untrue" in some literal or technical sense, the cybernetic principles that organize their community are very sound.

  2. Apr 2021
    1. 4:04 - lol, I love how this scene simultaneously explores something old and something new — the old being Bojack trying to use alcohol to erase his negative feelings about people (i.e. Kelsey) he's wronged, and the new being this watery world where he can't do that.

    1. those who received normative explanations felt they hada better understanding of the system, and perceived the systemto have higher capability.

      I wonder if, since the normative examples are more directly comparable to the user's drawing, they inspire counterfactual thinking in the user (not counterfactuals themselves.) E.g. with the avocado, the user could think "if my avocado had a hole in the middle, it would've been classified as an avocado." In this way the user gains some causal understanding of the model. Effectively, the user is running the min-edit distance algorithm in their heads, with their "training examples" being the instance examples.

    1. Below are two more samples showing the model taking the same motif on a different spin. This opens up the potential for users to specify their own primer and use the model as a creative tool to explore a range of possible continuations.

      this area seems ripe for counterfactual simulation.

  3. Mar 2021
    1. I like the quiet it takes to pursue an idea the way I pursued 'Hamilton', but I couldn't write a book, because there's no applause at the end of writing a book.

      Need that reward.

  4. Jan 2021
    1. The mammalian cerebral cortex is a multi-scale biological computing device consisting of billions of neurons, arranged in layered, local circuits. These local circuits are arranged into columns, and groups of columns form an area. Connections between neurons within a local circuit, column and area are both convergent (projections within structures) and divergent (projections between structures). Both feed-forward and feed-back connections are typical, and information may flow over multiple routes to reach the same target. The result is a hierarchical, parallel, highly interconnected network of areas that tile the cerebral cortex.

      Whoa. This is perhaps one of the best succinct summaries I've seen of the structure of the brain yet. Gives me a good structure to start filling in my knowledge of those different levels of abstraction

    1. Stan Lee, in his heyday, did something wildly and radically different. And as far as I'm concerned, his vacant throne will remain empty until we come up with someone who has the guts and imagination to do the same.

      I love this. It takes guts to be different.

    1. Jack sees his life as a rich picture depicting an epic story and assumes that the key to his happiness lies in the broad components of the image. But this is a mistake, because Jack doesn’t live in the picture’s broad strokes, he lives at all times in a single pixel of the image—a single Today.

      The most awesome moments, though, are when you in your single pixel get a feel, a momentary flash of the magnitude and grandeur of the whole image being formed.

  5. Dec 2020
    1. Have multiple formulations: One of the most common mistakes made by researchers is to hold on very closely to a particular problem formulation. They will stick closely to a particular formulation of a problem, without asking if they can achieve insights on related problems. The important thing is to be able to make some progress: if you can find a related problem, or reformulate a problem in a way that permits you to move forward, that is progress.

      reframe problems. don't get beholden to one particular (finite) game

    2. In my opinion, there is little that is more important in research than building forward momentum. Being clear about some goal, even if that goal is the wrong goal, or the clarity is illusory, is tremendously powerful. For the most part, it’s better to be doing something, rather than nothing, provided, of course, that you set time aside frequently for reflection and reconsideration of your goals. Much of the time in research is spent in a fog, and taking the time to set clear goals can really help lift the fog.

      Lol, I bet Tim Urban & Michael Nielsen are connected in the dependency graph of ideas somehow.

      https://waitbutwhy.com/2014/10/religion-for-the-nonreligious.html

    1. We’d like to be able to tell the difference. Just as we must seek a more fluid ground in ethics (neither pure deontology nor pure consequentialism), we need more fluid approaches for our open-ended work.

      This tracks well with @visakanv's talking point of making 100 things PLUS developing good taste along the way. Have (dynamically modifiable) direction+magnitude.

    1. We can’t build cathedrals for every book.

      interestingly enough, this suggests the idea of spatiotemporal texts. (I'll admit it's not as catchy as timeful texts, though.)

  6. Nov 2020
    1. Of course, spaced repetition is just one approach for writing timeful texts. What other powerful tools might it be possible to create, making future books into artifacts that transcend their pages, as they slowly help readers shape their lives?

      One thing I can imagine is that the trigger for the repetition is context, not time. Andy has already said that digital gardens/ZK approximate spaced repetition -- I'm imagining something more expansive than the ZK, though. Like a dash of the Evernote Chrome Extension that suggests relevant notes during your web searches, and a dash of @visakanv's threaded visuals too. I feel like visuals in concert with spaced repetition are so powerful.

    2. Consider The Elements of Style,a classic writing primer by Strunk and White.The authors demonstrate the value of parallel construction with this example from the Bible: “Blessed are the poor in spirit: for theirs is the kingdom of heaven. Blessed are they that mourn: for they shall be comforted. Blessed are the meek: for they shall inherit the earth.” But it’s not enough to read an example. Good writers’ ears become automatically alert to these constructions. They notice opportunities to create parallelisms, and they notice dissonance when similar phrases are presented differently. It takes time to develop this awareness.

      "Analogy as the core of cognition" Hofstadter. Keep repeating stuff over time and eventually the human brain connects the dots

  7. Oct 2020
    1. A fertilized egg that can transform itself into the myriad of specializations needed to make a complex organism has parsimony, generality, enlightenment, and finesse—in short, beauty, and a beauty much more in line with my own esthetics. I mean by this that Nature is wonderful both at elegance and practicality—the cell membrane is partly there to allow useful evolutionary kludges to do their necessary work and still be able act as component by presenting a uniform interface to the world.

      kind of interesting to see all of the analogies that run through this writing. Makes me think of the fact that we think in terms of things we've concretized--in terms of things we "feel" inside, in terms of things whose inherent structure we can then map onto other things, in the form of an analogy.

    2. this encounter finally hit me with what the destiny of personal computing really was going to be. Not a personal dynamic vehicle, as in Engelbart's metaphor opposed to the IBM "railroads", but something much more profound: a personal dynamic medium. With a vehicle one could wait until high school and give "drivers ed", but if it was a medium, it had to extend into the world of childhood.

      I find it interesting that we teach kids to play in media (like Play-doh or LEGOs or LOGO,) and adults to learn specialized skills like driving and doctoring and such....

    1. Also remarkable, consider that when we add the numbers 72 and 83 we at some point will likely use 2+3=5; similarly, when we add 27 and 38 we will also use 2+3=5, despite the fact that the meaning of 2 and 3 in the second sum is completely different than in the first sum. In modern user interface terms, the numerals have the same affordances, despite their meaning being very different in the two cases.

      Terry Tao commented somewhere on stack overflow about notation as UI — the nature of some problems beget certain affordances in the notation. Seems like this is the same energy

  8. Sep 2020
    1. So if a fly lands on your arm, here’s what happens: The fly touches your skin and stimulates a bunch of sensory nerves. The axon terminals in the nerves have a little fit and start action potential-ing, sending the signal up to the brain to tell on the fly. The signals head into the spinal cord and up to the somas in the somatosensory cortex.18 The somatosensory cortex then taps the motor cortex on the shoulder and tells it that there’s a fly on your arm and that it needs to deal with it (lazy). The particular somas in your motor cortex that connect to the muscles in your arm then start action potential-ing, sending the signals back into the spinal cord and then out to the muscles of the arm. The axon terminals at the end of those neurons stimulate your arm muscles, which constrict to shake your arm to get the fly off (by now the fly has already thrown up on your arm), and the fly (whose nervous system now goes through its own whole thing) flies off.

      meh @ "somatosensory taps motor" LOL...like where's PFC? but otherwise pretty cool

    1. ‘Now, it’s very important to try to remember this image multisensorily.’ The more associative hooks a new piece of information has, the more securely it gets embedded into the network of things you already know, and the more likely it is to remain in memory.

      associative /hooks/ -- that's it!!

    1. AVs are interesting

      i.e., the desire to get to the bottom of things, get to the truth. I feel like my AV has come out a lot more in quarantine

    1. The lens through which we view trends matters. If you recognize Software 2.0 as a new and emerging programming paradigm instead of simply treating neural networks as a pretty good classifier in the class of machine learning techniques, the extrapolations become more obvious, and it’s clear that there is much more work to do.

      *viewing NNs through a more powerful frame/paradigm iiluminates their power

    2. Computationally homogeneous. A typical neural network is, to the first order, made up of a sandwich of only two operations: matrix multiplication and thresholding at zero (ReLU).

      Just as NNs are just matrices and RELUs, Lisp is only made out of lists and symbols...brains are only made out of neurons + action potentials? Vast oversimplification, but you see where I'm going with this.

    1. Extend the experiments section of a paper you like. Read the methods and results carefully. Try to find the duct tape. Consider the simplest extensions first and ask whether the paper's method would suffice. Think about baseline methods not discussed and imagine where those might fall short.

      This is an interesting idea

    1. It's about having a sharp and clear perception of what is.  If the event that we're perceiving is negative, like a social or political injustice, then yes, we also need to experience that, for what it is. But it's harder to see what is good in life, and in people.  Our culture gives all too much encouragement to disapprove, complain and reject.

      Serious "Religion for the Nonreligious" vibes (Tim Urban.) Gotta have clear perception -- addendum here is not just of bad, but of good too.

    1. When a friend of mine used to grumble because he had to write a paper for school, his mother would tell him: find a way to make it interesting. That's what you need to do: find a question that makes the world interesting. People who do great things look at the same world everyone else does, but notice some odd detail that's compellingly mysterious.

      find a really good frame.

    2. It's not so important what you work on, so long as you're not wasting your time. Work on things that interest you and increase your options, and worry later about which you'll take.

      Yes! Just the justification for my gap quarter that I was looking for ;)

    1. It is only with a combination of both rigorous formalism and good intuition that one can tackle complex mathematical problems; one needs the former to correctly deal with the fine details, and the latter to correctly deal with the big picture. Without one or the other, you will spend a lot of time blundering around in the dark (which can be instructive, but is highly inefficient). So once you are fully comfortable with rigorous mathematical thinking, you should revisit your intuitions on the subject and use your new thinking skills to test and refine these intuitions rather than discard them. One way to do this is to ask yourself dumb questions; another is to relearn your field.

      100% feel like this generalizes beyond mathematics. But mathematics is a really clear frame for this. Ask yourself dumb questions = question (or at least bring up) the fundamentals regularly.

      Also, rigor shapes one intuition = experience shapes one's tastes.

    1. In many ways, starting my own company has given me the sort of freedom which academics aspire to. Sure, I have customers to assist, servers to manage (not that they need much management), and business accounting to do; but professors equally have classes to teach, students to supervise, and committees to attend. When it comes to research, I can follow my interests without regard to the whims of granting agencies and tenure and promotion committees: I can do work like scrypt, which is now widely known but languished in obscurity for several years after I published it; and equally I can do work like kivaloo, which has been essentially ignored for close to a decade, with no sign of that ever changing.

      wow

    1. Prioritize Downtime

      Yeah, another thing I want. I think that after G goes to bed is a natural time for me to have downtime / play around / read.

    2. keep your word to yourself by committing to daily or weekly reviews of your progress. Check in on your scorecard and assess why you may be falling short of the goals you’ve set. If you’re exceeding them with ease, it may be time to push yourself further.

      I think we could use a bit more deadline-based goal-setting. Maybe not to the level of days, but like weekly goals are good. I think without that constraint, things become a bit too loosey goosey, hard to prioritize things, etc. (In fact, sporadic deadlines during the school year are what force me to prioritize one thing over another 😅)

    3. While you can attempt to maximize your lagging measure (i.e. number of blog posts published) it may be more valuable to optimize for your lead measure (i.e. number of hours spent writing in deep work).

      Not sure if I agree with this one. I think that starting from the big goal and working backwards is effective. Cue visakanv doing 1000 1000-word vomits..

    4. Direct your effort to your most important goals during your deep work hours. Keep your biggest objectives at the forefront of your mind to make it easier to ignore distractions that don’t serve your long term goals. Try using sticky notes on your desk that list out your top priorities so you don’t forget them.

      Honestly...sticky notes might not be a bad idea. I think I need to escape the constraints of purely using the computer screen....multi-tool person, not just an Emacs cultist, I am.

    1. In doing so, they find that middle- and working-class individuals per-ceive themselves differently in relation to dominant institutions and also possess differ-ent strategies for navigating those settings

      The frame affects the perception, which reinforces the frame...

    2. I view culture as a “tool kit” that includes both “strategies of action” (Swidler 1986) and “log-ics of action” (DiMaggio 1997).

      culture as mass programming.

    1. But the easiest and most effective way to thin out the fog is simply to be aware of it.

      This is why I want to do the 100 Blocks / polling myself every ten minutes. to get closer to the truth, to ask myself, "what am I actually doing?"

    2. In a Whoa moment’s transcendent level of consciousness, I see every interaction, every motivation, every news headline in unusual clarity—and difficult life decisions are much more obvious. I feel wise.

      Yep. Getting out to the universe/existential level, It's such a mind-blowing frame that it imbues everything else you look at for a little while after with that same frame of wonder.

    3. The fog lines up a row of carrots, tells us that they’re the key to happiness, and tells us to forget today’s happiness in favor of directing all of our hope to all the happiness the future will hold because we’re gonna get those carrots.

      This feels in tension with the narrative that the animals want instant gratification, i.e. prioritizing today's happiness. Or maybe, to differentiate it, the animals care about today's pleasure, not today's happiness? Idk. Well either way, the animals aren't choosing stuff that's gonna truly make us happy in the long term.

    1. So while thousands of Jack’s Todays will, to an outsider from far away, begin to look like a complete picture, Jack spends each moment of his actual reality in one unremarkable Today pixel or another. Jack’s error is brushing off his mundane Wednesday and focusing entirely on the big picture, when in fact the mundane Wednesday is the experience of his actual life.

      Yup — that's the fog.

      "Tomorrow's not actually just gonna be a pixel, it's gonna be an entire painting!!"

      "Tomorrow, I'm gonna be this awesome person who's a polymath knowledge graph ethical hacker ....."

      Nah dude, it's just a bunch of Todays.

  9. Apr 2020
    1. DeepCluster iteratively clusters deep features from a single-modality encoder, and then uses the cluster assignments totrain the same encoder to improve its representation.

      while training:

      - k-means cluster features (assign "pseudo-labels")
      
      - train encoder on pseudo-labels
      
    1. However, if we introduce the hard negativesafter the initial optimization with easy negatives only (in our case between 40th and 50th epoch),fine-tuning using some harder negatives yields better results in terms of both AVTS accuracy

      Pretrain with "easy" negatives, then fine-tune with some harder negatives mixed in.

    2. The functiong(fa(a(n)),fv(v(n)))is then responsible to fuse the feature information fromboth modalities to address the synchronization task

      the purpose is to learn multimodal features, not just to synchronize

    3. inour work we train on negative samples that are “hard,” i.e., represent out-of-sync audio and visualsegments sampled from the same video. This forces the net to learn relevant temporal-sensitivefeatures for both the audio and the video stream in order to recognizesynchronizationas opposed toonly semantic correspondence.

      Giving "hard" negative examples to network - we could use same-patient, out-of-sync audio-video pair

    1. approaches to depression assessment from NLP, speech processing, and HCI tend to silo bysubfield, with little discussion about the utility of combining promising approaches

      Siloed modalities