22 Matching Annotations
  1. Nov 2021
    1. Although Olympus allows the market to largely determine the price of OHM, it does use the assets in the vault to help keep the price as close to a dollar as possible.

      Minting is a form of dilution which puts downward pressure on the price. I think of it as a 'soft peg' to the RFV of $1 per OHM. Note the protocol explicitly mentions OHM is not pegged but rather backed by $1, nevertheless this is a good mental model

    2. In addition, since the issuance of new OHM only requires collateral worth $1, the premium also represents the amount of OHM that can be minted in the future. For example, based on the RVF and circulating supply indicators listed above, the agreement can increase the current supply of OHM by 21 times. Of course, this may change, but it means that as the value of the treasury grows, the ability to issue more OHM will increase accordingly.

      Price premium is what allows minting (inflation). This implies that in the absence of bonds, while the price and units of OHM may change, your % of the TVL should not change as long as you stake

  2. May 2021
    1. But filling a menu with too many items can actually hamper choice, according to menu design experts. They say offering any more than seven items can overwhelm diners. To overcome this, they tell restaurants to break down their menus into sections of between five and seven dishes.“More than seven is too many, five is optimal and three is magical,” says Rapp. There is some research to back this up – a study from Bournemouth University a few years ago found that in fast food restaurants, customers wanted to pick from six items per category. In fine dining establishments, they preferred a little more choice – between seven and 10 items.

      3-10 is the range, the most upscale the establishment, the more choice you may offer

    2. Allen even says simply reordering the dishes on the menu can also have dramatic impacts. By placing the most expensive item at the top of the menu, it makes those that come after it seem far more reasonably priced.

      A bit like anchoring

  3. Apr 2021
    1. For years, most of the data management and other infrastructure chores in the data center ran on generic network interface cards, or NICs, and separate bundles of hardware that are attached to servers or storage to connect them to Ethernet networks. But more and more of the chores have been replaced in recent years by software relegated to the CPU in the server.One of the disadvantages is that the infrastructure software in the server strains the CPU. By offloading these functions to a DPU or SmartNIC, the CPU in the server can focus on other workloads. Data management chores—from ferrying data between the servers to storing and securing it—drain up to 30% of the CPU resources in modern data centers, NVIDIA estimates.

      Why DPU (Data Processing Unit) matters

  4. Mar 2021
    1. Through various tests with the first minimal instruction-set, the RISC-V designers made two important discoveries:RISC-V programs would typically take close to or less space in memory than any other CPU architecture. Including x86, which was supposed to be space efficient given that it is a CISC ISA.It needed to execute fewer micro-operations than other ISAs.

      Small program + fast execution can be achieved with RISC-V (link with David Patterson's paper)

    2. Under normal circumstances there is a a problem with Macro-fusion: While two instructions can be replaced by one, they still consume twice as much space in memory. But with instruction compression we are not consuming any more space. We get the best of both worlds.

      Compressed + Mop fusion -> both speed and space savings

    3. Compressed instructions — Instructions are compressed in memory and decompressed at first stage of CPU.Macro-operation Fusion — Two or more simple instructions read by the CPU are fused into one complex instruction.

      Benefits of complex instructions shrink due to 1) compressed instructions, 2) macro-op fusion

    1. But this is no match for the M1, which has an absolutely unheard of number of decoders: Eight. Significantly more than anybody else in the industry. That means it can fill up the instruction buffer much quicker.To deal with this the M1 also has an instruction buffer which is 3x times larger than what is normal in the industry.

      Lots of decoders + large instr buf = fast refill of instructions for Out-of-Order Execution unit

    2. This is what allows the M1 Firestorm cores to essentially process twice as many instructions as AMD and Intel CPUs at the same clock frequency.

      RISC = fixed length instructions, trivial to parallelize the decoding vs. CISC = variable length, brute force decode at every possible length does not scale

    3. Basically you got two forms of parallelism: One that the developer must deal with explicitly when writing code and one that is entirely transparent. Of course the latter relies on lots of transistors on the CPU dedicated to Out-of-Order Execution magic. This is not a viable solution for small CPUs with few transistors.It is the superior Out-of-Order execution that is making the Firestorm cores on the M1 kick ass and take names. It is in fact much stronger than anything from Intel or AMD and they may never be able to catch up. To understand why, we need to get into some more technical details.

      Jim Keller's given vs. found parallelism. Apple Firestorm CPU finds parallelism really well, hence making it fast

    4. The problem with threads is that software developers have to write so called multi-threaded code. That is often difficult. In the past, this was some of the hardest code to write. However making server software multi-threaded tends to be easy. It is simply a matter of handling each user request on a separate thread. Thus in this case having lots of cores, is an obvious advantage. Especially for cloud services.

      Multi-threaded programs for server are easier to write

    5. Apple’s not so secret heterogeneous computing strategyInstead of adding ever more general-purpose CPU cores, Apple has followed another strategy: They have started adding ever more specialized chips doing a few specialized tasks. The benefit of this is that specialized chips tend to be able to perform their tasks significantly faster using much less electric current than a general-purpose CPU core.

      M1 = CPU + GPU + ISP + DSP + NPU + Video Enc/Dec + Secure Enclave + Unified Memory

    1. A final impediment to persuasion is disagreeableness, a trait often expressed through argumentativeness. Disagreeable people are determined to crush the competition, and when you urge them to reevaluate their strategy, that’s what you become. However, if you’re willing to stand up to them rather than back down, you can sometimes gain the upper hand.

      Disagree with the Disagreeable

    2. A second obstacle to changing people’s opinions is stubbornness. Intractable people see consistency and certainty as virtues. Once made up, their minds seem to be set in stone. But their views become more pliable if you hand them a chisel.

      Let a Stubborn Person Seize the Reins

    3. The first barrier to changing someone’s view is arrogance. We’ve all encountered leaders who are overconfident: They don’t know what they don’t know. If you call out their ignorance directly, they may get defensive. A better approach is to let them recognize the gaps in their own understanding

      Ask a know-it-all to explain how things work

    1. The dairy industry uses the bacterium Streptococcus thermophilus to convert lactose into lactic acid, which gels milk. Viruses called bacteriophages can attack S. thermophilus, spoiling the yogurt culture. In 2007, Rodolphe Barrangou and Philippe Horvath were working at Danisco, one of the world's leading makers of yogurt cultures, when they found that the S. thermophilus genome contains odd chunks of repeated DNA sequences—so-called clustered regularly interspaced short palindromic repeats (CRISPR), which Spain's Francisco Mojica had first described in 1993 in the genome of the salt-loving microbe Haloferax mediterranei. The Danisco team found that the CRISPR sequences match the phage DNA, enabling S. thermophilus to recognize and fight off infections.

      CRISPR came from yogurt bacteria

    1. The Beast With Many Heads The paper further refined the self-attention layer by adding a mechanism called “multi-headed” attention. This improves the performance of the attention layer in two ways: It expands the model’s ability to focus on different positions. Yes, in the example above, z1 contains a little bit of every other encoding, but it could be dominated by the the actual word itself. It would be useful if we’re translating a sentence like “The animal didn’t cross the street because it was too tired”, we would want to know which word “it” refers to. It gives the attention layer multiple “representation subspaces”. As we’ll see next, with multi-headed attention we have not only one, but multiple sets of Query/Key/Value weight matrices (the Transformer uses eight attention heads, so we end up with eight sets for each encoder/decoder). Each of these sets is randomly initialized. Then, after training, each set is used to project the input embeddings (or vectors from lower encoders/decoders) into a different representation subspace.

      Attention heads = representation subspaces

    1. Identity Mapping by ShortcutsWe adopt residual learning to every few stacked layers.A building block is shown in Fig. 2. Formally, in this paperwe consider a building block defined as:y=F(x,{Wi}) +x

      The big idea that allowed training of deep networks without suffering "accuracy saturation". This is later borrowed in popular networks like the Transformer

    1. The following properties affect the output sizeojof a convolutional layeralong axisj:•ij: input size along axisj,•kj: kernel size along axisj,•sj: stride (distance between two consecutive positions of the kernel) alongaxisj,•pj: zero padding (number of zeros concatenated at the beginning and atthe end of an axis) along axisj.

      Formula symbol definitions