In summary, motivation is trying to feel like doing stuff. Discipline is doing it even if you don’t feel like it.

response times, error rates, and request rates

You can use authentication mechanisms such as OAuth2, JSON Web Tokens (JWT), or HTTP Basic Authentication to ensure that only authorized users or applications can access your API.

In this example, we’ve defined an API endpoint called /predict_image that accepts a file upload using FastAPI's UploadFile type. When a client sends an image file to this endpoint, the file is read and its contents are passed to a preprocessing function that prepares the image for input into the model. Once the image has been preprocessed, the model can make a prediction on it, and the result can be returned to the client as a JSON response.

For example, if you are using TensorFlow, you might save your model as a .h5 file using the Keras API. If you are using PyTorch, you might save your model as a .pt file using the torch.save() function. By saving your model as a file, you can easily load it into a deployment environment (such as FastAPI) and use it to make predictions on new images

Thinking that people are stupid is not thinking. Understanding them is.

Regular Shell Commands

The set -x command is used to turn on debugging in a shell script and can also be used to test bash aliases. When set -x is used, the command and its arguments are printed to the standard error stream before the command is executed. This can be useful for testing aliases because it lets you see exactly what command is running and with what arguments.

6. A function that checks if a website is up or down

5. A function that allows using sudo command without having to type a password every time

Kubernetes Aliases

Mac User Aliases

A much more elegant approach, however, is to add them to an ~/.aliases like file and then source this file in your respective profile file assource ~/.aliases

The way to get new ideas is to notice anomalies: what seems strange, or missing, or broken? You can see anomalies in everyday life (much of standup comedy is based on this), but the best place to look for them is at the frontiers of knowledge.Knowledge grows fractally. From a distance its edges look smooth, but when you learn enough to get close to one, you'll notice it's full of gaps. These gaps will seem obvious; it will seem inexplicable that no one has tried x or wondered about y. In the best case, exploring such gaps yields whole new fractal buds.

A huge percentage of the data that gets processed is less than 24 hours old. By the time data gets to be a week old, it is probably 20 times less likely to be queried than from the most recent day. After a month, data mostly just sits there.

Customer data sizes followed a power-law distribution. The largest customer had double the storage of the next largest customer, the next largest customer had half of that, etc.

the vast majority of customers had less than a terabyte of data in total data storage. There were, of course, customers with huge amounts of data, but most organizations, even some fairly large enterprises, had moderate data sizes.

Most applications do not need to process massive amounts of data. This has led to a resurgence in data management systems with traditional architectures; SQLite, Postgres, MySQL are all growing strongly, while “NoSQL” and even “NewSQL” systems are stagnating.

The most surprising thing that I learned was that most of the people using “Big Query” don’t really have Big Data. Even the ones who do tend to use workloads that only use a small fraction of their dataset sizes.

I think for some people that’s actually fine. Watching money compound gives them more pleasure than they would get spending it.

I think what many people really want from money is the ability to stop thinking about money. To have enough money that they can stop thinking about it and focus on other stuff.

To someone who grew up in an old-money affluent family, a Lamborghini might be a symbol of gaudy egotism; to those who grew up with nothing, the car might serve as the ultimate symbol that you’ve made it.

How you spend money can reveal an existential struggle of what you find valuable in life, who you want to spend time with, why you chose your career, and the kind of attention you want from other people.

I heard of a peculiar technique used by a company hiring a senior executive. In the final round of interviews, the candidates are taken to lunch, and during the meal something goes wrong—of course, this is all staged as a kind of test. Maybe someone walks up to the table and creates a scene, or perhaps the food delivered to the table is completely wrong. The purpose is to see how the candidate handles the situation. You fail the test if you over-react (for example, causing a scene yourself) or under-react (e.g., just letting things get out of control with no response).

If they cheat at small things, they will cheat at big things.

Great listeners possess extraordinary skills of awareness and comprehension. They can assess situations with tremendous accuracy, and act in ways that maximize group effectiveness.

I’ve met few great listeners in my entire life. But they are some of the most effective individuals I’ve ever encountered.

The flaw people hate most in others is usually their own greatest weakness.

I’d prefer to take a glimpse at how they spend time and money. Those reveal what a person is really all about.

His belief is that people’s character and ability to handle challenges are almost entirely formed during the first two decades of their life.

People reveal their true natures when they deal with others who have no power and can never return a favor.

A person’s choice of a spouse—or if they aren’t married, their closest lifelong partner—is much more revealing than anything they say or do in public.

We are so conditioned to think that our lives revolve around great moments. But great moments often catch us unawares. When that woman hugged me and said that I had brought her a moment of joy, it was possible to believe that I had been placed on earth for the sole purpose of providing her with that last ride.

These six are split across three operational meetings (each manager with their direct team, technical spec review, incident review), two developmental meetings (staff engineers, engineering managers) and finally a monthly engineering Q&A to learn what the organization is really thinking about.

My weekly team meetings always include my direct reports, and usually include our key partner in the Recruiting, People, and Finance teams. (I’ve also experimented with including engineers

Python — Json documents double as valid Python literals with minimal adaptation, and Python supports trailing commas and comments. It has variables and functions, powerful string interpolation, and json.dump built in. A self-contained Python file that prints json to stdout goes a long way!

always quote all strings. (Indeed, you can tell that somebody is an experienced yaml engineer when they defensively quote all the strings.) We can choose to always use true and false rather than yes and no, and generally stay away from the arcane features.

I think the main reason that yaml is so prevalent despite its pitfalls, is that for a long time it was the only viable configuration format.

Especially when compared to a plastic tongue scraper, a stainless steel one is better at balancing Ayurvedic imbalances. Unlike those made with gold, silver, brass, or copper, stainless steel tongue scrapers resist corrosion and are suitable for all mind-body types, or doshas, according to Dr. Deepak Chopra.  

kubectl auth can-i

Manolis Kellis: Origin of Life, Humans, Ideas, Suffering, and Happiness | Lex Fridman Podcast #123

Face To Face with MIKE SHINODA

Points from the comments in support of using Mac

Points from the comments in support of using Linux

There are also health and attitudinal consequences for managers who are laying people off as well as for the employees who remain. Not surprisingly, layoffs increase people’s stress.

Layoffs increase the odds of suicide by two and a half times.

The tech industry layoffs are basically an instance of social contagion, in which companies imitate what others are doing. If you look for reasons for why companies do layoffs, the reason is that everybody else is doing it.

Actually I’m not sure most people do this, I just hope I’m not the only one.

Solution #3: Switch to Conda-Forge

In general, the environment variable is too heavy-handed and should be avoided, since it will impact all images you build or run. Given the speed impact, you don’t for example want to run your postgres image with emulation, to no benefit.

The problem with this approach is that the emulation slows down your runtime. How much slower it is? Once benchmark I ran was only 6% of the speed of the host machine!

The other option is to run x86_64 Docker images on your ARM64 Mac machine, using emulation. Docker is packaged with software that will translate or emulate x86_64 machine code into ARM64 machine code on the fly; it’s slow, but the code will run.

Third, you can pre-compile wheels, store them somewhere, and install those directly instead of downloading the packages from PyPI.

If you have a compiler installed in your Docker image and any required native libraries and development headers, you can compile a native package from the source code. Basically, you add a RUN apt-get upgrade && apt-get install -y gcc and iterate until the package compiles successfully.

First, it’s possible the relevant wheels are available in newer versions of the libraries.

When you pip install murmurhash==1.0.6 on a M1/M2 Mac inside Docker, again it looks at the available files

When you pip install filprofiler==2022.05.0 on a M1/M2 Mac inside Docker, pip will look at the available files for that version, and then

In either case, pure Python will Just Work, because it’s interpreted at runtime: there’s no CPU-specific machine code, it’s just text that the Python interpreter knows how to run. The problems start when we start using compiled Python extensions. These are machine code, and therefore you need a version that is specific to your particular CPU instruction set.

on an Intel/AMD PC or Mac, docker pull will pull the linux/amd64 image. On a newer Mac using M1/M2/Silicon chips, docker pull will the pull the linux/arm64/v8 image.

In order to meet its build-once-run-everywhere promise, Docker typically runs on Linux. Since macOS is not Linux, on macOS this is done by running a virtual machine in the background, and then the Docker images run inside the virtual machine. So whether you’re on a Mac, Linux, or Windows, typically you’ll be running linux Docker images.

If I wanted to set someone up for a good life and they could focus on only one thing, I would prioritize getting social skills, especially conversational skills.

Of all the people I know, I can only think of a couple people who I believe really don’t want to be 50% of the conversation. Topic introduction should also be split pretty evenly.

“Nice” “Cool” “Ok” If you get a lot of single word answers, you are not keeping the other person interested. They are trying to prevent you from saying more, either because you habitually talk too much or because the topic isn’t interesting to them.

I have a friend who has somewhat extreme political views, but he will always say things like, “I believe X, but I bet you believe Y and you always have interesting takes, so I’d love to hear your thoughts”. It’s a great way to disagree in a positive and constructive way, and I always enjoy conversations with him.

It seems that these days everyone is so focused on being right and believes that changing their mind shows weakness, but in reality it is the opposite. Only confident people feel are able to change positions without affecting their self image.

Factual questions are good, but questions that deepen the conversation are even better. “What were you thinking when she said that?” “Was that as hard as it sounds?” “How did you learn how to do that?” “What made you decide to go that route?”

An ideal conversation is a mix of listening, asking questions, and sharing in a way that allows the other person to politely guide the conversation. You must ask questions so that the other person knows that you are interested in them and what they are saying. The worst conversations are those where both parties are waiting their turn to talk, saying as much as they can before getting interrupted, and then being forced to listen to the other.

I could tell a story about building my pinball machine. A crafty technical friend might be very interested in hearing every step, but my mom might not be interested in more than about 10 seconds of detail on it.

A conversation is best when both parties are interested, engaged, and want to share. If you interrupt you show that you are uninterested and you blunt the other person’s motivation to share.

I asked why she thought that was happening, and she said, “Covid”. The lack of socialization, especially at such a key time in life, had made this incoming class the first one that lacked basic manners and social skills.

This sort of behavior puts a huge burden on the listener because it makes them responsible for your emotional state. Their options are to deny you the emotional state you want, or to give it to you by lying. This is exhausting and will cause people to limit the amount of social time they spend with you.

The {vetiver} package provides a set of tools for building, deploying, and managing machine learning models in production. It allows users to easily create, version, and deploy machine learning models to various hosting platforms, such as Posit Connect or a cloud hosting service like Azure.

I hope to show how to demonstrate how easy model deployment can be using Posit’s open source tools for MLOps. This includes {pins}, {vetiver}, and the {tidymodels} bundle of packages along with the {tidyverse}.

W aktualnym stanie prawnym działalność nie podlega obowiązkowi rejestracji w przypadku, gdy miesięczny przychód z takiej działalności nie przekracza kwoty 50% minimalnego wynagrodzenia za pracę. Obecnie pensja minimalna wynosi 3010 zł, w związku z czym w 2022 roku wspomniany miesięczny limit jest równy kwocie 1505 zł

Although the architect could code, as the title suggests, there are other ways for the architect to stay engaged with the delivery, such as pairing and peer reviews.

Rotating the architect role among different team members carries the benefit of increasing the overall team’s working architectural knowledge. Team members gain a better understanding of all the roles involved in delivery, leading to empathy between team roles, improved intra-team interaction, and a better overall product by diversifying the viewpoints applied to each role.

Similarly, when I ask other architects how much they’ve coded recently, more often than not I hear: “It’s been a while.”

Use ssh -f -N -L to run the port-forwarding session in the background.

I always allocate a year: six months to get up to speed on the internal culture, tools, and processes; another six months to get your first performance review as a “ramped-up” engineer.

I posted my interview tracker spreadsheet on Twitter under the guise of “being transparent.” The very next day, I was on a phone screen with a recruiter when they said “Yeah, I looked at the interview spreadsheet you posted on Twitter and just based on that I can tell you’re not going to be a good fit here. I just took this call as a favor to <redacted> since they referred you.”

Just because you’re getting a lot of offers to interview does not mean that you are a hot commodity. Nor does it indicate a high likelihood of obtaining an offer.

If you had asked me right after I got laid off how long it would take me to get back to work, I would have said three months – including two months of vacation. It took me a year.

I highly recommend Advent of Code to anyone looking to sharpen (or re-sharpen) their programming skills.

I used vim and make for my universal IDE.

For the most part, homebrew solved the installation problem. Almost every language had a homebrew-based option.

I stayed up each night until the problem was released (11pm my time), but I didn’t try to code up the solution right away. Instead, I read the problem description before bed and then thought about how to solve it while falling asleep. I usually woke up every morning with a full sketch of the solution in my head, or something close to it.

net send * MESSAGE

You should check out Modal! Does much more than just cronjobs, but super easy and cheap: https://modal.com/docs/guide/cron.

Wildcards tend to be labelled as "Swiss army knife", "generalist", or "jack of all trades". Each term fails to describe the full range of value that a Wildcard brings to the table.Wildcards fit best into the chaotic nature of early-stage startups.

Here's my opinion, having written many thousands of lines of mypy code.

Typescript added rich type annotations to Javascript, which opened the door to refactoring and static analysis tools that facilitate development and maintenance of large Javascript projects.

Overall, the code was significantly shorter compared to the tkinter version I did last year. That version had a few more features, but I'd say Textual felt much easier to reason about.

Or more directly

In Python, everything is an object – integers, strings, lists, functions, even classes themselves.

The larger the capacity of an SSD, the more data can be written to it during its working life.

If you know the TBW for an SSD and the total amount of data that has been written to it during its lifetime, it’s simple to estimate the percentage of its lifetime (as TBW) that has been used up, hence the amount remaining.

“If something is not definitely ‘yes’, it is definitely ‘no’”. This is the leading idea of Greg McKeown’s great book Essentialism: The Disciplined Pursuit of Less

Monastic and bimodal modes are rather reserved for professions that can manage work without intensive communication with people, like writers, scientists, researchers, etc. Journalist mode fits best to people that are experienced with deep work and can easily switch into that state. From my experience, the best option to start with deep work is the rhythmic mode.

As far as deep work is concerned, it can be performed in four different modes:

Of course, CSV is less flexible than JSON. It's suitable when you have a list of items with mostly the same properties, and no nested structures.

At 100,000 entries, this list would be 2.4 MB (that's ~63% less than the JSON)

CSV is a format that's more lightweight than JSON and super well suited to streaming.

Those methods will wait until the entire response has been downloaded, and then parse it. That's because JSON is not a streaming format

JSON is ubiquitous, more lightweight than XML but still flexible enough to represent any data structure you typically need

GitHub Copilot is incredible, and if you check what’s happening in the preview released as the Copilot Labs extension it will only get more amazing.

At the end of the day, Copilot is supposed to be a tool to help developers write code faster, while ChatGPT is a general purpose chatbot, yet it still can streamline the development process, but GitHub Copilot wins hands down when the task is coding focused!

Summary: In people with normal vision (or corrected-to-normal vision), visual performance tends to be better with light mode, whereas some people with cataract and related disorders may perform better with dark mode. On the flip side, long-term reading in light mode may be associated with myopia.

If headaches and eye strain persist, go see an optician. I had the same problem about a year ago; it turns out I am long-sighted and require glasses. Since then, my headaches and eye strain have pretty much stopped.

Many people perceive light mode as the cause of eye strain. But blue light, among other things, is actually the cause of it most of the time.

According to an analysis from the Wall Street Journal, the top 1% of Twitch streamers made over 50% of all money paid out by the platform in 2021. Furthermore, just 5% of users had made over $1,000 in the same year. Only 0.06% had made over the U.S. median household income of $67,521. In a survey of 5,000 community members composed of smaller Twitch streamers, Stream Scheme found that 76% were not able to reach Twitch’s $100 minimum payout threshold. Most others were making between $25-130 per month on the platform. 

In a 2021 leak of Twitch’s user data that included creator payouts, it was revealed that from August 2019 to October 2021, the top 100 streamers on the platform made anywhere between $9,626,712.16 and $886,999.17. 

maps.google.com now redirects to google.com/maps. This implies that the permissions I give to Google Maps now apply to all of Googles services hosted under this domain.

Your changes preserved through git stash are saved in your project’s .git directory, usually, the path is /.git/refs/stash

“Berla devices position CBP and ICE to perform sweeping searches of passengers’ lives, with easy access to cars' location history and most visited places and to passengers’ family and social contacts, their call logs, and even their social media feeds,” she said.

Cybersecurity researcher Curry told Forbes that, after seeing what could be done with just a VIN, it was “terrifying” that those identifying numbers were public.

For anyone with a Honda or Nissan car, it was possible for a hacker with a laptop to unlock or start their vehicles, locate them and raid personal data stored inside, cybersecurity researchers warned on Wednesday.

“what surprised you when you got into X”, “what do people often misunderstand”, “what are most important problems in your field”

Think about your closest friends, and how these friendships happened. What needs are you fulfilling in each other’s lives? Are you happy with this state of affairs, or is something missing? What could be better?

Ultimately the data scientists need me more than I need them; I’m the reason their stuff is in production and runs smoothly.

The main reason I soured on data science is that the work felt like it didn’t matter, in multiple senses of the words “didn’t matter”:

You can't think well without writing well, and you can't write well without reading well. And I mean that last "well" in both senses. You have to be good at reading, and read good things.

Talking about your ideas with other people is a good way to develop them. But even after doing this, you'll find you still discover new things when you sit down to write.

if you need to solve a complicated, ill-defined problem, it will almost always help to write about it. Which in turn means that someone who's not good at writing will almost always be at a disadvantage in solving such problems.

Try this code at app startup:

The trigger is when you allocate 700 or more container objects (classes, dicts, tuples, lists, etc) more than have been cleaned up, a GC cycle runs.

An absolute location can be confidently calculated only when four (or more) distance values are available.

---.._ `\ ,;;;, "--.._ |,%%%%%% _ `\;;;; -\ _ _.'/\ try not to buy ,;;;;" .__{=====/_)==:_ || .io domains. ,,,;;;;;'`-./.____,'/ / '.\/ bcuz they're icky. 🤮 ;;;;;' `--.._.' / '-. `\/ ,'`. | __.-' \ ,' '`` `---`

.io is the official domain of "the british indian ocean territory"

To summarize the three options we’ve seen, as well as a streaming ijson-based solution:

For sufficiently simple cases, just running a few commands sequentially, with no subshells, conditional logic, or loops, set -euo pipefail is sufficient (and make sure you use shellcheck -o all).

Always start with functionsGrow to classes once you feel you can group different subsets of functions

First of all, in Python there are no such things as "files" and I noticed this is the main source of confusion for beginners.If you're inside a directory that contains any __init__.py it's a directory composed of modules, not files.

For every minute spent in organizing, an hour is earned.by Benjamin Franklin

the fact that the Poetry developers intentionally introduced failures to people’s CI/CD pipelines to motivate them to move away from Poetry’s legacy installer… Though we didn’t rely on the installer in our pipelines, this was the death knell for the continued use of Poetry.

Best times to post on social media overall: Tuesdays through Thursdays at 9 a.m. or 10 a.m. Best days to post on social media: Tuesdays through Thursdays Worst days to post on social media: Sundays

There are plenty of articles about the emergence of PyScript for embedding Python code directly into HTML, but until now the creation of browser extensions in Python has been something of a closed door.

In summary, terminal input is weird.  It’s weird largely because there’s a character-only pipe sitting between the terminal and shell.  And going one step back, the weirdness comes from the whole historical division of terminal vs. shell, which is based on emulating a physical hardware setup that hasn’t been built since the 80s. 

in MLflow 2.0, the mlflow.evaluate() API for model evaluation is now stable and production-ready. With just a single line of code, mlflow.evaluate() creates a comprehensive performance report for any ML model.

MLflow 2.0 also adds AutoML to MLflow Recipes, dramatically reducing the amount of time required to produce a high-quality model.

In MLflow 2.0, MLflow Recipes is now a core platform component with several new features, including support for classification models, improved data profiling and hyperparameter tuning capabilities.

As I think today microservice can do much more than just gives predictions using a single model, like:

notice that defaultdict not only returns the default value, but also assigns it to the key that wasn't there before:

we might need a dictionary subclass, and then we need to access a key that does not exist in that dictionary

The table also includes links to the documentation of the dunder method under the emoji 🔗. When available, relevant Pydon'ts are linked under the emoji 🗒️.

>>> 3 in my_list False >>> my_list.__contains__(3) False

“dunder” comes from “double underscore”

dunder methods are methods that allow instances of a class to interact with the built-in functions and operators

take a step back and ask a basic question: “What kind of business value are we trying to provide?"

As of today, a lot of the things in ML are not automated. They are manual or semi-manual.

If we say that MLOps is just DevOps + “some things”, then CI/CD is a core principle of that.

Not everything can be tested/evaluated with a metric like AUC or R2. Sometimes, people just have to check if things improved and not just metrics got better.

I believe that packaging/building/deploying the vanilla, run-of-the-mill ML model will become common knowledge for backend devs.

MLOps engineer today is either an ML engineer (building ML-specific software) or a DevOps engineer. Nothing special here.Should we call a DevOps engineer who primarily operates ML-fueled software delivery an MLOps engineer?I mean, if you really want, we can, but I don’t think we need a new role here. It is just a DevOps eng.

The MLOps team should consist of a DevOps engineer, a backend software engineer, a data scientist, + regular software folks.

By becoming a hybrid you can choose how you want to be unique. Countless unique combinations are available to you.

Being U-shaped requires bravery, because it’s so unusual. U-shaped people tend to be subjected to greater skepticism, because no one else really understands what they alone can see.

T-shaped. They tend to be natural leaders because they understand how different responsibilities overlap, and how to construct effective teams and processes.

The U-shaped path means developing skills that are not often found together. Like engineering and dancing, or singing and design.

The T-shaped hybrid path is one that many curious people follow. You grow your skillset and experience in areas that are adjacent to your dominant expertise. For example engineering and design, or singing and dancing.

I’m excited to see community efforts like Obsidian Ava

The sentence in italics above was not written by me. It was autocompleted as I wrote in Obsidian, using the Text Generator plugin.

In some ways it is surprising that filtering text is so technically challenging. Text seems like it would be easier to manipulate than images.

After decades of experience, he knew and understood that the most meaningful conceptual progress he made on problems was always away from his computer: on a run, in the shower, laying in bed at night. That’s where the insight came. And yet, even after all these years, he still felt a strange obligation to be at his computer because that’s too often our the mental image of “working”.

Work at MIT found that brainstorming—where a bunch of people put their heads together to try to come up with innovative solutions—generally “reduced creativity due to the tendency to incrementally modify known successful designs rather than explore radically different and potentially superior ones.”

It's like paying a quarter of your house's value for earthquake insurance when you don't live anywhere near a fault line.

The second is when your load is highly irregular. When you have wild swings or towering peaks in usage.

The cloud excels at two ends of the spectrum, where only one end was ever relevant for us. The first end is when your application is so simple and low traffic that you really do save on complexity by starting with fully managed services.

The first interaction with a programming language should be what it can do for you, rather than an exhaustive glossary of what it is.

Python is known for using more memory than more optimized languages and, in this case, it uses 7 times more than PostgresML.

PostgresML outperforms traditional Python microservices by a factor of 8 in local tests and by a factor of 40 on AWS EC2.

Lay the watch horizontally and align the hour hand of the watch with the direction of the sun. The middle point between the alignment of the sun with the hour hand, and the 12 o’clock position on the dial, approximately indicates south.

Use SSH and connect:

What makes a good error message

What makes a bad error message

By using a VPN, you are only changing who can see your network layer traffic. It does not increase any security.

any retailer doing credit card transaction processing is forced to use TLS

Because it's easy money. You just set up OpenVPN on a few servers, and essentially start reselling bandwidth with a markup.

Sometimes bullying comes with prejudice, but often it's a more instinctive behavior. There may be no belief, conscious or unconscious, behind it. It can be a plan or just an animal instinct to dominate, to coerce

git show | cat -A

For that, you must create a culture of fear in which it’s more important to show others you’ve been productive than to help the team achieve its goals.

Once you have convinced your team to estimate tasks, you can pressure people to work longer hours to prove they’re not bad at estimations.