In this example we first initialize an ArenaAllocator with a child allocator, in this case the page allocator.

output tokens

An attention function can be described as mapping a query and a set of key-value pairs to an output, where the query, keys, values, and output are all vectors.

2D Vectors in space. Image by Author

先将 fm 进行3x3卷积

PYBIND11_MODULE(TORCH_EXTENSION_NAME, m) { m.def("forward", &lltm_forward, "LLTM forward"); m.def("backward", &lltm_backward, "LLTM backward"); }

Default: 0

两个远程系统之间的复制

Array Broadcasting in Numpy

Regression Loss Functions

Neural network models learn a mapping from inputs to outputs from examples and the choice of loss function must match the framing of the specific predictive modeling problem, such as classification or regression. Further, the configuration of the output layer must also be appropriate for the chosen loss function.

如果回归的是坐标，那么在计算损失时，大尺寸bbox的坐标误差占的比重可能就会比小尺寸bbox之间的坐标误差大得多，从而使得模型更偏向于学习大bbox，从而导致小目标的检测效果不佳

可以认为 π k \pi_k πk​就是每个分量 N ( x ∣ μ k , Σ k ) \mathcal{N}(\boldsymbol{x}|\boldsymbol{\mu}_k, \boldsymbol{\Sigma}_k) N(x∣μk​,Σk​)的权重。

The behaviour of the argument function is extended by the decorator without actually modifying it.

As of Python 3.6, f-strings are a great new way to format strings.

Optical Flow

A location into which the result is stored.

LEGO

Data Augmentation

Text Sequence Type

和 Python 里的字符串和列表切片不同，你不能在 start, stop 或者 step 这些参数中使用负数。:

line.strip()

# A recursive generator that generates Tree leaves in in-order.

Any function containing a yield keyword is a generator function;

Generators

if expression is creating a tuple, it must be surrounded with parentheses.

list comprehensions

An object is called iterable if you can get an iterator for it.

An iterator is an object representing a stream of data;

两个向量的外积，又叫向量积、叉乘等

key 形参用来指定在进行比较前要在每个列表元素上调用的函数

无矛盾的最佳球队

综述

小样本学习（Few-shot Learning）

CVPR (2020) 元学习、小样本、领域自适应、领域泛化、迁移学习论文汇总

"commandline"

How To Set Windows Terminal Starting Directory for WSL

Variables - Part 1

*

begins with a special symbol: #. This marks the line as a comment

Philosophy

Note that to make a file executable, you must set the eXecutable bit, and for a shell script, the Readable bit must also be set:

Shell Scripting Tutorial

Trajectory

robotics researchers

Optical flow

Used by convention to avoid naming conflicts with Python keywords.

meant as a hint to the programmer only.

torch.argmax(input, dim, keepdim=False) → LongTensor

torch.randint

可能在返回Tensor底层数据中使用了新的内存

需要先使用 t2 的 stride (1, 4) 转换到 t2 的结构，再基于 t2 的结构使用 stride (1,) 转换为形状为 (12,)的 b 。但这不是view工作的方式，view 仅在底层数组上使用指定的形状进行变形，即使 view 不报错，它返回的数据是

Tensor底层一维数组元素的存储顺序与Tensor按行优先一维展开的元素顺序是否一致。

执行 t2.view(-1)

t2 = t.transpose(0,1)

torch.view等方法操作需要连续的Tensor

numpy.arange([start, ]stop, [step, ]dtype=None

widthfloat or array-like, default: 0.8

bbool or None, optional

That function takes a tuple to specify the size of the output,

Similar to linspace, but uses a step size (instead of the number of samples).

Number of samples to generate.

numpy.linspace(start, stop, num=50, endpoint=True, retstep=False, dtype=None, axis=0

The angle by which the start of the pie is rotated, counterclockwise from the x-axis.

The second is a “throwaway” variable that we don’t need just yet, denoted with an underscore.

If <key> is not found, it returns None

The len() function returns the number of key-value pairs in a dictionary

the in and not in operators

key values are simple strings

Restrictions on Dictionary Values

it is not quite correct to say an object must be immutable to be used as a dictionary key.

Restrictions on Dictionary Keys#

a dictionary key must be of a type that is immutable.

the values contained in the dictionary don’t need to be the same type.

on the fly

Python does guarantee that the order of items in a dictionary is preserved.

they have nothing to do with the order of the items in the dictionary.

If you refer to a key that is not in the dictionary, Python raises an exception:

Dictionary elements are not accessed by numerical index

A list of tuples works well for this:

dd = dict([('a',1),('b',2)])

Dictionaries and lists share the following characteristics:

Dictionaries differ from lists primarily in how elements are accessed:

the instance behaves like a standard dictionary.

The first argument to the Python defaultdict type must be a callable that takes no arguments and returns a value.

Using the Python defaultdict Type for Handling Missing Keys

not to call it using the parentheses at initialization time.

the dictionary assigns it the default value that results from calling list().

if you call .setdefault() on an existing key, then the call won’t have any effect on the dictionary.

four available ways to handle missing keys

if you try to access or modify a missing key, then defaultdict will automatically create the key and generate a default value for it.

subclass collections.UserDict

Decide when and why to use a Python defaultdict rather than a standard dict

Emulating the Python defaultdict Type

augmented assignment operator

Sets are collections of unique objects,

for large datasets, it can also be a lot faster and more efficient.

Diving Deeper Into defaultdict

When and why to use a Python defaultdict rather than a regular dict

Note that __missing__() is not called for any operations besides __getitem__().

将RGB分量转化成灰度图像

Gamma校正

目标检测

大概过程

If we know the ball lands at a position ccc after the second drop, what is the probability that the previous position was aaa?