his single model is trained concurrently onImageNet, multiple translation tasks, image captioning (COCO dataset), a speechrecognition corpus, and an English parsing task. Our model architecture incor-porates building blocks from multiple domains. It contains convolutional layers,an attention mechanism, and sparsely-gated layers

Automated Machine Learning — A Paradigm Shift That Accelerates Data Scientist Productivity @ Airbnb

Notice that with a few exceptions, the non-tank areas are largely dark

like partial occlusion and saliency maps exist to provide a sanity check on the learning process.

al occlusion Occlude parts of the image and see how the classification changes [1].Saliency map Compute derivatives of class predictions with respect to the input image [2].Class Prediction Not a visualization per se, but can be a handy, simple check on the learning process.

At Merantix,

The Talking Machines Podcast by Katherine Gorman and Ryan Adams The Spectator by Shakir Mohamed Andrew Gelman’s Blog Christian Robert’s Blog OpenAI Blog Andrej Karpathy’s Blog Dustin Tran’s Blog Alex Smola’s Blog Radford Neal’s Blog Hal Daume III’s NLP Blog inFERENCe

Terra is a low-level system programming language that is embedded in and meta-programmed by the Lua programming language

Thirty-three Miniatures: Mathematical and Algorithmic Applications of Linear Algebra

Persistent homology is a method for computing topological features of a space at different spatial resolutions. More persistent features are detected over a wide range of length and are deemed more likely to represent true features of the underlying space, rather than artifacts of sampling, noise, or particular choice of parameters.

var myChart = chart().width(720).height(80); Modifying an existing chart is similarly easy: myChart.height(500); As is inspecting it: myChart.height(); // 500 Internally, the chart implementation becomes slightly more complex to support getter-setter methods, but convenience for the user merits additional developer effort! (And besides, this pattern becomes natural after you’ve used it for a while.) function chart() { var width = 720, // default width height = 80; // default height function my() { // generate chart here, using `width` and `height` } my.width = function(value) { if (!arguments.length) return width; width = value; return my; }; my.height = function(value) { if (!arguments.length) return height; height = value; return my; }; return my; } To sum up: implement charts as closures with getter-setter methods.

D3 for Mere Mortals

A visual explanation of the Enter, Update and Exit Selections in D3js

AI and HCI: Two Fields Divided by a Common Focus

A few equations scattered on a single page of paper explain most of what goes on in the physical world. This miracle speaks of the organizing principles of the universe: symmetry, invariance, and regularity—precisely the stuff on which mathematics feasts.

Natural Algorithms and Influence Systems By Bernard Chazelle

(One promising area of current research is Generative Adversarial Networks (GANs), which seem to be well-suited to generating realistic data.)

We put this orientation predictor into our pipeline, using its detected orientation to rotate the image to upright before doing word detection and OCRing.

, being very careful about their privacy,

Our jail infrastructure allows us to efficiently set up expensive resources a single time at startup, such as loading our trained models, then have these resources be cloned into a jail to satisfy a single OCR request. The resources are cloned Copy-on-Write into the forked jail and are read-only for how we use our models so it’s quite efficient and fast.

We generated about a million synthetic words, trained our deep net, and then tested our accuracy, which was around 79%.

Three years experience building machine learning or AI systems

opml2json A simple tool to convert opml files exported by Mindnode Pro to JSON consumable by D3 Javascript library.

"augmentation of human intellect" via an interactive vehicle navigating through "thought vectors in concept space."

He actually traveled with his own 16mm projector with a remote control for starting and stopping it to show what was going on (people were not used to seeing and following cursors back then).

needs for large scope, reduction in complexity, and end-user literacy would require that data and control structures be done away with in favor of a more biological scheme of protected universal cells interacting only through messages that could mimic any desired behavior.

Bruner

Research Debt

Distill

Architecture guidelines for stable Deep Convolutional GANsReplace any pooling layers with strided convolutions (discriminator) and fractional-stridedconvolutions (generator).Use batchnorm in both the generator and the discriminator.Remove fully connected hidden layers for deeper architectures.Use ReLU activation in generator for all layers except for the output, which uses Tanh.Use LeakyReLU activation in the discriminator for all layers

non-normative format:

Hypothes.is and the dream of universal web annotation

The “can you hear me” con is actually a variation on earlier scams aimed at getting the victim to say the word “yes” in a phone conversation. That affirmative response is recorded by the fraudster and used to authorize unwanted charges on a phone or utility bill or on a purloined credit card.

Adversarial Variational Bayes: Unifying Variational Autoencoders andGenerative Adversarial Networks