Radek Osmulski

How to move to Australia if you are in tech

Australia is very welcoming for people in tech, especially if you work in AI. I have successfully gone through the visa application process myself and here is what I learned along the way. A word of caution: I am not an immigration lawyer. None of this is intended as advice

How did I get here?

An introductory chapter to a book on learning machine learning that I wrote.

How to reach the top of the imagenette leaderboard?

How to make your NNs more shift-invariant? What are some hyperparameter changes worth considering when training with a limited budget of epochs?

Going From Not Being Able to Code to Deep Learning Hero

A detailed plan for going from not being able to write code to being a deep learning expert. Advice based on personal experience.

How to build a Deep Learning system that will answer questions about the Harry Potter universe?

Riva is a set of APIs into a very complex, very well staffed AI research organization.

notes

20 Years of Tech Startup Experiences in One Hour by Jeremy Howard

There is no such thing as business... there is only such a thing as making things people want and selling them to them.

How to use the power of the community to learn faster

Community is the most powerful force behind online learning. It is the reason why MOOCs have a limited impact and tight-knit communities like fast.ai consistently produce unbelievable results.

howto

How to train and validate on Imagenet

Training on Imagenet is something that is completely trivial after you do it once, but if you are just someone on the Internet without such prior experience, it is an insurmountable task. Up until a couple of days ago, I didn't even know how to get the data! And then

Machine Learning and Testing

The rewards of testing can be immense, but so can be the price that one would need to pay for testing poorly.

How to train your neural network

Evaluation of cosine annealing.

Why take the log of a continuous target variable?

In this article, we’ll look at a simple but useful concept that often gets overlooked.

How to do machine learning efficiently

The only way to maintain your sanity in the long run is to be paranoid in the short run.

Do smoother areas of the error surface lead to better generalization?

An experiment inspired by the first lecture of the fast.ai MOOC

Introduction to data augmentation and pseudo-labeling

A closer look at two techniques that can help you make the most of your training data.

Can we beat the state of the art from 2013 with only 0.046% of training examples?

If we take the CNN layers of a pretrained model, how much data would we need to recover some of the mappings from features to classes? As it turns out, very little!

howto

Automated AWS spot instance provisioning with persisting of data

After following this guide, you will be able to spin up an AWS EC2 spot instance by executing a single command from your terminal. The instance will have a volume attached that will be persisted across shutdowns.