RSSAmplifier

Blog

大トロ

ml ・ design

blog.otoro.netRSS feed ↗15 posts

Latest posts

Collective Intelligence for Deep Learning: A Survey of Recent Developments

We survey ideas from complex systems such as swarm intelligence, self-organization, and emergent behavior that are gaining traction in ML. (Figure: Emergence of encirclement tactics in MAgent .) Introduction Unless you’ve been living under a rock, you would’ve noticed that artificial neural networks are now used everywhere. They’re impacting our everyday lives, from performing predictive tasks…

EvoJAX: A Hardware-Accelerated Neuroevolution

EvoJAX is a hardware-accelerated neuroevolution toolkit built on top of JAX. It can help run a wide range of evolution experiments within minutes on a TPU/GPU, compared to hours or days on CPU clusters. Redirecting to github.com/google/evojax/ , where the repo resides.

Permutation-Invariant Neural Networks for Reinforcement Learning

Reinforcement learning agents typically perform poorly if provided with inputs that were not clearly defined in training. A new approach enables RL agents to perform well, even when subject to corrupt, incomplete, or shuffled inputs. Note: This blog post about our paper is written by Yujin Tang and myself, and was originally posted on Google AI Blog . It has been cross-posted here for archival…

Modern Evolution Strategies for Creativity&#x3a;</br>Fitting Concrete Images and Abstract Concepts

--> --> --> “A drawing of a cat” CLIP + ES + Triangles GitHub --> Redirecting to es-clip.github.io , where the article resides.

Neuroevolution of Self-Interpretable Agents

--> --> --> Evolved Biped Walker. --> Agents with a self-attention “bottleneck” not only can solve these tasks from pixel inputs with only 4000 parameters, but they are also better at generalization. GitHub --> Redirecting to attentionagent.github.io , where the article resides.

Learning to Predict Without Looking Ahead

--> --> --> Evolved Biped Walker. --> Rather than hardcoding forward prediction, we try to get agents to learn that they need to predict the future. GitHub --> Redirecting to learningtopredict.github.io , where the article resides.

Weight Agnostic Neural Networks

--> --> --> Evolved Biped Walker. --> We search for neural network architectures that can already perform various tasks even when they use random weight values. GitHub --> Redirecting to weightagnostic.github.io , where the article resides.

Learning Latent Dynamics for Planning from Pixels

--> --> --> Evolved Biped Walker. --> PlaNet learns a world model from image inputs only and successfully leverages it for planning in latent space. GitHub --> Redirecting to planetrl.github.io , where the article resides.

Reinforcement Learning for Improving Agent Design

--> --> --> Evolved Biped Walker. --> Little dude rewarded for having little legs. GitHub --> Redirecting to designrl.github.io , where the article resides.

World Models Experiments

GitHub In this article I will give step-by-step instructions for reproducing the experiments in the World Models article ( pdf ). The reference TensorFlow implementation is on GitHub . Other people have implemented World Models independently. There is an implementation in Keras that reproduces part of the CarRacing-v0 experiment. There is also another project in PyTorch that attempts to apply this…

World Models

--> --> --> Evolved Biped Walker. --> Can agents learn inside of their own dreams? GitHub --> Redirecting to worldmodels.github.io , where the article resides.

Evolving Stable Strategies

--> --> --> Evolved Biped Walker. --> Going for a ride. GitHub In the previous article , I have described a few evolution strategies (ES) algorithms that can optimise the parameters of a function without the need to explicitly calculate gradients. These algorithms can be applied to reinforcement learning (RL) problems to help find a suitable set of model parameters for a neural network agent. In…

A Visual Guide to Evolution Strategies

Survival of the fittest. Evolved Bipedal Walker GitHub --> In this post I explain how evolution strategies (ES) work with the aid of a few visual examples. I try to keep the equations light, and I provide links to original articles if the reader wishes to understand more details. This is the first post in a series of articles, where I plan to show how to apply these algorithms to a range of tasks…

Teaching Machines to Draw

Latent space interpolation of various vector drawings produced by sketch-rnn . GitHub This is an updated version of my article, cross-posted on the Google Research Blog . Instructions on using the sketch-rnn model is available at Google Brain Magenta Project . Link to our paper, “ A Neural Representation of Sketch Drawings ”. This article has also been translated to Simplified Chinese .…

Recurrent Neural Network Tutorial for Artists

This post is not meant to be a comprehensive overview of recurrent neural networks. It is intended for readers without any machine learning background. The goal is to show artists and designers how to use a pre-trained neural network to produce interactive digital works using simple Javascript and p5.js library. Introduction Handwriting Generation with Javascript Machine learning has become a…