Gradients or Mutations? Musings on Genetic Algorithms and Deep Learning (v0)

ref At its core, most of AI is about search: navigating vast parameter spaces to minimize a loss function. Deep learning (DL) does this via gradients,…