Randomized Kaczmarz: How Should You Sample?

The randomized Kaczmarz method is a method for solving systems of linear equations: (1) Throughout this post, the matrix will have dimensions . Beginning from an initial iterate , randomized Kaczmarz works as follows. For : What selection probabilities should we use? The answer to this question may depend on whether the system (1) Read more