This is a temporary, read-only recovery of the chessprogrammingwiki while a longer-term plan is worked out. Editing is not possible right now, but will be again soon.
Chess Programming Wiki All pages Other namespaces

Go

Home * Games * Go

19*19 Go board 11919 Go board 1*


  1. The Age of Intelligent Machines↩︎

The game of Go has attracted game researchers and programmers as an ambitious AI-challenge. Albert Zobrist was a pioneer, who wrote the first Go program in 1968 as part of his Ph.D. Thesis on pattern recognition 1. Chess programmers, beside others, Rémi Coulom and Gian-Carlo Pascutto became successful Go programmers with their programs CrazyStone and Leela respectively. Competitive computer Go, as organized by the ICGA 2, is played on boards with 9x9 as well with default 19x19 grids. Since Go lacks a simple evaluation function mainly based on counting material, attempts to apply similar techniques and algorithms as in chess were less successful. The breakthrough in computer Go was accomplished by Monte-Carlo tree search and deep learning.

Contents
  1. Progress
    1. Monte-Carlo Go
    2. CNNs
    3. AlphaGo
    4. AlphaGo Zero & AlphaZero
    5. Fine Art
  2. Quotes
  3. Computer Olympiads
  4. See also
    1. Search
    2. Learning
    3. Misc
    4. Videos on Go
  5. Selected Publications
    1. 1960 ...
    2. 1970 ...
    3. 1980 ...
    4. 1990
    5. 1995 ...
    6. 2000 ...
    7. 2005 ...
    8. 2010 ...
    9. 2015 ...
    10. 2020 ...
  6. Forum Posts
    1. 2005 ...
    2. 2010 ...
    3. 2015 ...
    4. 2020 ...
  7. External Links
    1. Tournaments
    2. Computer Go Archives
    3. Computer Go Pages
    4. Open Source
    5. Misc
    6. Go Challenge
    7. AlphaGo
    8. Fine Art
  8. References

Progress

Monte-Carlo Go

After early trials to apply Monte Carlo methods to a Go playing program by Bernd Brügmann in 1993 3, recent developments since the mid 2000s by Bruno Bouzy 4, and by Rémi Coulom, who coined the term Monte-Carlo Tree Search 5, in conjunction with UCT (Upper Confidence bounds applied to Trees) introduced by Levente Kocsis and Csaba Szepesvári 6, led to a breakthrough in computer Go 7.

CNNs

As mentioned by Ilya Sutskever and Vinod Nair in 2008 8, convolutional neural networks are well suited for problems with a natural translation invariance, such as object recognition. Go has some translation invariance, because if all the pieces on a hypothetical Go board are shifted to the left, then the best move will also shift (with the exception of pieces that are on the boundary of the board). Many applications of neural networks to Go have already used convolutional neural networks, such as Nicol N. Schraudolph et al. 9, Erik van der Werf et al. 10, and Markus Enzenberger 11, among others.

In 2014, two teams independently investigated whether deep convolutional neural networks 12 could be used to directly represent and learn a move evaluation function for the game of Go. Christopher Clark and Amos Storkey trained an 8-layer convolutional neural network by supervised learning from a database of human professional games, which without any search, defeated the traditional search program Gnu Go in 86% of the games 13 14 15 16 17. In their paper Move Evaluation in Go Using Deep Convolutional Neural Networks 18, Chris J. Maddison, Aja Huang, Ilya Sutskever, and David Silver report they trained a large 12-layer convolutional neural network in a similar way, to beat Gnu Go in 97% of the games, and matched the performance of a state-of-the-art Monte-Carlo Tree Search that simulates a million positions per move 19.

AlphaGo

In 2015, a team affiliated with Google DeepMind around David Silver, Aja Huang, Chris J. Maddison, and Demis Hassabis, supported by Google researchers John Nham and Ilya Sutskever, build a Go playing program dubbed AlphaGo, combining Monte-Carlo tree search with their 12-layer networks 20, the “policy network,” to select the next move, the “value network,” to predict the winner of the game. The neural networks were trained on 30 million moves from games played by human experts, until it could predict the human move 57 percent of the time. AlphaGo achieved a huge winning rate against other Go programs, and defeated European Go champion Fan Hui 21 in October 2015 with a 5 - 0 score 22 On March 9 to 15, 2016, AlphaGo won a $1M 5-game challenge match in Seoul versus Lee Sedol with 4 - 1 23 24 25. During The Future of Go Summit from May 23 to 27, 2017 in Wuzhen, China, AlphaGo won a three-game match versus current world No. 1 ranking player Ke Ji. After the Summit, AlphaGo is now retired from competitive play while DeepMind continues AI research in other areas 26.

AlphaGo Zero & AlphaZero

However, in October 2017, AlphaGo Zero, an evolution of AlphaGo was introduced. While previous versions were initially trained on thousands of human amateur and professional games to learn how to play Go, AlphaGo Zero learns exclusively by playing games against itself, starting from completely random play, to quickly surpass human level of play and defeated the previously published champion-defeating version of AlphaGo by 100 games to 0 27 28. AlphaGo Zero was further improved and even generalized for other games now dubbed AlphaZero, as published in December 2017 29.

Fine Art

Fine Art is a Go playing entity developed since 2016 under the patronage of the Chinese media company Tencent by a team around Liu Yongsheng, along with Ma Bo, Tang Shanmin, Wu Guangyu, and Zhang Kaixu. It won the Computer Go UEC Cup at the University of Electro-Communications, Chōfu, Tokyo, Japan, in March 2017 against a field of 27 other programs including DeepZenGo and Crazy Stone 30. In January 2018, it defeated Ke Jie 9P in 77 moves after giving two stones handicap 31 on Fox Weiqi 32 server 33.

Quotes

Quote by Gian-Carlo Pascutto in 2010 34:

There is no significant difference between an alpha-beta search with heavy LMR  and a static evaluator (current state of the art in chess) and an UCT searcher with a small exploration constant that does playouts (state of the art in go).

The shape of the tree they search is very similar. The main breakthrough in Go the last few years was how to backup an uncertain Monte Carlo score. This was solved. For chess this same problem was solved around the time quiescent search was developed.

Both are producing strong programs and we've proven for both the methods that they scale in strength as hardware speed goes up.

So I would say that we've successfully adopted the simple, brute force methods for chess to Go and they already work without increases in computer speed. The increases will make them progressively stronger though, and with further software tweaks they will eventually surpass humans. 

Computer Olympiads

See also

Learning

Misc

Videos on Go

Selected Publications

35

1960 ...

1970 ...

1980 ...

1990

1991

1992

1993

1994

1995 ...

1996

1997

1998

1999

2000 ...

2001

2002

2003

2004

2005 ...

2006

2007

2008

2009

2010 ...

2011

2012

2013

2014

2015 ...

2016

2017

2018

2019

2020 ...

Forum Posts

2005 ...

Re: A thought about ratings by Don Dailey, Computer Go Archive, December 10, 2007

Re: A thought about ratings by Edward de Grijs, Computer Go Archive, December 10, 2007

Re: A thought about ratings by Don Dailey, Computer Go Archive, December 10, 2007

2010 ...

2015 ...

2017

2018

2019

2020 ...

Watch on YouTube

Tournaments

Computer Go Archives

Program database - Program list

Program database - Programmer list

Computer Go - Past Events - Acorn 1984 » BBC Micro

1998 Ing Computer Goe Cup - Stories

Human-Computer Go Challenges

Computer Go Pages

Go Servers at Sensei's Library

Counting Legal Positions in Go by John Tromp, January 20, 2016

Open Source

Misc

Go Challenge

AlphaGo

The computer that mastered Go, with Demis Hassabis and David Silver, YouTube Video

Watch on YouTube

Watch on YouTube

Fine Art

References

Up one Level


  1. Albert Zobrist (1970). Feature Extraction and Representation for Pattern Recognition and the Game of Go. Ph.D. thesis , University of Wisconsin, also published as technical report, pdf↩︎

  2. Go at the Computer Olympiad↩︎

  3. Bernd Brügmann (1993). Monte Carlo Go. pdf↩︎

  4. Bruno Bouzy (2005). Associating domain-dependent knowledge and Monte Carlo approaches within a go program. Information Sciences, Heuristic Search and Computer Game Playing IV↩︎

  5. Rémi Coulom (2006). Efficient Selectivity and Backup Operators in Monte-Carlo Tree Search. CG 2006, pdf↩︎

  6. Levente Kocsis, Csaba Szepesvári (2006). Bandit based Monte-Carlo Planning. ECML-06, LNCS/LNAI 4212, pdf↩︎

  7. Sylvain Gelly, Marc Schoenauer, Michèle Sebag, Olivier Teytaud, Levente Kocsis, David Silver, Csaba Szepesvári (2012). The Grand Challenge of Computer Go: Monte Carlo Tree Search and Extensions. Communications of the ACM, Vol. 55, No. 3, pdf preprint↩︎

  8. Ilya Sutskever, Vinod Nair (2008). Mimicking Go Experts with Convolutional Neural Networks. ICANN 2008, pdf↩︎

  9. Nicol N. Schraudolph, Peter Dayan, Terrence J. Sejnowski (1993). Temporal Difference Learning of Position Evaluation in the Game of Go. NIPS 1993↩︎

  10. Erik van der Werf, Jos Uiterwijk, Eric Postma, Jaap van den Herik (2002). Local Move Prediction in Go. CG 2002↩︎

  11. Markus Enzenberger (2003). Evaluation in Go by a Neural Network using Soft Segmentation. Advances in Computer Games 10, pdf↩︎

  12. Convolutional neural network from Wikipedia↩︎

  13. Christopher Clark, Amos Storkey (2014). Teaching Deep Convolutional Neural Networks to Play Go. arXiv:1412.3409↩︎

  14. Deep learning for… Go by Erik Bernhardsson, December 11, 2014↩︎

  15. Teaching Deep Convolutional Neural Networks to Play Go by Hiroshi Yamashita, The Computer-go Archives, December 14, 2014↩︎

  16. Why Neural Networks Look Set to Thrash the Best Human Go Players for the First Time | MIT Technology Review, December 15, 2014↩︎

  17. Teaching Deep Convolutional Neural Networks to Play Go by Michel Van den Bergh, CCC, December 16, 2014↩︎

  18. Chris J. Maddison, Aja Huang, Ilya Sutskever, David Silver (2014). Move Evaluation in Go Using Deep Convolutional Neural Networks. arXiv:1412.6564v1↩︎

  19. Move Evaluation in Go Using Deep Convolutional Neural Networks by Aja Huang, The Computer-go Archives, December 19, 2014↩︎

  20. David Silver, Aja Huang, Chris J. Maddison, Arthur Guez, Laurent Sifre, George van den Driessche, Julian Schrittwieser, Ioannis Antonoglou, Veda Panneershelvam, Marc Lanctot, Sander Dieleman, Dominik Grewe, John Nham, Nal Kalchbrenner, Ilya Sutskever, Timothy Lillicrap, Madeleine Leach, Koray Kavukcuoglu, Thore Graepel, Demis Hassabis (2016). Mastering the game of Go with deep neural networks and tree search. Nature, Vol. 529↩︎

  21. Fan Hui at Sensei's Library↩︎

  22. Game Over? AlphaGo Beats Pro 5-0 in Major AI Advance « American Go E-Journal, January 27, 2016↩︎

  23. DeepMind - YouTube Channel↩︎

  24. Video Interview with Rémi Coulom on AlphaGo, February 2016↩︎

  25. Artificial intelligence: Google's AlphaGo beats Go master Lee Se-dol, BBC News, March 12, 2016↩︎

  26. AlphaGo’s Designers Explore New AI After Winning Big in China by Cade Metz, Wired, May 27, 2017↩︎

  27. AlphaGo Zero: Learning from scratch by Demis Hassabis and David Silver, DeepMind, October 18, 2017↩︎

  28. David Silver, Julian Schrittwieser, Karen Simonyan, Ioannis Antonoglou, Aja Huang, Arthur Guez, Thomas Hubert, Lucas Baker, Matthew Lai, Adrian Bolton, Yutian Chen, Timothy Lillicrap, Fan Hui, Laurent Sifre, George van den Driessche, Thore Graepel, Demis Hassabis (2017). Mastering the game of Go without human knowledge. Nature, Vol. 550↩︎

  29. David Silver, Thomas Hubert, Julian Schrittwieser, Ioannis Antonoglou, Matthew Lai, Arthur Guez, Marc Lanctot, Laurent Sifre, Dharshan Kumaran, Thore Graepel, Timothy Lillicrap, Karen Simonyan, Demis Hassabis (2017). Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm. arXiv:1712.01815↩︎

  30. Fine Art (software) from Wikipedia↩︎

  31. Two stones! Fine Art defeated Ke Jie 9P after giving two stones handicap. – Website of The International Go Federation, January 19, 2018↩︎

  32. Go Servers at Sensei's Library - Fox Weiqi↩︎

  33. Breakthrough: Fine Art beating Ke Jie with 2 Handicap Stones by Ingo Althöfer, Computer Go Archive, January 20, 2018↩︎

  34. Re: Chess vs Go // AI vs IA by Gian-Carlo Pascutto, June 02, 2010↩︎

  35. Computer Go Bibliography, University of Alberta↩︎

  36. GoTools - TsumeGo Solving Software↩︎

  37. Gobble↩︎

  38. Nici Schraudolph’s go networks, review by Jay Scott↩︎

  39. Mathematical Go from Sensei's Library↩︎

  40. EZ-GO at Sensei's Library↩︎

  41. Tsumego at Sensei's Library↩︎

  42. steganography from Wikipedia↩︎

  43. The Shodan Go Bet↩︎

  44. Re: Teaching Deep Convolutional Neural Networks to Play Go by Erik van der Werf, The Computer-go Archives, December 15, 2014↩︎

  45. Capturing race from Wikipedia↩︎

  46. Fuzzy markup language (FML) from Wikipedia↩︎

  47. Franz-Josef Dickhut from Wikipedia, Rémi Coulom↩︎

  48. codecentric go challenge 2014: Interviews with Franz-Josef Dickhut and Rémi Coulom - codecentric Blog by Raymond Georg Snatzke, October 1, 2014↩︎

  49. codecentric go challenge 2014: Final Interviews - codecentric Blog by Raymond Georg Snatzke, November 27, 2014 (German)↩︎

  50. How Facebook’s AI Researchers Built a Game-Changing Go Engine | MIT Technology Review, December 04, 2015↩︎

  51. Combining Neural Networks and Search techniques (GO) by Michael Babigian, CCC, December 08, 2015↩︎

  52. Re: Minmax backup operator for MCTS by Brahim Hamadicharef, CCC, December 30, 2017↩︎

  53. AlphaZero: Shedding new light on the grand games of chess, shogi and Go by David Silver, Thomas Hubert, Julian Schrittwieser and Demis Hassabis, DeepMind, December 03, 2018↩︎

  54. ELF OpenGo: An Open Reimplementation of AlphaZero by Carl Lumma, CCC, February 13, 2019↩︎

  55. GitHub - pytorch/ELF: ELF: a platform for game research with AlphaGoZero/AlphaZero reimplementation↩︎

  56. KataGo by Warren D. Smith, LCZero Forum, March 16, 2021↩︎

  57. New DeepMind paper by GregNeto, CCC, November 21, 2019↩︎

  58. MuZero: Mastering Go, chess, shogi and Atari without rules↩︎

  59. The Mystery of Go, the Ancient Game That Computers Still Can’t Win by Alan Levinovitz, Wired, May 12, 2014↩︎

  60. Yuandong Tian, Jerry Ma, Qucheng Gong, Shubho Sengupta, Zhuoyuan Chen, James Pinkerton, C. Lawrence Zitnick (2019). ELF OpenGo: An Analysis and Open Reimplementation of AlphaZero- arXiv:1902.04522↩︎

  61. Wired Article on Computer GO by Edmund Moshammer, CCC, May 13, 2014↩︎

  62. World #1 Go Player Ke Jie accepts Google Alpha Go Match.. by AA Ross, CCC, June 07, 2016↩︎

  63. Ke Jie from Wikipedia↩︎

Categories: Videos · Quotes

What links here

Contributors: GerdIsenberg.