“Computer Go”的意思、由来-开放百科全书

Go is a complex board game that requires intuition, creative and strategic thinking.^[3]^[4] It has long been considered a difficult challenge in the field of artificial intelligence (AI) and is considerably more difficult^[5] to solve than chess. Many in the field of artificial intelligence consider Go to require more elements that mimic human thought than chess.^[6] Mathematician I. J. Good wrote in 1965:^[7]

Prior to 2015,^[8] the best Go programs only managed to reach amateur dan level.^[9] On the small 9×9 board, the computer fared better, and some programs managed to win a fraction of their 9×9 games against professional players. Prior to AlphaGo, some researchers had claimed that computers would never defeat top humans at Go.^[10]

Early decades

The first Go program was written by Albert Lindsey Zobrist in 1968 as part of his thesis on pattern recognition.^[11] It introduced an influence function to estimate territory and Zobrist hashing to detect ko.

In April 1981, Jonathan K Millen published an article in Byte discussing Wally, a Go program with a 15x15 board that fit within the KIM-1 microcomputer's 1K RAM.^[12] Bruce F. Webster published an article in the magazine in November 1984 discussing a Go program he had written for the Apple Macintosh, including the MacFORTH source.^[13]

In 1998, very strong players were able to beat computer programs while giving handicaps of 25–30 stones, an enormous handicap that few human players would ever take. There was a case in the 1994 World Computer Go Championship where the winning program, Go Intellect, lost all three games against the youth players while receiving a 15-stone handicap.^[14] In general, players who understood and exploited a program's weaknesses could win with much larger handicaps than typical players.^[15]

21st century

Developments in Monte Carlo tree search and machine learning brought the best programs to high dan level on the small 9x9 board. In 2009, the first such programs appeared which could reach and hold low dan-level ranks on the KGS Go Server on the 19x19 board as well.

In 2010, at the 2010 European Go Congress in Finland, MogoTW played 19x19 Go against Catalin Taranu (5p). MogoTW received a seven-stone handicap and won.^[16]

In 2011, Zen reached 5 dan on the server KGS, playing games of 15 seconds per move. The account which reached that rank uses a cluster version of Zen running on a 26-core machine.^[17]

In 2012, Zen beat Takemiya Masaki (9p) by 11 points at five stones handicap, followed by a 20-point win at four stones handicap.^[18]

In 2013, Crazy Stone beat Yoshio Ishida (9p) in a 19×19 game at four stones handicap.^[19]

The 2014 Codecentric Go Challenge, a best-of-five match in an even 19x19 game, was played between Crazy Stone and Franz-Jozef Dickhut (6d). No stronger player had ever before agreed to play a serious competition against a go program on even terms. Franz-Jozef Dickhut won, though Crazy Stone won the first match by 1.5 points.^[20]

2015 onwards: The deep learning era

In October 2015, Google DeepMind program AlphaGo beat Fan Hui, the European Go champion, five times out of five in tournament conditions.^[21]

In March 2016, AlphaGo beat Lee Sedol in the first three of five matches.^[22] This was the first time that a 9-dan master had played a professional game against a computer without handicap.^[23] Lee won the fourth match, describing his win as "invaluable".^[24] AlphaGo won the final match two days later.^[25]^[26]

In May 2017, AlphaGo beat Ke Jie, who at the time was ranked top in the world,^[27]^[28] in a three-game match during the Future of Go Summit.^[29]

In October 2017, DeepMind revealed a new version of AlphaGo, trained only through self play, that had surpassed all previous versions, beating the Ke Jie version in 89 out of 100 games.^[30]

Since the basic principles of AlphaGo had been published in the journal Nature, other teams were able to produce high-level programs. By 2017, both Zen and Tencent's project Fine Art were capable of defeating very high level professionals some of the time.

Obstacles to high-level performance

For a long time, it was a widely held opinion that computer Go posed a problem fundamentally different from computer chess. It was believed that methods relying on fast global search with relatively little domain knowledge would not be effective against human experts. Therefore, a large part of the computer Go development effort was during these times focused on ways of representing human-like expert knowledge and combining this with local search to answer questions of a tactical nature. The result of this were programs that handled many situations well but which had very pronounced weaknesses compared to their overall handling of the game. Also, these classical programs gained almost nothing from increases in available computing power per se and progress in the field was generally slow.

A few researchers grasped the potential of probabilistic methods and predicted that they would come to dominate computer game-playing,^[31] but many others considered a strong Go-playing program something that could be achieved only in the far future, as a result of fundamental advances in general artificial intelligence technology. Even writing a program capable of automatically determining the winner of a finished game was seen as no trivial matter.

The advent of programs based on Monte Carlo search starting in 2006 changed this situation in many ways with the first 9-dan professional Go players being defeated in 2013 by multicore computers, albeit with four-stone handicap.

Size of board

The large board (19×19, 361 intersections) is often noted as one of the primary reasons why a strong program is hard to create. The large board size prevents an alpha-beta searcher from achieving deep look-ahead without significant search extensions or pruning heuristics.

In 2002, a computer program called MIGOS (MIni GO Solver) completely solved the game of Go for the 5×5 board. Black wins, taking the whole board.^[32]

Number of Move Options

Continuing the comparison to chess, Go moves are not as limited by the rules of the game. For the first move in chess, the player has twenty choices. Go players begin with a choice of 55 distinct legal moves, accounting for symmetry. This number rises quickly as symmetry is broken, and soon almost all of the 361 points of the board must be evaluated. Some moves are much more popular than others and some are almost never played, but all are possible.

Evaluation function

While a simple material counting evaluation is not sufficient for decent play in chess, it is often the backbone of a chess evaluation function, when combined with more subtle considerations like isolated/doubled pawns, rooks on open files (columns), pawns in the center of the board and so on. These rules can be formalized easily, providing a reasonably good evaluation function that can run quickly.

These types of positional evaluation rules cannot efficiently be applied to Go. The value of a Go position depends on a complex analysis to determine whether or not the group is alive, which stones can be connected to one another, and heuristics around the extent to which a strong position has influence, or the extent to which a weak position can be attacked.

More than one move can be regarded as the best depending on which strategy is used. In order to choose a move, the computer must evaluate different possible outcomes and decide which is best. This is difficult due to the delicate trade-offs present in Go. For example, it may be possible to capture some enemy stones at the cost of strengthening the opponent's stones elsewhere. Whether this is a good trade or not can be a difficult decision, even for human players. The computational complexity also shows here as a move might not be immediately important, but after many moves could become highly important as other areas of the board take shape.

Combinatorial problems

Sometimes it is mentioned in this context that various difficult combinatorial problems (in fact, any NP-hard problem) can be converted to Go-like problems on a sufficiently large board; however, the same is true for other abstract board games, including chess and minesweeper, when suitably generalized to a board of arbitrary size. NP-complete problems do not tend in their general case to be easier for unaided humans than for suitably programmed computers: it is doubtful that unaided humans would be able to compete successfully against computers in solving, for example, instances of the subset sum problem.

Endgame

Given that the endgame contains fewer possible moves than the opening (fuseki) or middle game, one might suppose that it is easier to play, and thus that a computer should be able to easily tackle it. In chess, computer programs perform worse in chess endgames because the ideas are long-term, unless the number of pieces is reduced to an extent that allows taking advantage of solved endgame tablebases.

The application of surreal numbers to the endgame in Go, a general game analysis pioneered by John H. Conway, has been further developed by Elwyn R. Berlekamp and David Wolfe and outlined in their book, Mathematical Go ({{ISBN|978-1-56881-032-4}}). While not of general utility in most playing circumstances, it greatly aids the analysis of certain classes of positions.

Nonetheless, although elaborate study has been conducted, Go endgames have been proven to be PSPACE-hard. There are many reasons why they are so hard:

Thus, it is very unlikely that it will be possible to program a reasonably fast algorithm for playing the Go endgame flawlessly, let alone the whole Go game.^[39]

Order of play

Current Monte-Carlo-based Go engines can have difficulty solving problems when the order of moves is important.^[40]

Tactical search

One of the main concerns for a Go player is which groups of stones can be kept alive and which can be captured. This general class of problems is known as life and death. The most direct strategy for calculating life and death is to perform a tree search on the moves which potentially affect the stones in question, and then to record the status of the stones at the end of the main line of play.

However, within time and memory constraints, it is not generally possible to determine with complete accuracy which moves could affect the 'life' of a group of stones. This implies that some heuristic must be applied to select which moves to consider. The net effect is that for any given program, there is a trade-off between playing speed and life and death reading abilities.

With Benson's algorithm, it is possible to determine the chains which are unconditionally alive and therefore would not need to be checked in the future for safety.

State representation

An issue that all Go programs must tackle is how to represent the current state of the game. For programs that use extensive searching techniques, this representation needs to be copied and/or modified for each new hypothetical move considered. This need places the additional constraint that the representation should either be small enough to be copied quickly or flexible enough that a move can be made and undone easily.

The most direct way of representing a board is as a one- or two-dimensional array, where elements in the array represent points on the board, and can take on a value corresponding to a white stone, a black stone, or an empty intersection. Additional data is needed to store how many stones have been captured, whose turn it is, and which intersections are illegal due to the Ko rule.

Most programs, however, use more than just the raw board information to evaluate positions. Data such as which stones are connected in strings, which strings are associated with each other, which groups of stones are in risk of capture and which groups of stones are effectively dead are necessary to make an accurate evaluation of the position. While this information can be extracted from just the stone positions, much of it can be computed more quickly if it is updated in an incremental, per-move basis. This incremental updating requires more information to be stored as the state of the board, which in turn can make copying the board take longer. This kind of trade-off is indicative of the problems involved in making fast computer Go programs.

An alternative method is to have a single board and make and take back moves so as to minimize the demands on computer memory and have the results of the evaluation of the board stored. This avoids having to copy the information over and over again.

System design

New approaches to problems

Historically, GOFAI (Good Old Fashioned AI) techniques have been used to approach the problem of Go AI. More recently, neural networks have been used as an alternative approach. One example of a program which uses neural networks is WinHonte.^[41]

These approaches attempt to mitigate the problems of the game of Go having a high branching factor and numerous other difficulties.

Computer Go research results are being applied to other similar fields such as cognitive science, pattern recognition and machine learning.^[42] Combinatorial Game Theory, a branch of applied mathematics, is a topic relevant to computer Go.^[42]

Design philosophies

The only choice a program needs to make is where to place its next stone. However, this decision is made difficult by the wide range of impacts a single stone can have across the entire board, and the complex interactions various stones' groups can have with each other. Various architectures have arisen for handling this problem. The most popular use:

Few programs use only one of these techniques exclusively; most combine portions of each into one synthetic system.

Minimax tree search

One traditional AI technique for creating game playing software is to use a minimax tree search. This involves playing out all hypothetical moves on the board up to a certain point, then using an evaluation function to estimate the value of that position for the current player. The move which leads to the best hypothetical board is selected, and the process is repeated each turn. While tree searches have been very effective in computer chess, they have seen less success in Computer Go programs. This is partly because it has traditionally been difficult to create an effective evaluation function for a Go board, and partly because the large number of possible moves each side can make each leads to a high branching factor. This makes this technique very computationally expensive. Because of this, many programs which use search trees extensively can only play on the smaller 9×9 board, rather than full 19×19 ones.

There are several techniques, which can greatly improve the performance of search trees in terms of both speed and memory. Pruning techniques such as alpha–beta pruning, Principal Variation Search, and MTD-f can reduce the effective branching factor without loss of strength. In tactical areas such as life and death, Go is particularly amenable to caching techniques such as transposition tables. These can reduce the amount of repeated effort, especially when combined with an iterative deepening approach. In order to quickly store a full-sized Go board in a transposition table, a hashing technique for mathematically summarizing is generally necessary. Zobrist hashing is very popular in Go programs because it has low collision rates, and can be iteratively updated at each move with just two XORs, rather than being calculated from scratch. Even using these performance-enhancing techniques, full tree searches on a full-sized board are still prohibitively slow. Searches can be sped up by using large amounts of domain specific pruning techniques, such as not considering moves where your opponent is already strong, and selective extensions like always considering moves next to groups of stones which are about to be captured. However, both of these options introduce a significant risk of not considering a vital move which would have changed the course of the game.

Results of computer competitions show that pattern matching techniques for choosing a handful of appropriate moves combined with fast localized tactical searches (explained above) were once sufficient to produce a competitive program. For example, GNU Go was competitive until 2008.

Knowledge-based systems

Novices often learn a lot from the game records of old games played by master players. There is a strong hypothesis that suggests that acquiring Go knowledge is a key to making a strong computer Go. For example, Tim Kinger and David Mechner argue that "it is our belief that with better tools for representing and maintaining Go knowledge, it will be possible to develop stronger Go programs." They propose two ways: recognizing common configurations of stones and their positions and concentrating on local battles. "... Go programs are still lacking in both quality and quantity of knowledge."^[43]

After implementation, the use of expert knowledge has been proved very effective in programming Go software. Hundreds of guidelines and rules of thumb for strong play have been formulated by both high level amateurs and professionals. The programmer's task is to take these heuristics, formalize them into computer code, and utilize pattern matching and pattern recognition algorithms to recognize when these rules apply. It is also important to have a system for determining what to do in the event that two conflicting guidelines are applicable.

Most of the relatively successful results come from programmers' individual skills at Go and their personal conjectures about Go, but not from formal mathematical assertions; they are trying to make the computer mimic the way they play Go. "Most competitive programs have required 5–15 person-years of effort, and contain 50–100 modules dealing with different aspects of the game."^[44]

This method has until recently been the most successful technique in generating competitive Go programs on a full-sized board. Some example of programs which have relied heavily on expert knowledge are Handtalk (later known as Goemate), The Many Faces of Go, Go Intellect, and Go++, each of which has at some point been considered the world's best Go program.

Nevertheless, adding knowledge of Go sometimes weakens the program because some superficial knowledge might bring mistakes: "the best programs usually play good, master level moves. However, as every games player knows, just one bad move can ruin a good game. Program performance over a full game can be much lower than master level."^[44]

Monte-Carlo methods

One major alternative to using hand-coded knowledge and searches is the use of Monte Carlo methods. This is done by generating a list of potential moves, and for each move playing out thousands of games at random on the resulting board. The move which leads to the best set of random games for the current player is chosen as the best move. The advantage of this technique is that it requires very little domain knowledge or expert input, the trade-off being increased memory and processor requirements. However, because the moves used for evaluation are generated at random it is possible that a move which would be excellent except for one specific opponent response would be mistakenly evaluated as a good move. The result of this are programs which are strong in an overall strategic sense, but are imperfect tactically.{{Citation needed|date=January 2015}} This problem can be mitigated by adding some domain knowledge in the move generation and a greater level of search depth on top of the random evolution. Some programs which use Monte-Carlo techniques are Fuego,^[45] The Many Faces of Go v12,^[46] Leela,^[47] MoGo,^[48] Crazy Stone, MyGoFriend,^[49] and Zen.

In 2006, a new search technique, upper confidence bounds applied to trees (UCT),^[50] was developed and applied to many 9x9 Monte-Carlo Go programs with excellent results. UCT uses the results of the play outs collected so far to guide the search along the more successful lines of play, while still allowing alternative lines to be explored. The UCT technique along with many other optimizations for playing on the larger 19x19 board has led MoGo to become one of the strongest research programs. Successful early applications of UCT methods to 19x19 Go include MoGo, Crazy Stone, and Mango.^[51] MoGo won the 2007 Computer Olympiad and won one (out of three) blitz game against Guo Juan, 5th Dan Pro, in the much less complex 9x9 Go. The Many Faces of Go^[52] won the 2008 Computer Olympiad after adding UCT search to its traditional knowledge-based engine.

Machine learning

While knowledge-based systems have been very effective at Go, their skill level is closely linked to the knowledge of their programmers and associated domain experts. One way to break this limitation is to use machine learning techniques in order to allow the software to automatically generate rules, patterns, and/or rule conflict resolution strategies.

This is generally done by allowing a neural network or genetic algorithm to either review a large database of professional games, or play many games against itself or other people or programs. These algorithms are then able to utilize this data as a means of improving their performance. AlphaGo used this to great effect. Other programs using neural nets previously have been NeuroGo and WinHonte.

Machine learning techniques can also be used in a less ambitious context to tune specific parameters of programs which rely mainly on other techniques. For example, Crazy Stone learns move generation patterns from several hundred sample games, using a generalization of the Elo rating system.^[53]

AlphaGo

AlphaGo, developed by Google DeepMind, made a significant advance by beating a professional human player in October 2015, using techniques that combined deep learning and Monte-Carlo tree search.^[54] AlphaGo is significantly more powerful than other previous Go programs, and the first to beat a 9 dan human professional in a game without handicaps on a full-sized board.

Datasets

[https://github.com/yenw/computer-go-dataset/ computer-go-dataset (1,645,958 SGFs)]

List of Go-playing computer programs

Competitions among computer Go programs

Several annual competitions take place between Go computer programs, the most prominent being the Go events at the Computer Olympiad. Regular, less formal, competitions between programs used to occur on the KGS Go Server^[65] (monthly) and the Computer Go Server^[66] (continuous).

Prominent go-playing programs include Crazy Stone, Zen, Aya, Mogo, The Many Faces of Go, pachi and Fuego, all listed above; and Taiwanese-authored coldmilk, Dutch-authored Steenvreter, and Korean-authored DolBaram.

History

The first computer Go competition was sponsored by Acornsoft,^[67] and the first regular ones by USENIX. They ran from 1984 to 1988. These competitions introduced Nemesis, the first competitive Go program from Bruce Wilcox, and G2.5 by David Fotland, which would later evolve into Cosmos and The Many Faces of Go.

One of the early drivers of computer Go research was the Ing Prize, a relatively large money award sponsored by Taiwanese banker Ing Chang-ki, offered annually between 1985 and 2000 at the World Computer Go Congress (or Ing Cup). The winner of this tournament was allowed to challenge young players at a handicap in a short match. If the computer won the match, the prize was awarded and a new prize announced: a larger prize for beating the players at a lesser handicap. The series of Ing prizes was set to expire either 1) in the year 2000 or 2) when a program could beat a 1-dan professional at no handicap for 40,000,000 NT dollars. The last winner was Handtalk in 1997, claiming 250,000 NT dollars for winning an 11-stone handicap match against three 11–13 year old amateur 2–6 dans. At the time the prize expired in 2000, the unclaimed prize was 400,000 NT dollars for winning a nine-stone handicap match.^[68]

Many other large regional Go tournaments ("congresses") had an attached computer Go event. The European Go Congress has sponsored a computer tournament since 1987, and the USENIX event evolved into the US/North American Computer Go Championship, held annually from 1988–2000 at the US Go Congress.

Japan started sponsoring computer Go competitions in 1995. The FOST Cup was held annually from 1995 to 1999 in Tokyo. That tournament was supplanted by the Gifu Challenge, which was held annually from 2003 to 2006 in Ogaki, Gifu. The Computer Go UEC Cup has been held annually since 2007.

Rule Formalization Problems in computer-computer games

When two computers play a game of Go against each other, the ideal is to treat the game in a manner identical to two humans playing while avoiding any intervention from actual humans. However, this can be difficult during end game scoring. The main problem is that Go playing software, which usually communicates using the standardized Go Text Protocol (GTP), will not always agree with respect to the alive or dead status of stones.

While there is no general way for two different programs to "talk it out" and resolve the conflict, this problem is avoided for the most part by using Chinese, Tromp-Taylor, or American Go Association (AGA) rules in which continued play (without penalty) is required until there is no more disagreement on the status of any stones on the board. In practice, such as on the KGS Go Server, the server can mediate a dispute by sending a special GTP command to the two client programs indicating they should continue placing stones until there is no question about the status of any particular group (all dead stones have been captured). The CGOS Go Server usually sees programs resign before a game has even reached the scoring phase, but nevertheless supports a modified version of Tromp-Taylor rules requiring a full play out.

It should be noted that these rule sets mean that a program which was in a winning position at the end of the game under Japanese rules (when both players have passed) could lose because of poor play in the resolution phase, but this is not a common occurrence and is considered a normal part of the game under all of the area rule sets.

The main drawback to the above system is that some rule sets (such as the traditional Japanese rules) penalize the players for making these extra moves, precluding the use of additional playout for two computers. Nevertheless, most modern Go Programs support Japanese rules against humans and are competent in both play and scoring (Fuego, Many Faces of Go, SmartGo, etc.).

Historically, another method for resolving this problem was to have an expert human judge the final board. However, this introduces subjectivity into the results and the risk that the expert would miss something the program saw.

Testing

Many programs are available that allow computer Go engines to play against each other and they almost always communicate via the Go Text Protocol (GTP).

GoGUI and its addon gogui-twogtp can be used to play two engines against each other on a single computer system.^[69] SmartGo and Many Faces of Go also provide this feature.

To play as wide a variety of opponents as possible, the KGS Go Server allows Go engine vs. Go engine play as well as Go engine vs. human in both ranked and unranked matches. CGOS is a dedicated computer vs. computer Go server.

See also

References

1. ^{{Cite web|url=http://sports.sina.com.cn/go/2016-08-02/doc-ifxunyya3020238.shtml|title=柯洁迎19岁生日雄踞人类世界排名第一已两年|date=May 2017|language=Chinese}}
2. ^{{Cite web|url=http://www.goratings.org/|title=World's Go Player Ratings|date=24 May 2017}}
3. ^{{cite web|url=https://www.wired.com/2016/03/googles-ai-wins-first-game-historic-match-go-champion/|title=Google's AI Wins First Game in Historic Match With Go Champion|date=9 March 2016|work=WIRED}}
4. ^https://www.koreatimes.co.kr/www/news/tech/2016/03/325_200068.html
5. ^{{cite journal|last1=Bouzy|first1=Bruno|last2=Cazenave|first2=Tristan|title=Computer Go: An AI oriented survey|journal=Artificial Intelligence|date= 9 August 2001|volume=132|issue=1|pages=39–103|doi=10.1016/S0004-3702(01)00127-8|url=http://www.sciencedirect.com/science/article/pii/S0004370201001278|accessdate=14 March 2016}}
6. ^{{Citation| url=https://query.nytimes.com/gst/fullpage.html?res=9C04EFD6123AF93AA15754C0A961958260 | title=To Test a Powerful Computer, Play an Ancient Game | last=Johnson | first=George | work=The New York Times| date=1997-07-29 | accessdate = 2008-06-16}}
7. ^http://www.chilton-computing.org.uk/acl/literature/reports/p019.htm
8. ^{{Cite journal|title = Mastering the game of Go with deep neural networks and tree search|url = https://www.nature.com/nature/journal/v529/n7587/full/nature16961.html|journal = Nature| issn= 0028-0836|pages = 484–489|volume = 529|issue = 7587|doi = 10.1038/nature16961|pmid = 26819042|first1 = David|last1 = Silver|author-link1=David Silver (programmer)|first2 = Aja|last2 = Huang|author-link2=Aja Huang|first3 = Chris J.|last3 = Maddison|first4 = Arthur|last4 = Guez|first5 = Laurent|last5 = Sifre|first6 = George van den|last6 = Driessche|first7 = Julian|last7 = Schrittwieser|first8 = Ioannis|last8 = Antonoglou|first9 = Veda|last9 = Panneershelvam|first10= Marc|last10= Lanctot|first11= Sander|last11= Dieleman|first12=Dominik|last12= Grewe|first13= John|last13= Nham|first14= Nal|last14= Kalchbrenner|first15= Ilya|last15= Sutskever|author-link15=Ilya Sutskever|first16= Timothy|last16= Lillicrap|first17= Madeleine|last17= Leach|first18= Koray|last18= Kavukcuoglu|first19= Thore|last19= Graepel|first20= Demis |last20=Hassabis|author-link20=Demis Hassabis|date= 28 January 2016|bibcode = 2016Natur.529..484S|accessdate=11 December 2017}}{{closed access}}
9. ^{{cite web|last=Wedd|first=Nick|title=Human-Computer Go Challenges|url=http://www.computer-go.info/h-c/index.html|work=computer-go.info|accessdate=2011-10-28}}
10. ^{{cite web|url=http://www.sciencemag.org/news/2016/01/huge-leap-forward-computer-mimics-human-brain-beats-professional-game-go|title='Huge leap forward': Computer that mimics human brain beats professional at game of Go}}
11. ^Albert Zobrist (1970), Feature Extraction and Representation for Pattern Recognition and the Game of Go. Ph.D. Thesis (152 pp.), University of Wisconsin. Also published as technical report
12. ^{{cite news | url=https://archive.org/stream/byte-magazine-1981-04/1981_04_BYTE_06-04_Future_Computers#page/n101/mode/2up | title=Programming the Game of Go | work=Byte | date=April 1981 | accessdate=18 October 2013 | author=Millen, Jonathan K | pages=102}}
13. ^{{cite news | url=https://archive.org/stream/byte-magazine-1984-11/1984_11_BYTE_09-12_New_Chips#page/n125/mode/2up | title=A Go Board for the Macintosh | work=Byte | date=November 1984 | accessdate=23 October 2013 | first=Bruce |last=Webster | authorlink=Bruce Webster | pages=125}}
14. ^{{cite web|url=http://www.itee.uq.edu.au/~janetw/Computer%20Go/CS-TR-339.html#6.2|title=CS-TR-339 Computer Go Tech Report|accessdate=28 January 2016}}
15. ^See for instance intgofed.org {{webarchive |url=https://web.archive.org/web/20080528195407/http://www.intgofed.org/history/computer_go_dec2005.pdf |date=May 28, 2008 }}
16. ^{{cite web|url=http://www.egc2010.fi/news.php|title=EGC 2010 Tampere News|accessdate=28 January 2016|deadurl=yes|archiveurl=https://web.archive.org/web/20090814112411/http://www.egc2010.fi/news.php|archivedate=14 August 2009|df=}}
17. ^{{cite web|url=http://www.gokgs.com/gameArchives.jsp?user=+Zen19D|title=KGS Game Archives|accessdate=28 January 2016}}
18. ^{{cite web|url=https://gogameguru.com/zen-computer-go-program-beats-takemiya-masaki-4-stones/|title=Zen computer Go program beats Takemiya Masaki with just 4 stones!|work=Go Game Guru|accessdate=28 January 2016|archive-url=https://web.archive.org/web/20160201162313/https://gogameguru.com/zen-computer-go-program-beats-takemiya-masaki-4-stones/|archive-date=2016-02-01|dead-url=yes|df=}}
19. ^{{cite web|title=「アマ六段の力。天才かも」囲碁棋士、コンピューターに敗れる　初の公式戦 |url=http://sankei.jp.msn.com/life/news/130320/igo13032020420000-n1.htm |publisher=MSN Sankei News |accessdate=27 March 2013 |deadurl=yes |archiveurl=https://web.archive.org/web/20130324221549/http://sankei.jp.msn.com/life/news/130320/igo13032020420000-n1.htm |archivedate=24 March 2013 |df= }}
20. ^{{cite web|url=https://go.codecentric.de/#homepage|title=codecentric go challenge – Just another WordPress site|accessdate=28 January 2016}}
21. ^{{cite web|url=http://www.nature.com/news/google-ai-algorithm-masters-ancient-game-of-go-1.19234|title=Google AI algorithm masters ancient game of Go|work=Nature News & Comment|accessdate=28 January 2016}}
22. ^{{cite web | title= Artificial intelligence: Google's AlphaGo beats Go master Lee Se-dol |url= https://www.bbc.co.uk/news/technology-35785875| author=|date= 12 March 2016| website= BBC News Online | accessdate= 12 March 2016 }}
23. ^{{cite web|url=https://www.theverge.com/2016/3/9/11184362/google-alphago-go-deepmind-result|title=Google's DeepMind defeats legendary Go player Lee Se-dol in historic victory|publisher=www.theverge.com|accessdate=9 March 2016}}
24. ^{{cite web | title= Artificial intelligence: Go master Lee Se-dol wins against AlphaGo program |url= https://www.bbc.co.uk/news/technology-35797102| author=|date= 13 March 2016| website= BBC News Online | accessdate= 13 March 2016 }}
25. ^{{cite web|url=https://www.theverge.com/2016/3/15/11213518/alphago-deepmind-go-match-5-result|title=Google's AlphaGo AI beats Lee Se-dol again to win Go series 4-1|website=The Verge|accessdate=15 March 2016}}
26. ^{{cite web|url=https://www.wired.com/2017/05/win-china-alphagos-designers-explore-new-ai/|title=After Win in China, AlphaGo's Designers Explore New AI|date=2017-05-27}}
27. ^{{Cite web|url=http://www.goratings.org/|title=World's Go Player Ratings|date=May 2017}}
28. ^{{Cite web|title=柯洁迎19岁生日雄踞人类世界排名第一已两年|url=http://sports.sina.com.cn/go/2016-08-02/doc-ifxunyya3020238.shtml|language=Chinese|date=May 2017}}
29. ^{{cite web|url=https://www.wired.com/2017/05/googles-alphago-continues-dominance-second-win-china/|title=Google's AlphaGo Continues Dominance With Second Win in China|date=2017-05-25}}
30. ^{{cite journal |first1=David |last1=Silver|author-link1=David Silver (programmer)|first2= Julian|last2= Schrittwieser|first3= Karen|last3= Simonyan|first4= Ioannis|last4= Antonoglou|first5= Aja|last5= Huang|author-link5=Aja Huang|first6=Arthur|last6= Guez|first7= Thomas|last7= Hubert|first8= Lucas|last8= Baker|first9= Matthew|last9= Lai|first10= Adrian|last10= Bolton|first11= Yutian|last11= Chen|author-link11=Chen Yutian|first12= Timothy|last12= Lillicrap|first13=Hui|last13= Fan|author-link13=Fan Hui|first14= Laurent|last14= Sifre|first15= George van den|last15= Driessche|first16= Thore|last16= Graepel|first17= Demis|last17= Hassabis |author-link17=Demis Hassabis|url=https://www.nature.com/nature/journal/v550/n7676/full/nature24270.html|title=Mastering the game of Go without human knowledge|journal=Nature|issn= 0028-0836|pages=354–359|volume =550|issue =7676|doi =10.1038/nature24270|pmid=29052630|date=19 October 2017|accessdate=10 December 2017|bibcode=2017Natur.550..354S}}{{closed access}}
31. ^Game Tree Searching with Dynamic Stochastic Control pp. 194–195
32. ^{{cite web|url=http://erikvanderwerf.tengen.nl/5x5/5x5solved.html|title=5x5 Go is solved|accessdate=28 January 2016}}
33. ^On page 11: "Crasmaru shows that it is NP-complete to determine the status of certain restricted forms of life-and-death problems in Go." (See the following reference.) {{cite arxiv |author=Erik D. Demaine, Robert A. Hearn |title=Playing Games with Algorithms: Algorithmic Combinatorial Game Theory |date=2008-04-22 |eprint=cs/0106019}}
34. ^{{cite book |author=Marcel Crasmaru |title=On the complexity of Tsume-Go |volume=1558 |doi=10.1007/3-540-48957-6_15 |pages= 222–231 | location=London, UK |publisher=Springer-Verlag |year=1999 |series=Lecture Notes in Computer Science |isbn=978-3-540-65766-8}}
35. ^{{cite web|url=http://senseis.xmp.net/?TripleKo|title=Triple Ko}}
36. ^{{cite web|url=http://senseis.xmp.net/?QuadrupleKo|title=Quadruple Ko}}
37. ^{{cite web|url=http://senseis.xmp.net/?MolassesKo|title=Molasses Ko}}
38. ^{{cite web|url=http://senseis.xmp.net/?MoonshineLife|title=Moonshine Life}}
39. ^{{cite web|url=http://senseis.xmp.net/?ComputerGoProgramming|title=Computer Go Programming}}
40. ^example of weak play of a computer program
41. ^{{cite web|url=http://www.jellyfish-go.com/ai.htm|archive-url=https://web.archive.org/web/20070703123614/http://www.jellyfish-go.com/ai.htm|dead-url=yes|archive-date=3 July 2007|title=Jellyfish-Go.com|accessdate=28 January 2016}}
42. ^¹Müller, Martin. Computer Go{{dead link|date=November 2016 |bot=InternetArchiveBot |fix-attempted=yes }}, Artificial Intelligence 134 (2002): p150
43. ^Müller, Martin. Computer Go{{dead link|date=November 2016 |bot=InternetArchiveBot |fix-attempted=yes }}, Artificial Intelligence 134 (2002): p151
44. ^¹Müller, Martin. Computer Go{{dead link|date=November 2016 |bot=InternetArchiveBot |fix-attempted=yes }}, Artificial Intelligence 134 (2002): p148
45. ^¹{{cite web|url=http://fuego.sourceforge.net/|title=Fuego}}
46. ^¹{{cite web|url=http://www.smart-games.com/manyfaces.html|title=Dan Level Go Software – Many Faces of Go|author=David Fotland}}
47. ^¹²{{cite web|url=http://www.sjeng.org/leela|title=Sjeng – chess, audio and misc. software}}
48. ^¹http://www.lri.fr/~teytaud/mogo.html
49. ^¹{{cite web|url=http://www.mygofriend.com/|title=MyGoFriend – Gold Medal Winner 15th Computer Olympiad, Go (9x9)|deadurl=yes|archiveurl=https://web.archive.org/web/20101208200028/http://mygofriend.com/|archivedate=2010-12-08|df=}}
50. ^{{cite web|url=http://senseis.xmp.net/?UCT|title=UCT}}
51. ^{{cite web|url=http://www.cs.unimaas.nl/go4go/mango/|title=Page not found (404)|deadurl=yes|archiveurl=https://web.archive.org/web/20071103202224/http://www.cs.unimaas.nl/go4go/mango/|archivedate=2007-11-03|df=}}
52. ^{{cite web|url=http://www.smart-games.com|title=Smart Games|author=David Fotland}}
53. ^{{cite web|url=http://remi.coulom.free.fr/Amsterdam2007/|title=Computing Elo Ratings of Move Patterns in the Game of Go|accessdate=28 January 2016}}
54. ^{{cite web|url=http://googleresearch.blogspot.com/2016/01/alphago-mastering-ancient-game-of-go.html|title=Research Blog: AlphaGo: Mastering the ancient game of Go with Machine Learning|author=|date=27 January 2016|work=Google Research Blog}}
55. ^{{cite web|url=http://www32.ocn.ne.jp/~yss/|title=Page ON/サービス終了のお知らせ|deadurl=yes|archiveurl=https://web.archive.org/web/20061211061341/http://www15.ocn.ne.jp/~yss/|archivedate=2006-12-11|df=}}
56. ^{{cite web|url=http://www.sente.ch/?p=1206&lang=en|title=Goban. Play Go on Mac – Sen:te}}
57. ^{{cite web|url=http://www.sente.ch/?p=1221&lang=en|title=Goban Extensions – Sen:te}}
58. ^{{cite web|url=http://www.goplusplus.com|title=Go++, Go playing program}}
59. ^{{cite web|url=http://www.lri.fr/~gelly/MoGo.htm |title=Archived copy |accessdate=2007-02-21 |deadurl=yes |archiveurl=https://web.archive.org/web/20061128074317/http://www.lri.fr/~gelly/MoGo.htm |archivedate=2006-11-28 |df= }}
60. ^{{cite web|url=http://pachi.or.cz/|title=Pachi – Board Game of Go / Weiqi / Baduk}}
61. ^http://www.peepo.com {{webarchive|url=https://web.archive.org/web/20110904081144/http://www.peepo.com/ |date=2011-09-04 }}
62. ^{{cite web|url=http://www.smartgo.com/|title=SmartGo|author=Anders Kierulf}}
63. ^{{cite web|url=http://erikvanderwerf.tengen.nl/steenvreter.html|title=STEENVRETER}}
64. ^{{cite web|url=http://senseis.xmp.net/?ZenGoProgram|title=Zen (go program)}}
65. ^{{cite web|url=http://www.weddslist.com/kgs/index.html|title=Computer Go Tournaments on KGS}}
66. ^{{cite web|url=http://cgos.boardspace.net/|title=9x9 Go Server|access-date=2007-03-25|archive-url=https://web.archive.org/web/20070119034515/http://cgos.boardspace.net/|archive-date=2007-01-19|dead-url=yes|df=}}
67. ^{{cite web|title=Acorn 1984 The First Computer Go Tournament|url=http://computer-go.info/events/acorn/1984/index.html|website=computer-go.info}}
68. ^{{cite web|url=http://www.smart-games.com/worldcompgo.html|title=World Computer Go Championships|author=David Fotland|accessdate=28 January 2016}}
69. ^Using GoGUI to play go computers against each other {{webarchive|url=https://web.archive.org/web/20110309022713/http://watchingnumbersgoup.com/usage-of-gogui-twogtp-on-windows |date=2011-03-09 }}

Performance