beating KataGo by Adversarial attack

Hiroshi Yamashita · Post by **Hiroshi Yamashita** » Sat Nov 05, 2022 7:03 am

These two are recent papers about beating KataGo by anti strategy.

Adversarial Policies Beat Professional-Level Go AIs
https://arxiv.org/abs/2211.00241
Are AlphaZero-like Agents Robust to Adversarial Perturbations?
https://openreview.net/forum?id=yZ_JlZaOCzv

Rémi Coulom · Post by **Rémi Coulom** » Sat Nov 05, 2022 1:03 pm

Thanks, these are interesting results.

I have always felt that it is a fundamental weakness of the AlphaZero approach that the training set is made of self-play games: it does not learn to handle positions that do not occur between very strong players. That may be why Leela Zero had a lot of trouble learning ladders. If there is no ladder being played out in the training set, then the network cannot learn how to evaluate them.

Hiroshi Yamashita · Post by **Hiroshi Yamashita** » Sun Nov 06, 2022 5:19 am

I think the reason of ladder fail in LeelaZero, it needs search and long distance recognition.
In Shogi, AobaZero can not play simple capture move from to 19 to 91 by bishop.
With bishop movable position information input for NN, it can play.
But AobaZero still can not play bishop discover check by moving rook from 46 to 86, a bit more difficult move.
dlshogi(current strongest Shogi program by DCNN) also can not find this.
AlphaBeta program (Yanauraou) can find it easily.
Maybe this is limit of DCNN, and something hybrid method DCNN + AlphaBeta will be better.

Rémi Coulom · Post by **Rémi Coulom** » Wed Feb 22, 2023 6:46 pm

This newer result by the same authors is really interesting:
https://goattack.far.ai/

Hiroshi Yamashita · Post by **Hiroshi Yamashita** » Sat Feb 25, 2023 11:37 am

Counting nakade liberties in surround center looks like difficult for KataGo?
Very interesting.
It seems Fine Art has same problem. Japanese pro Go player Ryunosuke Shibano defeated by this attack.

Ohashi pro's tweet(In Japanese)
https://twitter.com/ohashihirofumi/stat ... 7068508161

Japanese newspaer also wrote this news.
[FT] Human beated Go AI. Found weekness. Suggest deep learning defect (In Japanese)
https://www.nikkei.com/article/DGXZQOCB ... 3A2000000/

Man beats machine at Go in human victory over AI
https://www.ft.com/content/175e5314-a7f ... 3219f433a1

lightvector had added some hand-made learning positions to solve this problem.
https://discord.com/channels/4170221623 ... 3069845536
A sample of added position.
https://katagotraining.org/sgfplayer/tr ... /34889642/

Game-AI Forum

beating KataGo by Adversarial attack

beating KataGo by Adversarial attack

Re: beating KataGo by Adversarial attack

Re: beating KataGo by Adversarial attack

Re: beating KataGo by Adversarial attack

Re: beating KataGo by Adversarial attack