Full contest (I)

28 Aug 2017

The results of the first round of the full contest are now available. Their were 146 entries in total.

You can watch the replays of all the games on PuntTV.

Bad punters

As with the lightning contest, we do not include entries that failed to score on our simplest test map. In total, 26 entries failed to score:

The most common problem seems to be that the protocol is not implemented correctly — resulting in some kind of exception being raised. Several entries fail to include the message size in their messages. There are various problems with managing the serialised game state. Some entries expect the server to send JSON state in the setup message matching a schema that is only defined by their clients. Another problem is relying on a particular order for fields of JSON objects that did not match the one of our testing framework. Some entries rely on writing state to the file system (explicitly disallowed by the specification). At least one entry always attempts to make illegal moves.

Results

A total of 120 teams took part in the first round. We used the same methodology as for the first round of the lightning contest, but with one fewer map (we only used one of the randomly generated maps compared with two in the first round of the lightning contest).

The maps are here:

For each of the 8 possible combinations of extensions and each of the 4 maps we assigned groups of 4 teams (each group playing 4 times in order to allow every team to play in every position). This gave rise to a total of 3840 games.

The results are as follows.

Team Points Score
DiamondPrincess 122 287576
Wile E. 120 284758
Adlersprung 119 292268
Unagi 119 284628
Popes who died violently 117 171249
cashto 115 273929
All your lambda are belong to us 113 259105
perpertuum mobile 111 287585
The Blind Hen 111 251009
udfew 111 220973
Frictionless Bananas 110 297107
TBD 110 220775
fixstars 110 208971
negainoido 110 198196
A Storm Of Minds 109 229127
hayatox 109 228053
Sampou 108 224011
Begot 107 225625
GennAI 106 221313
trup16 105 251285
jabber.ru 105 224880
CDT 105 211690
The $ound of .\ 104 183459
Olympia 102 194563
Piggybank Software 101 256638
code-o-matic 101 212059
alexf 100 187113
Love and Lies 100 145037
zeta 99 175926
HHP 97 208198
flash 97 198635
kstm.org 97 193453
O Caml, My Caml 97 190063
301 97 155498
Udon 96 127771
BargeHauler 95 169716
AIM Tech 94 217071
Lambding Snakes vs Coding Monkeys 94 171637
THIRTEEN 94 153216
punteros 93 211867
powder 92 162225
Turing Machinists 92 108871
JODY HiGHROLLERS 91 216176
NCPLUG 91 210878
SoyuzMultfilm 91 194441
FromRedmondWithLove 91 119506
SpiritRaccoons 90 131663
SKI 89 168599
Sirius Cybernetics Corporation 89 154378
Dark Integers 89 114831
?!? 88 150481
DONT TOUCH MY LAMBDAS 88 149051
RagingMushrooms 88 107867
peeingbananas 87 96911
uguu.org 86 138130
Lambada Calculus 86 101767
Eger a Marson 85 161873
cw 85 127674
Frog 83 170566
ALAMBDA 82 137211
Skobochka 81 138173
Oak 81 114415
AK 80 175089
MindSweeper 80 110732
超凶喵 80 87746
uni 79 145770
Random Hackers 76 102734
master_thesis 76 85935
Mind over Matter 75 86598
vim-team 75 71519
LILiK 74 101019
taxidriver 74 96950
DrunkAlexSh 73 57028
Creeping Lollypop 73 44017
This is an albatrocity! 72 97099
CitVeterans-Rav 72 67725
Echo 71 111773
kontur.ru 70 111075
okeydaj 70 107449
cvnm 69 77025
DNIWE :: a 68 115651
yarunee 68 70407
Enoch Root 68 65985
Bottle Kids! 67 77931
lambda-daddy 67 42303
WILD BASHKORT MAGES 66 65065
MIPT Lambda 64 72662
The Flux Ambassadors 64 57113
The Higher Order of Zeuxis 64 41849
SML/Punter 63 69689
Celestial Dire Badger 63 36423
TeamDev 63 17971
Russian Horse Cup 61 58731
λ tracéurs 61 37505
Stifinderne 61 35577
WinterMUTE 57 13607
Goto11 55 17486
TFS_is_shit 54 22268
Sir Bedevere the Wise 53 30302
The Cat is #1!! 53 20212
shinh11 52 2400
Invisible Imp 51 23584
Dis Functional 51 13663
Lambda In Closure Act 51 8467
The Church of the Least Fixed Punt 50 21409
Codermal 49 4344
called haddock’s eyes 48 9729
codingteam 48 7531
Sunspear 47 2061
Go-TEAMPLOWULTRAFORCE5Fox1 45 7492
Embedded Cloud Puntifictation 45 4738
The Pragmatic Russions 45 2742
d4o 43 19269
blueiris 42 4287
The Mikinators 42 -30543
Die Zwei Nerdigen Drei 40 2344
owl 38 2395
drop table teams; 38 234
Sideways Spider 37 2737
barvins 36 128

The median number of points is 81.5. Any team with fewer points is now eliminated.

We did not manage to download the DrunkAlexSh full submission because it was not properly shared with icfpcontest2017@gmail.com, so their entry is the same as the one used for the lightning contest. We do not know whether this failure has anything to do with their state of inebriation at the time.

A number of other submissions had similar problems, but we think we managed to resolve them all. At least one team deliberately resubmitted their lightning entry to the full contest (which we have no problem with).

post-contest