Video

Transcript

well as this final match is getting set

up for the day in between the last

matches we have a costume competition

and now we have a little bit of a

special treat before we get into that

lower bracket match a special treat

indeed sure and this this is something

special so get your bum in those seats I

see you you think it’s time to get

nachos it’s not sit-down because you’ve

got something very very cool for you

guys here at in the key arena and at

home you get something special every

year and this time I think they may have

outdone themselves my pleasure to

introduce it and so ladies and gentlemen

of T arena and at home dota fans around

the world it is time for a battle like

no other you’ve had five players in

these booths five versus five how about

we do one versus one like you’ve never

seen before I know I know there is

something rather exciting in store for

you and in order to get a one verse one

going we have to introduce your

contenders it is my absolute pleasure

and please raise the decibel levels

raise the roof as we introduce your

first champion

[Music]

[Applause]

[Music]

remain a duty tank I’m in the main room

or toothpaste remain a duty on the

department would be a buddy

Oh

[Applause]

they start a fight

[Applause]

the witness he would meet me on the kata

he prohibited Brita water pool and

gentlemen

take it all in bag

you’ve made every single international

it would have been a shame not to make

this one one way or another you stand on

this stage how you doing dude

amazing ah you’ve been playing in the

practice for this 1v1

oh yeah I’m totally ready that’s not

what you were saying backstage sorry

that’s not what you were saying to me my

name red you know he’s ready he is ready

guys one more time Dendi is your first

contender I need to get me one of these

but now he needs an opponent for this

1v1 who will stand the test of Dendi on

this main stage strap yourselves in

ladies and gentlemen because it’s time

to meet dendi’s opponent

[Music]

[Music]

[Music]

[Music]

[Applause]

[Music]

here we go hi I’m Greg from open AI in

San Francisco we brought a 1v1

shadowfiend bought to this year’s

international to match up against the

pros the spot isn’t like anything you’ve

ever played against we didn’t program it

to understand the world of dota we just

let it play lifetimes of 1v1 against

itself and coach it on what we thought

was good or bad and now we want to see

how it stacks up against the best

players in the world I’m Raphael I’m

we’ve open the a my name is Jim um

I’m Greg Greg hello I run open AI would

you like to play again we’d like you to

try our books all right so before you

get started just wanted to know have you

ever played against a dota bot before

are you kidding for three months I

played only against the bots I have more

in common with them in a normal build

appoint oh well maybe I tried it once

just to see what it’s like pretty much

none at all honestly have you ever

played about and does yeah it sometimes

when I just want to warm up what do you

think of them they’re pretty awful how

good you need to need to defeat the boss

you don’t have to be great could you

imagine a bot it’s actually better than

the best players no do you think you can

beat my confidence as yes then my belief

in science says no hopefully my

confidence window could you think your

game yeah ready okay let’s do this play

some dota 2 rules no bottle no neutral

no rooms and rain jobs no shrine no song

so if I get first blood it’s just over

to kill it’s just going to be signed one

one cool and good luck

[Music]

I just destroying it

dang okay we’re already in trouble let’s

assign them no I don’t think it is good

oh good lord

oh we are pretty bad [ __ ] the ham so

it’s just impossible to kill it mmm very

fired

okay he’s ignoring the ferry fires the

vadas good about it better than I could

have ever imagined like playing a

smarter version of me not being able to

kill him fire destroy oh my god he’s so

fast

No Oh seems a bit impossible oh thanks

me a couple of on yeah what you turn it

up for do you think then we can visit

hmm now I think then D which is pretty

much to it good luck then this bit like

sandy is outstanding you don’t need it

he’s got a shot no oh man it really

doesn’t make sense

sending you’ve heard about it now you’re

going to be playing against it do you

can you comprehend the idea of a bot

being better than you I don’t want to do

it please I don’t want to believe it I

hope I can beat it I’ll just leave in

game it’s just about I am joined us yet

introductions out of the way I’m joined

by two guys from open AI a 10 man team

who have been working on this we have

Greg and yeah cool now guys I’m gonna

ask you a question here and it’s very

simple you’ve been working throughout

the whole week getting some the prozium

we saw on the screen does then d have a

chance versus you’re AI there’s always a

chance ok we’ll be talking more about

how on earth this has come to be but

first I want to get this first game

underway

Jakob let’s hold on to our horses and

let’s see what you’ve got then d oh ok

yeah let’s go the rule shadowfiend 1v1

mid no bottle no runes no neutrals no

raindrops no shrines no soul ring 2

kills are at our Dendi that’s not hard

right oh it’s frizzy

against the box right

then you’re thinking about it or taking

get something good

have you ever lost a game to the bottom

normally in Doha yes of course

it happens a few times okay any advices

guys so should I buy okay sounds like

rapier okay guys let’s give him some

words of encouragement did you ever

think as a dota fan Jakob you’d be

wanting Dendi to lose oh no I’m joking

I’m joking it’s not a valid dumb joke

here we go he’s blocking the creep

[Applause]

this is a good luck whoa we’re creeps

come on

what give me dreams since always

[Applause]

okay this guy’s scary I need to bring

forth already

I never thought I would stand here and

watch you flavor so hot and not nodes in

a way never felt so too scary

one who q you see the Tao he’s carrying

he’s going anything you scared of a

pothead oh did it just take him out

it definitely does that it’s getting a

little free faster than me that’s not

good without safe

whoa take it easy

I need to do the strange creep to die

good night okay okay and another faucet

and some stuff these guys carry

oh my god how’s he doing so far pretty

well glowy the bot is also strong

defender FN go either way still just to

clarify this fort has beaten to nail the

spotted seems to melt will provide no

pressure

how about our team hasn’t either

ten zero because tears rise okay bring

up some more first 24 damage I guess I’m

losing the creeps a little bit

wait out a tank does it feel like a

player like a person nope

he please stop boozing me Stacy’s Omaha

no mana but he have mango Nikki but go

ahead and he Muhammad was ended up

basically well played well played

I guess I need more patience first to

kill

okay although I just saw song don’t

touch me

guys I think he needs some help Thank

You didi so stay in your seat sending

who I’m going to talk to these guys

these are mines behind it now you

weren’t alone we have to have Greg and

Jakob here now I believe the rest your

team are here let’s see we can find them

big shout out to them a team of 10 dev

typical working on this one alongside a

bit round of applause there they are the

guys of open AI who have just ceased and

not only to mail our tzc PN C then B as

well in a 1vs1 so let’s just talk about

it very briefly big question first Jakob

how on earth does a computer learn to

play doctor yeah so this spot is quite

unlike any what you’ve seen before so

we’ve coached it to learn just from

playing areas itself so we didn’t hard

code in any strategy we didn’t have it

learned from human experts just from the

very beginning it just keeps playing as

a copy of itself it starts from complete

randomness and then it makes very small

improvements and eventually which is the

pro level so complete randomness I’m

guessing during its learning process is

it looked kind of like I do we’re

talking like it did look bad right yeah

so it’s it’s super fascinating to watch

it watch it train

what kind of like what kind of examples

can you give me of like what encountered

on the way to be things ending yeah so

when it starts I was just completely

random so most of the games just end in

one of the shadow fiends dying to the

power necessarily the mid sour they add

power yeah they just run around the map

and then they you know they fairly

quickly figure out a better strategy and

that’s the same base so I’m sure that

one I’ve tried that one yeah so then

they spend a while just just basically

afk in the base oh maybe occasionally

they venture out they the kita crib they

push out the wave a little bit and it

helps a little bit and you know maybe

eventually they get to last hit and then

if we jump forward what like what for

the big breakthrough for them so it’s

hard to say there is a particular big

bravery this series of small

improvements oh they reach the level of

casual player

isn’t they learn to play aggressively

and then they learn to bathe and you

know what about that day you didn’t I

know it splendid you for my next game

like you say it up again be well it’s

hard for us to hear you but I do agree

that this is kind of ridiculous concept

to kind of get our heads around now

final question because I know you’re

ready for game two right yeah okay final

question and I have to ask this one is

like I have to ask because I’m not just

quite sure how this and how to

understand how to comprehend this these

are pro players these are human brain so

you just telling me this robot has

failed so many times it’s actually

better than professional dota players

it’s played for really lifetimes of

experience and it’s quit so many games

of dota

it’s explored many different strategies

learn to be learn to exploit other

people who beat and it’s just played far

more into the strategy space than any

human has so it turns out robots don’t

eat sleep and they just played dota 24

hours a day

dandy let’s see if you can do it a

second time and it’s cool

you’re going to try a different approach

this time Oh

talk us through your thought process

what are you thinking with the planner

I’m planning to push creepwave because

one is a little bit different compared

to five is five and one we want you can

push so we get a little two little three

faster compared to five and five where

you can’t really push because someone

won someone can gank you come from

behind whatsoever so it’s a little bit

different game I’m not kind of used to

it but I’m thinking over what what is

doing and I’m trying to copy what is

buried so trying to copy the ball yeah

okay if any audio wizard by the way it

maybe make it so I can hit Andy in my

ears we can have a proper conversation

and also you need to bring region

constantly because that’s just a way to

go you can bottlecrow or whatever that’s

the cheapest item you exchange hit your

same heroes and both do it really

automatically kinda I see he just

raining fought us all hesitation oh and

he’s working

[Music]

I’m getting nervous are we gang

hospitable preflop don’t glob

[Applause]

let’s see what what do if you miss it

look interesting okay open the good idea

let’s go

who go hooray

and that’s how school level two

have no money for for the PD

[Applause]

interesting no time I can make it out nd

we control okay I give up

giving up yeah I don’t think that skiing

is like breaking something already I’ve

seen this quite a lot this week okay so

would you want to do like that to our

five or you’re out there the hands are

shaking Tandy are you giving up yep he’s

too strong but need more time I guess I

played a lot of times maybe I find out

also good okay let’s just kind of talk

me through what it feels like to play

again about you I see it kind of uses as

any small hole you let him like your

place he does not hesitate so it’s

pretty cool so I’m just trying to kind

of comprehend this right so it played 24

hours of dota for like I mean what you

said lifetime so basically I mean how

many hours of those who have you played

any roughly can you think about can you

know rewind the years think about it

give me a approximation maybe a few days

here and there a few days so I’ll tell

you so this spot can actually learn from

scratch in a span of two weeks of real

time and so after an hour of training is

able to crush all the built-in BOTS and

after about these two weeks that were

kind of at the level that we’re seeing

here today body how guys let’s give a

round of both open AI have beaten the

world’s best soccer players with this

machine that that USB now they’re rid of

it and they’re just just kind of lastly

I think we kind of get the closing

thoughts in terms of what does this mean

for like you know the real world what

does this mean

you know what does training computers of

winners 1v1 and dota mean and does that

mean anything exciting it’s a great

question so what we’ve built here is a

general learning system which is still

limited in a number of ways but it’s

capable enough to be the best human pros

this is a step towards building more

general systems that can learn really

complicated messy and important

real-world tasks like being a surgeon

and the goal of opening I is a company

the company that we do we work at is to

ensure that these really powerful

systems are good and beneficial for all

of us incredible stuff I mean I have to

you I understand about 20% of it but

guys come on

doser is a fantastic game and the

gentleman and the gentleman over there

have managed to beat some of the best

with their technology I think this has

been an absolute advent of the last

words with you Dendy did you ever think

that not only would you be a at the TI

and playing against apart and losing but

also you know but did you ever think

that this kind of scenario was going to

happen you ever think a bot could

possibly be better than a player nope

not true but Henry’s running around does

it feel does it feel human or does it

feel like something out yeah it feels a

little bit like comin at the same time

it’s something else wise words so let me

tell you the next step in the project

next step in the project is v u5 so just

wait for next year’s international we’ll

put it in our diary so we’ll see how

that one’s going to go down now if you

think you can do better

we’ve got something very exciting in

store 50s FR karna on the line for the

first 50 people that beat this bot it’s

going to be the red ball and you can

find it over in far away from the key

arena jump in and see if you can do

better than this man here dude it’s been

an absolute pleasure

I’m coming she’s going back we hope to

see you guys one more time open AI dendi

at a 1v1

Thank You machined any of course thank

you open a I’m honestly really excited

for the opportunity to get my hands on

it and practice with this sort of thing

because I think one of the toughest

things about trying to learn dota is

that you don’t wind up in the same

situations a lot of the time and the

idea that you could practice a whole

bunch of times just in laning against

the bots will be really nice for

training and I mean that said this pot

is very limited and what it’s doing

there you know no bottle no raindrops

not the full expanse but it’s I still

think getting good at dota is about

learning those individual pieces and

kind of layering them together also poor

Dendi I mean it is it that was amazing

to see and the bot is staying the lane

like perfect yeah it got me to think I

think you don’t want to end too unless

you you might try to aim to break the

ball like break what it’s trying to do

do some really random stuff like I

thought about what if you take his wave

between his towers you take it between

your towers like how is it going to

react like I like what then it is is

like trying to not block you know this

type of mindset where you just have me

throw it out of whatever is learned if

it’s possible if it’s not done eh I mean

it doesn’t matter because it just knows

you’re not blocking it takes every every

piece of information that you’re

presenting it and it’s reacting

instantly so it’s I mean I heard like I

heard I can’t beat it like once but then

they like then it got better so then it

never lost again um I know it’s all no

it definitely comes from PI cap

definitely cool but I think one cool

thing I am a hater I think one cool

thing that I said was like it took an

hour to be casual bus and then it took

two weeks for it to get to this level of

buildings or beating pros and it’s like

300 hours relative to one hour so that

tells you the amount of time that

actually needs it becomes a global pro

player whereas it’s pretty easy to beat

a casual but but I mean coming a pro is

really difficult it’s spooky though it’s

just so spooky to see it like animation

cancelled well you heard this is just

the beginning right technology is

changing our world very very quickly I

know we’re all going to be out of jobs

man I’m going to get bought hos bought

panelist now watch them both coaches are

doing all so much better than the other

analysts and a hos could do and I’m just

sitting there like don’twe Donald Trump

will help us