It’s like reading my mind.

It’s magic.

We’re innovating

at a scale like never before.

It takes what you prompt it with

and just runs with it.

Everything is linked.

Everything is easy to use.

We’re accelerating how fast we can deliver

solutions to our fans, to our business.

It takes the hands-on time

that the provider has to spend

with the computer

and puts that time back with the patient.

It allows for the patient and doctor

to be a patient and a doctor

like it used to be.

It’s fundamentally

about amplifying what every person is able to do.

every person is able to do.

This opens up the opportunity

for that farmer,

for that girl in the village

who’s trying to go to college

to find out what more

can they do with their life.

Good morning.

Good morning.

It’s fantastic to see you all.

Welcome to Build, all of those

who made it here.

You know, it’s

fantastic to be back together

physically and everyone joining online.

You know, these developer conferences are special

times, special places to be,

especially when platform shifts are in the air.

I distinctly remember my first PDC in 1991,

driving up 101 into Moscone Center,

and my life changed after that

developer conference.

So it’s exciting to be able

to come back to Build 2023 with that same sense

of anticipation of something big that is shifting

around us as developers.

To just sort of put this in perspective,

in fact, last summer I was reading

Mitchell Waldrop’s Dream Machine

while I was playing with DV3, as GPT-4

was called then, Da Vinci 3

and it just brought to -

it brought in perspective what this is all about.

I think that that concept of “Dream Machine”

perhaps best communicates

what we have really been doing

over the last 70 years, right?

All the ways,

starting with

what Vannevar Bush wrote in his most

seminal paper

As We May Think,

where he had all these concepts

like associative memory,

or what Licklider was the first one

who even conceptualized

the human computer symbiosis,

The Mother of All Demos

that came in ‘68 to the Xerox Alto,

and then, of course, the PDC that I attended,

which was the PC server one in ‘91,

‘93 is when we had the mosaic moment,

then there was iPhone and the cloud,

and all of these would be one continuous journey.

And then, in fact, the other thing I always loved

is Jobs’s

description of computers

as bicycles for the mind.

It’s sort of a beautiful metaphor.

I think it captures

the essence of what computing is.

But then last November,

we got an upgrade, right?

We went from the bicycle to the steam engine.

With the launch of ChatGPT,

it was like the mosaic moment for this generation

of the AI platform.

And now we look forward to, as developers,

what we can do going forward.

And so it’s an exciting time.

And in fact, every layer of the software stack

is going to be changed forever.

And no better place to start

than the actual developer stack, right?

We, as developers,

how do we build is fundamentally changing.

In fact, when I think about how we build,

I think about first Codespaces, right?

Being able to set up that environment in,

you know, in seconds was versus minutes.

Dev Box, you know,

instead of waiting for a day

for your managed

dev box to be set up,

you have it in less than an hour.

If you think about Copilot, what it does to you,

and Copilot X,

in terms of driving the overall flow

and productivity, which is, what, 54% or so up.

And then of course GitHub Actions

and Azure Deployment Environments,

really making that possible for you to stay.

In fact, one of the things that I keep on

bugging Scott Guthrie for years is,

“Hey, I want to stay in VS code,

I want to stay in command line

and let me do everything there.”

We are close, close to that dream.

And that to me is bringing back

both the joy of programming

and the flow of programming.

That ability to be able to stay on

task, it’s just so wonderful to see.

So how we build software is radically different,

but what we are going to build as developers

is really the story of this developer conference.

And what we build -

we’ve been, you know,

it’s not like I came in on January 1st and said,

“Let’s start doing press releases.”

But it does feel like that.

It does feel like every week

there is something new and,

you know, we’re infusing

this new AI stack across all layers of it, right?

So we started with tooling in GitHub -

or rather, Copilot in GitHub.

We did Copilot in Power Platform.

And when it comes to productivity,

Copilot in Microsoft 365,

Copilot in Viva.

With business process, it’s

the copilot in Dynamics 365.

And when it comes to industry sort of workflows,

what Nuance has done with DAX

or the Security Copilot.

Or the copilot,

of course, for the web in Bing and Edge,

features in LinkedIn, which are driven by AI,

and of course the AI infrastructure

with Azure OpenAI APIs

and everything else around it, right?

So every layer of the stack

is profoundly changing.

And we today are going to -

as part of this developer conference,

we’re going to have 50+ more announcements,

but I want to highlight five of them.

The first is we are bringing

search grounding in Bing to ChatGPT.

We are very excited about this.

Yeah, you can clap!

Look, ChatGPT is the most fast-growing

consumer app we’ve ever seen

and such grounding is a very key feature, right?

So that all the information is current

and grounded by what you have

from the crawl and the index.

And so it’s fantastic to see

that we are excited to be able -

it’s going to launch in ChatGPT+

immediately and quickly coming

even to the free tier.

And this is just the start of what we plan to do

with our partners in OpenAI

to bring the best of Bing to the ChatGPT experience.

Next, we are bringing

the copilot to the biggest canvas of all:

Windows.

You’re going to hear a lot from Panos

tomorrow about it, but I think that this is going

to make every user a power user of Windows.

Let’s roll the video.

It’s so cool.

So we’re going to talk a lot more about Windows,

you know, tomorrow when Panos is up here.

The other thing that we’re also very excited to

launch is the Copilot stack, right?

After all, we’ve built all these copilots

with one common architectural stack.

We want to make that available

so that everyone here

can build their own copilot

for their applications.

We will have everything from the AI

infrastructure to the foundation models to the

AI orchestration all the way up to your copilot

and its extensibility.

In fact, the other thing that we’re going to do

is have common

extensibility across

all of these surfaces, right?

Whether it is ChatGPT,

Bing Chat, Microsoft 365 Copilot,

or all of the Microsoft copilots,

and of course, your own copilots,

we can share the same extensibility model.

This is one of the most powerful things

for your developers -

for every developer to be able to write a plugin

and have it reach billions of users

across all of these surface areas.

So to be able to show you everything

in action

from both the plugin extensibility

to all of the copilots we announced,

let me right up on stage Yusuf Mehdi

to come show you all of this.

Yusuf, let me throw it over to you.

Hi, everybody.

We’re making fast progress on

delivering our vision of your copilot

for the web and for business.

And today, as Satya said,

we’re excited to announce

that we’re going to bring

ChatGPT and Bing together

as the default search experience

to give you higher quality answers

and more timely answers.

Let’s take a look.

Here I am in ChatGPT.

And as you can see now,

Bing is the default

and when I come in and select it,

I can now ask sort of real-time queries.

For example,

let’s ask what I should expect to hear

about Build and .NET.

And what you can see is the results

now are more up to date.

They include fresh content

and they include citations.

In fact, if you can see the links

on that page there,

you can click those

and those will take you straight

to a web page that’s sourced by Bing.

We’re also excited -

yeah, absolutely, you can clap!

We’re also excited to announce

that we’re going to bring

interoperability between ChatGPT and Bing

for plugins.

So you write them once

and they’re going to run everywhere.

So as you can see here in ChatGPT,

I’ve got Zillow and Instacart enabled,

but I want to show them to you

here in Bing Chat.

So we’ll flip over

and you can see again,

I’ve got the same plugins now

in both Bing Chat and in ChatGPT.

And what we’re going to show you now is

I’ll do a search here for

houses in Chicago.

And I can ask for a set of criteria,

I’ll learn a little bit about

the neighborhoods.

And now I can automatically call Zillow

by saying,

hey, give me three houses

in a certain price range

that meet my criteria.

And what you can see

is now I get these great options

and I’m also going to get

all of the other great things

you get with Bing, like

helpful city guides and maps and prompts.

I’m going to tell you now how

we’re going to further add value

to the plugins that you write.

They’re going to work

not just in chat and ChatGPT,

they’re going to work

across the entire Web,

courtesy of the Edge browser.

So here’s an example.

I’m on a web page

here checking out a recipe for a cake,

and now I can call Bing Chat

and ask it to tell me,

hey, give me the ingredients

from this web page.

And notice Bing can read

the context of the Web page,

understand those ingredients,

put them into chat,

and then I can say,

hey, give me a shopping list for this,

and it’ll automatically call

the Instacart plugin,

take those ingredients

right off the page,

and put them into an Instacart shopping.

And with one click,

I can get those now

delivered to my house.

This is incredible

productivity benefit for people.

Let’s show you how you’ll be

more productive at work.

Here I’m going to use

Microsoft 365 Copilot.

Now I’m in Microsoft Word

and I’m going to need some help

for drafting a legal contract.

I got a legal contract here

and I need some help with California law.

So I’m going to call three plugins

from Thomson Reuters

to edit this document.

First thing is, I’ll go into Copilot

and I’ll pull it up and I’ll say,

hey, help me understand

how to edit the limitation of liability

using the practical law plugin.

It’ll read the document,

find the paragraph, and make that change.

Next, I want to know

if this is enforceable

under California law,

so I’ll call the Westlaw plugin

that will do that analysis

and it’ll come back

and give you an analysis about it

from a legal perspective.

And finally,

since we’re making lots of changes,

I’d like to know

the summary of all of these changes.

And with Document Intelligence,

I get a simple table

that shows you all of those changes

in an easy-to-read format.

By joining the power of

Microsoft 365 Copilot in Word

with the support

of these real powerful plugins

like Thomson Reuters,

now you can draft a legal contract

in so much more powerful way.

Let me show you one more.

Here I am in Teams chat

and I’m engaging with

Microsoft 365 Copilot

to track website changes.

Copilot will just call the Atlassian plugin

to help.

Atlassian Jira specializes in project

and issue tracking.

So it’ll pull the Jira ticket

automatically with the plugin.

And now all I have to do is

assign an owner

using the Azure Active Directory

and that’s it.

It’s all done.

So with plugins

and Microsoft 365 Copilot,

you can intelligent reason across

all of your business apps

and the data stored

on the Microsoft Graph

to keep you in your flow.

Finally, as Satya shared,

we’re excited to announce the

Windows Copilot.

I think it’s going to change

how you use your PC forever.

Let me show it to you.

Here I am, in a coding project on my PC,

but I want to configure my PC

to help me be more creative

and more productive.

All I have to do now

is invoke the Windows Copilot.

I now just come down here to the taskbar.

I click on that

and now we’ll pop up the

Windows Copilot on the right.

This side pane here will be consistent

across every app that you use on your PC.

And just like with Bing Chat,

I can now ask it questions like,

how can I adjust my system

to get work done?

And not only will I get

a bunch of great suggestions,

but watch this.

I can now, with one click,

take action on those suggestions.

For example, I can put into focus mode.

I also know that as developers,

we like dark mode -

there’s a suggestion here for dark mode -

so with one click,

I’m now here on the dark side

and to really get going,

I want to get that coding playlist going.

So I’ll pull the plugin from Spotify

and say, give me a great coding playlist.

In this case, Chill Vibes will come up,

and now I’ll have it ready to go.

And finally,

there’s a suggestion here

that says, hey, to organize your PC,

let’s take advantage of snap.

So with one click,

it snaps all the windows

right in the place.

I need them so I can be super productive.

What do you think?

So as you can see,

we have an incredible array

of powerful AI-powered copilots.

We’ve got over 50 plugins

already available

for customers and thousands more coming.

I can’t wait to see

what you’re all going to build.

Thank you very much.

Thanks, Yusuf.

Thank you, Yusuf.

We have, as Yusuf said,

fantastic momentum already building.

And this is about really creating

that opportunity for developers

to reach all users across

all of these surface areas

and we are so excited

to see how you go about exploiting

that opportunity in the weeks and months to come.

Of course, when we talk about the

AI platform and the Copilot stack,

the next thing for us,

which is really exciting, is AI Studio.

This is the full lifecycle toolchain

for you to be able

to build your intelligent AI apps

and your copilots.

Everything from being able

to train your own models

to be able to then ground, whether it’s OpenAI

or any open source model, with data

that you bring.

Built-in vector Indexing in Azure Search,

built-in support

for RAG -

or retrieval augmented generation -

support, and built-in support for

prompt engineering

with prompt flow and orchestration,

and of course, built-in support

for perhaps the most important feature,

which is AI safety.

One of the things that we’ve been hard

at work is to build into the toolchain is AI safety.

We’ve been at work on AI safety

for the last five years.

We have principles,

which we have translated

into our core set of processes that we implement

across our engineering stack.

And then, of course, we have

all of the compliance and oversight.

But the real challenge

is not just to have these things

outside the engineering process,

but to build it into the everyday toolchain.

And that’s what we are doing with AI Studio.

And it starts with testing.

There is the Responsible AI dashboard

that helps you during the testing phase to ensure

that what you’re developing is safe.

We have grounding.

In fact,

the prompt flow is perhaps

one of the best features

for you to be able to ground your models.

You have provenance,

provenance for media provenance,

support for images and videos,

and watermarking for your neural voice

that’s going to be

available to all of you

as you build your applications.

And at deployment time,

that’s perhaps one of the most critical

things, is we have taken

all of the safety work

we did, for example, for the launch of Bing Chat

and really made it available

as just a set of features

for any developer to use, right?

You can take an OSS model

and use the AI Safety Service

to really make it, at the deployment time, safe.

And of course,

then you can even monitor the model

for model drift.

And that way then you can make sure

that it’s not just the one time,

but you are continuously looking to make sure

that you have safe deployment.

So we’re very, very excited about AI Studio

helping every developer out here

to be able to build AI applications,

but build them with safety first.

Let’s roll the video.

Introducing Azure AI Studio, a full life cycle tool

to build, customize, train, evaluate,

and deploy

the latest next-generation models responsibly.

With just a few clicks,

developers can ground AI models

with their structured

and unstructured data

to quickly and easily build customized, cutting edge,

conversational experiences for their customers.

Developers can take advantage

of a new model catalog that works

with the popular models organizations use,

including those from Azure OpenAI Service,

Hugging Face, and many other open source models.

With prompt flow,

developers can combine

relevant data from your organization

and create a detailed prompt to get better results.

Prompt flow works

with foundation,

internally developed or open source models,

and uses popular open source tools,

LangChain, and Semantic Kernel.

And because the AI systems

we build are designed to support our AI principles,

with Azure

AI Content Safety, we are making it easier for you

to test and evaluate your AI deployments for safety.

This is Azure AI Studio,

the trusted tools

you need to build the next generation

of AI applications.

Cool.

And of course,

all AI applications start with data.

And we are really thrilled

to be announcing Microsoft Fabric.

This is a product that we’ve been

working very, very hard on over multiple years,

and it’s finally coming together.

It’s perhaps the biggest launch of a data product

from Microsoft since the launch of SQL Server.

You know, it

really brings together compute and storage,

so it unifies compute and storage.

It unifies

all of the full analytics

stack product experiences.

It brings together governance,

so it unifies governance with analytics.

And, most interesting, it unifies

the business model,

across all the different types

of analytics workloads,

whether they’re SQL, machine learning,

whatever job you want,

you can use the same compute

infrastructure.

And this unification at the end of the day

is what I think will fuel

the next generation of AI applications.

Let’s roll the video.

Introducing Microsoft Fabric,

a unified data analytics platform,

one product,

one experience,

one architecture,

one business model.

Unified data is stored in OneLake,

a SaaS data lake for the entire organization.

Data is integrated and stored in an open format,

allowing one copy to be used to train

machine learning models,

visualize data,

and run SQL queries on the lake

and data warehouse.

A unified experience brings together all the tools

data professionals need -

pipelines for orchestrating data movement,

experiments for training machine learning models,

semantic models for defining key metrics,

and much more.

And for business users, Fabric brings together

data for collaborating

and doing ad hoc analysis in Microsoft 365.

Unified governance,

security,

and compliance is built in for all your data.

And with Copilot for Microsoft Fabric,

AI helps everyone be more productive,

whether it’s writing SQL statements,

building reports,

or setting up automations based on triggers.

All your data,

all your teams,

all in one place.

This is Microsoft Fabric.

You know what the AI

supercomputer did for the infrastructure layer?

Microsoft Fabric will do to the data

layer for this next generation

of AI applications.

Very, very exciting.

These are just the five of the 50,

so we have 45 more to discover

throughout the conference.

We’re, again,

really on a fast pace to build things

that help us

build this next generation of applications,

but build them with safety first.

Now,

one of the things

that I think we should ask ourselves

as developers is why do we build?

Why do we build technology?

You know, this relationship

between economic progress

and economic

growth and technology

has been there for a long time.

In fact, in this graph, when you see it,

it’s pretty

stunning that for most of human history,

we didn’t have much economic growth,

nor did we have much technology.

And then something happened

250 years ago, right?

Which was long in building,

by the way, from perhaps the Enlightenment

to the Scientific Revolution to the

Industrial Revolution was close to 400 years.

But then there was real progress.

You see that slope going upwards.

And then, of course, over the last

70 years, information

technology has played a role across

all of those sort of seminal moments

on the march towards that dream machine.

And of course, we now enter the age of AI

and we get to define

what that slope looks like

going forward for economic growth.

But it’s not even just economic growth

on its own, right?

We don’t build

just because we want economic growth.

We want economic growth

so that we can have human

development index growth.

We want the lifespans to go up.

We want education and prosperity

and standard of living to go up everywhere.

That’s why we build, that’s why we innovate.

That’s why technology exists.

It’s not for technology’s sake,

but it is for that broad impact.

And to me,

this all came together -

you know,

in January when I was visiting India,

I had a chance to see this demo

and it sort of had a very profound impact on me

because at some level

it motivated me to go into this next wave

with that much more rigorous ensure

that this time around, this technology

reaches everybody in the world.

There are two things that stood out for me,

right, that things that we build

can in fact make a difference

to 8 billion people,

not some small sort of group of people.

And to be able to do that

by diffusing

or diffusion that takes days and weeks,

not years and centuries,

because we want that equitable growth.

We want trust in technology.

We want to ensure that we protect

those fundamental rights that we care about

and that we do this

in such a way that we manage

our energy transition

given the finite resource we have in our planet.

That’s, at the end of the day,

what grounds us in our mission

to empower every person

and every organization

on the planet to achieve more.

And so I want to leave you with this video

of what you as developers are going to do

in the days and weeks

and months and years

to come

is going to have the most profound impact

of any technology

to 8 billion people all around the planet.

Thank you very much and have a fantastic Build.

I’m a farmer.

In our village, we have two acres of land where we grow crops.

I grow rabi and kharif crops, which include wheat,

jowar, millet, sesame, and mustard.

But here in Mewat, many villages don’t have access

to newspapers, so our access to information is limited.

There are many government schemes available to us,

but we often don’t know about them.

These are all communities living in media-dark areas,

which means that penetration of traditional media

like television and radio is very sparse.

There’s also literacy challenges,

so things like newspapers have a very low access in these areas.

In India, we have 22 constitutionally-recognized languages.

But apart from that, we have more than 100,

almost 120, languages.

Being able to provide justice

to each and every citizen in their own language,

it’s a challenge, but it’s also an opportunity.

Jugalbandi is a chat bot that we built to solve two problems.

One is this linguistic divide and the technological divide.

We collected millions of parallel sentences

for machine translation.

We collected thousands of hours of data

for speech recognition,

and then we built state-of-the-art models on top of it,

using Bhashini speech recognition models and Azure OpenAI.

So these capabilities allow us to understand language,

transcribe it, translate it,

and also synthesize it back in the form of speech.

Uncle, this is Jugalbandi.

We can write or ask about government schemes

that we want to know about

and it will give us information about it.

I am a farmer and I want to know about

the government scheme for farming.

My name is Jugalbandi.

I am an assistant that will help you to know about

your government scheme and apply for it.

The answer came both in text and audio,

with which documents and forms are required.

The Ministry of Electronics and IT in the country

has been working on this for the last five years now,

and when ChatGPT was launched,

that was really the catalyst for us

being able to bring these pieces together.

We’ve been able to categorize the diversity of India

as an innovation opportunity.

And if you’re able to do that successfully,

you’re able to do it for the world.