Enterprise

Microsoft warns investors that its artificial-intelligence tech could go awry and hurt its reputation

Satya Nadella
Microsoft CEO Satya Nadella. Microsoft
Read in app

Analysis banner

Microsoft is spending heavily on its artificial-intelligence tech. But it wants investors to know that the tech may go awry, harming the company's reputation in the process.

Or so it warned investors in its latest quarterly report, as first spotted by Quartz's Dave Gershgorn.

"Issues in the use of AI in our offerings may result in reputational harm or liability," Microsoft wrote in the filing. 

"AI algorithms may be flawed. Datasets may be insufficient or contain biased information. Inappropriate or controversial data practices by Microsoft or others could impair the acceptance of AI solutions. ... Some AI scenarios present ethical issues," it added. You can read the full filing below. 

And the company isn't wrong.

Despite the big talk from tech companies such as Microsoft about the virtues and possibilities of AI, the truth is that the technology is not that smart yet.

Today, AI is mostly based on machine learning, in which the computer has a limited ability to infer conclusions from limited data. It must ingest many examples for it to "understand" something, and if that initial data set is biased or flawed, its output will be, too.

That's changing, of course. Intel and startups such as Habana Labs are working on chips that could help computers better perform the complicated task of inference. Inference is the foundation of learning and the ability of humans (and machines) to reason. 

But we're not there yet. And Microsoft has already had a few high-profile cases of snafus with its AI tech. In 2016, Microsoft yanked a Twitter chatbot called Tay offline within 24 hours after it began spewing racist and sexist tweets, using words taught to it by trolls. 

More recently, and more seriously, was research done by Joy Buolamwini at the MIT Media Lab, reported on a year ago by The New York Times. She found three leading facial-recognition systems — created by Microsoft, IBM, and China's Megvii — were doing a terrible job identifying nonwhite faces. Microsoft's error rate for darker-skinned women was 21%, which was still better compared with 35% for the other two.

Microsoft insists that it listened to that criticism and has improved its facial-recognition technology.

Plus, in the wake of outcry over Amazon's Rekognition facial-recognition service, Microsoft has begun calling for regulation of facial-recognition tech.

Microsoft CEO Satya Nadella told journalists last month: "Take this notion of facial recognition, right now it's just terrible. It's just absolutely a race to the bottom. It's all in the name of competition. Whoever wins a deal can do anything."

Whether that regulation comes, and what it would look like, remains to be seen.

Last summer, after the American Civil Liberties Union published a report claiming Amazon's tech misidentified a bunch of members of Congress, several members sent letters asking Amazon for information. Amazon, for its part, countered in a blog post that questioned the validity of the ACLU's tests.

In the meantime, Microsoft's facial-recognition technology, chatbots, and other AI tech is out in the world already, too.

For instance, in an official company podcast on Monday, a Microsoft exec talked about how the company is building AI for humanitarian needs. The company is using facial-recognition tech to reunite refugee children with their parents in refugee camps, said Justin Spelhaug, the general manager of technology for social impact at Microsoft.

"We're using facial recognition to really drive a positive outcome where we're able, through machine vision and image matching, to measure the symmetry of a child's face and match that to a database of potential parents," Spelhaug said. 

Microsoft also created a chatbot for the Norwegian Refugee Council to help direct refugees to humanitarian services.

Generally speaking, Microsoft is investing so heavily in AI that it was named as one of the main reasons its operating expenses increased by 23%, or $1.1 billion, for its intelligent-cloud unit in the last six months of 2018, the company said. Other reasons included investments in cloud, investment in sales teams, and the purchase of GitHub.

But, Microsoft said, AI is still risky business — after all, things can still go very wrong. 

Here's the full investor warning:

"Issues in the use of AI in our offerings may result in reputational harm or liability. We are building AI into many of our offerings and we expect this element of our business to grow. We envision a future in which AI operating in our devices, applications, and the cloud helps our customers be more productive in their work and personal lives. As with many disruptive innovations, AI presents risks and challenges that could affect its adoption, and therefore our business.

"AI algorithms may be flawed. Datasets may be insufficient or contain biased information. Inappropriate or controversial data practices by Microsoft or others could impair the acceptance of AI solutions. These deficiencies could undermine the decisions, predictions, or analysis AI applications produce, subjecting us to competitive harm, legal liability, and brand or reputational harm.

"Some AI scenarios present ethical issues. If we enable or offer AI solutions that are controversial because of their impact on human rights, privacy, employment, or other social issues, we may experience brand or reputational harm."

Read next

Julie Bort was Business Insider's Editor at Large for the Tech team. She loves investigating stories and shedding light on the tech industry's most amazing people.Here's a small sample of some of Julie's work.Former Pinterest employees describe a traumatic workplace where managers humiliate employees until they cry, Black people feel alienated, and the toxic culture 'eats away at your soul'Sex, tequila, and a tiger: Employees inside Adam Neumann's WeWork talk about the nonstop party to attain a $100 billion dream and the messy reality that tanked itInsiders say WeWork's IT is a patchwork of cheap devices and Band-Aid fixes that will take millions to fixWeWork's toxic phone booths were created in-house by its Powered by We business70-hour weeks and 'WTF' emails: 42 employees reveal the frenzy of working at Tesla under the 'cult' of Elon MuskElon Musk works so many hours at Tesla, employees are constantly finding him asleep under tables and desksHow this woman went from a Pizza Hut employee to a founder of a $4 billion startupAn Oracle insider explains how some salespeople gamed the system to sell more cloudTHE TAKEDOWN OF TRAVIS KALANICK: The untold story of Uber's infighting, backstabbing, and multimillion-dollar exit packagesMicrosoft is in talks to buy GitHub, a startup at the center of the software world last valued at $2 billionThe alarming inside story of a failed Google acquisition, and an employee who was hospitalizedInside Facebook's plan to eat another $350 billion IT marketHow a registered sex offender wound up living in an Airbnb hosting unsuspecting guestsA controversial ex-banker is the person who really runs Twitter — and he's gambling the company's future on one risky betSecret passages and skipped meals: Oracle's CEO gave us a rare peek at what it really takes to run a $37 billion companyHP told some employees to choose between becoming contractors with no benefits or being fired without severance'I felt like we were being extorted': Customer says Oracle tried to strong-arm him into a cloud saleHow the queen of Silicon Valley is helping Google go after Amazon's most profitable businessAirbnb host: A guest is squatting in my condo and I can't get him to leaveLIES, BOOZE, AND BILLIONS: How one of the fastest-growing startups in Silicon Valley history raised $580 million then spiraled out of controlGitHub is undergoing a full-blown overhaul as execs and employees depart — and we have the full inside storyWhen she's not writing for Business Insider, Julie can usually be found on the trails, on my mountain bike, or on my skis, if you know where to look.