The Next Big Breakthrough in AI Will Be Around Language

September 25, 2020

The Next Big Breakthrough in AI Will Be Around Language

Most companies recognise that aggressive adoption of digital technologies is increasingly critical to being competitive. Our research shows that the top 10% of early adopters of digital technologies have grown at twice the rate of the bottom 25%, and that they are using cloud systems — not legacy systems — to enable adoption, a trend we expect to accelerate among industry leaders over the coming five years. Many laggard and middle-of-the-pack companies, by comparison, are dramatically underestimating the cloud resources they will need in order to access, power, or train a new generation of intelligent applications presaged by breakthroughs like GPT-3, a state-of-the-art natural language processing (NLP) tool.

The big breakthroughs in AI will be about language.

The 2010s produced breakthroughs in vision-enabled technologies, from accurate image searches on the web to computer vision systems for medical image analysis or for detecting defective parts in manufacturing and assembly, as we described extensively in our book and research. GPT3, developed by OpenAI, indicates that the 2020s will be about major advances in language-based AI tasks. Previous language processing models used hand-coded rules (for syntax and parsing), statistical techniques, and, increasingly over the last decade, artificial neural networks, to perform language processing. Artificial neural networks can learn from raw data, requiring far less routine data labelling or feature engineering. GPTs (generative pre-trained transformers) go much deeper, relying on a transformer — an attention mechanism that learns contextual relationships between words in a text. Researchers who were given access to GPT-3 via a private beta were able to induce it to produce short stories, songs, press releases, technical manuals, text in the style of particular writers, guitar tabs, and even computer code.

GPT-3 is far from perfect. Its numerous flaws include sometimes producing nonsense or biased responses, incorrectly answering trivial questions, and generating plausible but false content. Even one of the leaders at OpenAI cautioned against over-hyping GPT-3. All of this suggests that much work remains to be done, but the writing, so to speak, is on the wall: a new stage of AI is upon us.

GPT-3 is only one of many advanced transformers now emerging. Microsoft, Google, Alibaba, and Facebook are all working on their own versions. These tools are trained in the cloud and are accessible only through a cloud application programming interface (API). Companies that want to harness the power of next generation AI will shift their compute workloads from legacy to cloud-AI services like GPT-3.

Next-gen apps will enable innovation across the enterprise.

These cloud-AI services will enable the development of a new class of enterprise apps that are more creative (or “generative” — the “G” in GPT) than anything we’ve seen before. They will make the process of synthesising words, intentions, and information in language cheaper, which will make many business activities more efficient and stimulate the innovation and growth we see with early adopters.

Our analysis of more than 50 business-relevant proofs of concept (demos) of GPT-3 indicates that tomorrow’s leading-edge business apps will fall into at least three broad creative categories, all linked to language understanding: writing, coding, and discipline-specific reasoning.

GPT-3’s ability to write meaningful text based on a few simple prompts, or even a single sentence, can be uncanny. For instance, one of GPT-3’s private beta testers used it to produce a convincing blog on the subject of bitcoin. Among the demos we analysed, there were apps for developing new podcasts, generating email and ad campaigns, suggesting how to run board meetings, and intelligently answering questions that would befuddle earlier language systems.

Based on prompts from humans, GPT-3 can also code — writing instructions for computers or systems. It can even convert natural language to programming language. In a natural language (English, Spanish, German, etc.), you describe what you want the code to do — such as develop an internal or customer-facing website. GPT then writes the program.

The ability to think about content, procedures, and knowledge in a scientific or technical field suggests other potentially fertile applications of GPT-3. It can answer chemistry questions — in one demo, it correctly predicted five of six chemical combustion reactions. It can autoplot graphs based on verbal descriptions, taking much of the drudgery out of tasks like creating presentations. Another beta tester created a GPT-3 bot that enables people with no accounting skills to generate financial statements. Another application can answer a deliberately difficult medical question and discuss underlying biological mechanisms. The app was given a description of a 10-year-old boy’s set of respiratory symptoms and was informed that he was diagnosed with an obstructive disease and given medication. Then it was asked what protein receptor the medication was likely to act on. The program correctly identified the receptor and explained that the boy had asthma and that it is typically treated with bronchodilators that act on that receptor.

This general reasoning potential across writing, coding, and science suggests that the use of cloud-powered transformers could become a meta-discipline, applicable across management sciences, data sciences, and physical and life sciences. Further, across non-technical jobs, cloud in combination with GPT3 will lower the barrier for scaling digital innovations. Non-technical staff will be able to use every day natural language rather than programming languages to build apps and solutions for customers.

Reimagined jobs will increase productivity.

In light of these coming changes, companies will not only need to rethink IT resources, but also human resources. They can begin by analysing the bundles of tasks in current roles, uncovering specific tasks that the AI can augment, and unleashing technical and non-technical workers alike to innovate faster. Using the Occupational Information Network (O*NET), based on a U.S. government standard used to classify workers into occupational categories, we analysed 73 job categories in 16 career clusters, and found that all clusters would be impacted by GPT-3. Digging into job categories, we found that 51 can be augmented or complemented by GPT-3 in at least one task, and 30 can use GPT-3 to complement two or more tasks.

Some tasks can be automated, but our analysis shows the larger opportunity will be around augmenting and amplifying human productivity and ingenuity. For example, communications professionals will see the majority of their work tasks involving routine text generation automated, while more critical communications like ad copy and social media messages will be augmented by GPT-3’s ability to help develop lines of thought. Company scientists might use GPT-3 to generate graphs that inform colleagues about the product development pipeline. Meanwhile, to augment basic research and experimentation, they could consult GPT-3 to distill the findings from a specific set of scientific papers. The possibilities across disciplines and industries are limited only by the imagination of your people.

Don’t get left behind.

The time to prepare is now. The next generation of enterprise apps won’t run on legacy systems, and companies will need to move to the cloud more aggressively than they are now. Wait-and-see won’t do. On October 1, OpenAI will launch GPT-as-a-service, making the API available to beta users. Leaders will be adopting and adapting GPT-3 within months, learning where it works best or where it doesn’t work at all. They will get a head start on redesigning jobs and on the issues of privacy, security, and social responsibility that surround all AI. And over the next two years, you can expect to see them putting all sorts of apps into production, finding opportunities for innovation that will put laggards even further behind.

 


 

CLICK HERE - to speak with consultant about adopting cloud based technologies for your business.

This article was originally written by H. James Wilson and Paul R. Daugherty. James, is global managing director of information technology and business research at Accenture Research. He is a coauthor, with Paul Daugherty, of Human + Machine: Reimagining Work in the Age of AI. Paul, is Accenture’s group chief executive – Technology and chief technology officer. Paul and James coauthored the book, Human + Machine: Reimagining Work in the Age of AI. Full credit goes to HBR, who published this article earlier this year. This article has been reprinted for the purpose of education.

The authors wish to recognise the contributions of the research team at Accenture Research, especially Thijs Deblaere, Surya Mukherjee, and Prashant Shukla

If you enjoyed this article then why not sign up to our mailing list to gain access to more high-quality content and exclusive offers.





Also in Portal's Daily Dose

To Build an Inclusive Culture, Start with Inclusive Meetings
To Build an Inclusive Culture, Start with Inclusive Meetings

October 23, 2020

Chances are you’ve attended a meeting today. Was it time well spent or a soul-draining exercise in futility? Although no two meetings are the same, their collective impact on the culture of a company is significant. Meetings matter. They are the forum where people come together to discuss ideas, make decisions, and be heard. Meetings are where culture forms, grows, and takes hold.

Continue Reading

4 Tips for Effective Virtual Collaboration
4 Tips for Effective Virtual Collaboration

October 16, 2020

Team collaboration done right is a powerful force to align a group of individuals to accomplish a common goal in the most effective way possible. But even the best collaborations, filled with smart, capable, and experienced team members, can be a struggle.

Continue Reading

Leaders Need to Harness Aristotle’s 3 Types of Knowledge
Leaders Need to Harness Aristotle’s 3 Types of Knowledge

October 09, 2020

If you’re working to improve your leadership capability, what exactly should you be trying to develop? The experience of the 2020 pandemic offers a powerful lesson: A critical skill a leader must bring to the table is the ability to figure out what kind of thinking is required to address a given challenge.

Continue Reading