What is GPT-3?
GPT-3 stands for Generative Pre-Trained Transformer 3, and it is a new artificial intelligence that is essentially able to perform any language-based tasks. It was designed by OpenAI, which was cofounded in 2015 by Elon Musk
and has big name investors like Microsoft. Compared to its predecessor GPT-2 which was never released to the public due to moral cyber concerns, GPT-3 is a hundred times larger and it is trained on 175 billion parameters
compared to GPT-2’s 1.5 billion parameters.
So what exactly does it do and how does it do it? Well, any language based tasks entail almost complete communication and written coherency: GPT-3 can make computer code, write research articles, create movie scripts, translate languages, and maybe even have a heart-to-heart about Love Island. The “P” in GPT-3 is integral to its function as its “pre-training” involves feeding its algorithm 570 gigabytes of text
from scouring the internet as well as Wikipedia. It then predicts by weighing” words based on meaning, connotation, and its context within a sentence in order to eventually find the right word and build a proper sentence. This is an example of the genius behind AI as this process of weighing and selecting eventually allows GPT-3 to essentially learn and build a knowledge database for itself. This is a very simplified description of how GPT-3 “learns”.
Why Is This Revolutionary?
This is a total technology game changer as GPT-3 has already built its own pseudo-Instagram app and answered questions about our existence and God. It has even had another conversation with a fellow AI GPT-3
which... was weird to say the least. With its 175 billion parameters, this makes it the largest artificial neural network (ANN)
. An ANN is basically the outcome of how computer programmers have tried to replicate the human brain’s billions of neurons in an attempt to make machines learn and process information as humans do. GPT-3 could change the future of technology by creating websites, improving virtual customer service, and prescribing medicine.
Is this like the start of The Terminator?
Well apparently not, as GPT-3 wrote its own article saying so
. The second co-founder Sam Altman even mentioned that GPT-3 is merely one of the first baby steps towards complete artificial intelligence, and to not engage too intently with the hype surrounding it. There are still hurdles the algorithm has to overcome as it will produce gibberish when presented with too complex of a task, and because the “pre-training” information does not include what “right” or “wrong” entails, GPT-3 has been found to produce sexist or racist content. Still, this is leaps and bounds in the production of AI, and in the hands of innovative companies and new-wave developers, GPT-3 could change the way we communicate with technology... or the way they communicate with each other.
Join the WINS AI Community
Opinions expressed by the author are not necessarily those of WITI.
Are you interested in boosting your career, personal development, networking, and giving back? If so, WITI is the place for you! Become a WITI Member and receive exclusive access to attend our WITI members-only events, webinars, online coaching circles, find mentorship opportunities (become a mentor; find a mentor), and more!
Founded in 1989, WITI (Women in Technology International) is committed to empowering innovators, inspiring future generations and building inclusive cultures, worldwide. WITI is redefining the way women and men collaborate to drive innovation and business growth and is helping corporate partners create and foster gender inclusive cultures. A leading authority of women in technology and business, WITI has been advocating and recognizing women's contributions in the industry for more than 30 years.
The organization delivers leading edge programs and platforms for individuals and companies -- designed to empower professionals, boost competitiveness and cultivate partnerships, globally. WITIâ€™s ecosystem includes more than a million professionals, 60 networks and 300 partners, worldwide.
Inspire Future Generations.
Build Inclusive Cultures.
As Part of That Mission WITI Is Committed to
Building Your Network.
Building Your Brand.
Advancing Your Career.