Skip to content
Gallery
J-WEL AI Knowledgebase
J-WEL AI Knowledgebase
Share
Explore
Artificial Intelligence (AI) Learning Resources from MIT

How Generative AI Models such as ChatGPT Work?

artificial-intelligence
Understanding how generative AI models like ChatGPT work is crucial for helping users make informed decisions about the ethical and responsible use of these new technologies and recognizing their potential biases and limitations. Understanding how the tools work, empowers individuals to leverage these tools effectively in various fields, from enhancing productivity to fostering creativity. A deeper comprehension of generative AI fosters critical thinking and innovation, enabling people to contribute to the development and improvement of these technologies.
Generative AI models like ChatGPT work by using advanced machine learning techniques to generate new content based on the data they were trained on. These models are trained on vast amounts of text data, learning patterns, structures, and nuances of human language. When given a prompt, they generate responses by predicting the next word in a sequence, considering the context provided by previous words. This allows them to produce coherent and contextually relevant text, enabling applications like conversational agents, content creation, and more.

⁠

Getting Started Resource Suggestion cont

⁠

⁠
⁠
⁠

AI Basics and Why You Should Care

Jameel World Education Lab
This presentation from the Jameel World Education Lab at MIT provides an in-depth exploration of artificial intelligence (AI), focusing on large language models (LLMs) like ChatGPT. It explains how these transformer-based neural networks function, their similarities and differences compared to the human brain, their current capabilities (2024) and their various applications.
In this video, we aim to break down complex concepts around AI, particularly focusing on large language models (LLMs). This presentation provides an overview of their development, capabilities, and some of their limitations, such as the challenge of hallucinations. This would be valuable to get a better understanding of the current generation of models (such as ChatGPT) work, understanding how “intelligent” they are right now, and why it's so important in today's world.
Important Highlights:
Minutes 6-34: An overview of how LLM’s actually work.
Minutes 50-61: An important discussion about how/if LLM’s “understand” and what’s behind “predicting the next word.”
Minutes 61-66: An overview of how intelligent the (2024) models are in various tests and situations.
LINKS:
Video Presentation Link:
https://cdn.jwplayer.com/players/ImsxhPuS-RjWacw6B.html
⁠
⁠
Slides PDF Link:
https://jconnector.mit.edu/media_center/file/118dc2b7-063c-4728-84b5-db5eecba84f5
⁠
⁠
⁠
aWg2Kb6t-720.jpg
AI Basics and Why You Should Care Thumbnail
⁠
⁠
⁠

⁠
⁠
⁠

“Large language models can do jaw-dropping things. But nobody knows exactly why.”

MIT Technology Review
An important article to help you understand what we actually know (a don’t) about how the current generation of AI works.
⁠
https://www.technologyreview.com/2024/03/04/1089403/large-language-models-amazing-but-nobody-knows-why/
⁠
⁠
Written by: Will Douglas, March 4, 2024
quote
“We’re a very infant science,” he says. “The questions that I’m most excited about this month might be different to the questions that I’m most excited about next month. We are still discovering things. We very much need to experiment and get surprised.” - Boaz Barak, Harvard University

Want to print your doc?
This is not the way.
Try clicking the ⋯ next to your doc name or using a keyboard shortcut (
CtrlP
) instead.