Categories
Artificial Intelligence Programming

Want to learn how to make AI/ML programs? Watch Andrej Karpathy’s AI tutorial videos.

Title card for one of Andrej Karpathy’s videos: “Let’s build GPT. From Scratch. In code. Spelled out.”

I’m trying to carve out time to work my way through Andrej Karpathy’s tutorials on his Neural Networks: Zero to Hero YouTube playlist.

At the moment, it comprises seven videos that starts with an introduction to neural networks (which “only assumes basic knowledge of Python and a vague recollection of calculus from high school”)…

…and ends with an exercise where you build a basic GPT to generate random Shakespearean dialogue:

Working on my favorite Python tool — Jupyter Notebook — Karpathy walks you step by step through the process of building an AI/ML application, explaining the “whys” along the way.

There’ve been requests for a more “slowed down” version of these videos, and I might have to take up that challenge.

Who is Andrej Karpathy?

His most recent gig was being Tesla’s director of artificial intelligence, a job he had from June 2017 until he resigned in July 2022. Before that, he founded an AI group you may have heard of: OpenAI, as in the people behind ChatGPT.

Born in 1986 in Bratislava, he and his family moved to Toronto when he was 15. He has a bachelor’s in computer science and physics from the University of Toronto, a master’s from University of British Columbia, and a PhD from Stanford, where his specialty was natural language processing and computer vision.

Want to know more about Andrej Karpathy and have a long drive or need something to listen to while working out? Check out this lengthy interview (three and half hours!), even if you do it in installments…

Categories
Artificial Intelligence Editorial The Street Finds Its Own Uses For Things

We don’t need AI to make art

Categories
Artificial Intelligence What I’m Up To

Could ChatGPT do my job?

It’s been just over five weeks since the launch of ChatGPT (it happened on November 30, 2022). Since then, from casual conversations over the holidays to New York Times think pieces, people have been asking if ChatGPT could do their jobs.

Auth0 logo
Want to know how I landed my job at Auth0? I wrote about it back in 2020.

In case you’re wondering, I’m a Senior Developer Advocate at Okta for the Auth0 product. If that sounds confusing, it’s because Okta acquired Auth0 in May 2021, and while we’re one company, that company has two products named “Okta” and “Auth0”. It’s my job to show mobile developers how they can use the Auth0 product to authenticate and authorize users.

In the video above, I “had a conversation” with ChatGPT where I asked it some basic questions about OAuth2, OIDC, and Auth0, and it answered them correctly. However, when it got to questions about writing iOS and Android apps that used Auth0 for login, it got some details wrong — and in programming, it’s the details that get you. Watch the video to find out what happened!

Categories
Artificial Intelligence What I’m Up To

A scene from an upcoming video

Joey deVilla, seen in his home office, holding a small robot in his right hand. The text “Welcome, AI overloads!” appears on screens in the background.

Just for kicks, here’s a still from my upcoming video where I ask ChatGPT some questions about OAuth and building apps with Auth0.

Categories
Artificial Intelligence

AI art isn’t quite “there” yet

AI-generated picture of an illustartion of a magazine showing a tubby-yet-muscular Elon Musk holding a big gun. His gun hand appears to have 8 fingers.
Tap to view at full size.

Pictured above is an AI-generated illustration of a magazine featuring Elon Musk. Note that his gun hand has a few too many fingers — or is it Schrödinger’s trigger discipline?

Categories
Artificial Intelligence

ChatGPT passes one of my AI professor’s tests

Picture of a the boarding area of a bus terminal with this question superimposed over it: “If someone is sitting in the waiting area of a bus station, what's the likelihood that they're wearing a tuxedo?”
Photo of Dr. Janice Glasgow.
Dr. Janice Glasgow, Professor Emerita, Queen’s University, Canada.

Back when I was a computer science student at Crazy Go Nuts University, the professor teaching the AI course — Dr. Janice Glasgow — said that this question would stump just about every conversational artificial intelligence system at the time:

If someone is sitting in the waiting area of a bus station, what’s the likelihood that they’re wearing a tuxedo?

This was back when “AI” most often referred to rules-based AI, which was based on programmed sets of rules and facts. In effect, they were made of a big collection “if this, then do that” instructions. These systems generally “learn” only through their programming; expanding their knowledge typically means doing more programming.

Today, “AI” is generally used to refer to machine learning, which take a pool of data (generally, the bigger that pool, the better) and use it to “train” themselves by making predictions based on that data and adapting to feedback (often provided by humans) on those predictions. These systems generally “learn” from “experience”. Expanding their knowledge typically means providing them with more data and feedback on the predictions they make based on that data.

(If you’d like to know more about the differences between rules-based systems and machine learning, this article is a good place to start.)

Still frame from the “Sailor Moon” anime showing Tuxedo Mask.
Tuxedo Mask might make an appearance at a bus station…

For a rules-based system to be able to answer the question “How likely is a person waiting at a bus station to be wearing a tuxedo?”, it would not only have to be able to parse an English question, but it would also have to know what a bus station is, what a tuxedo is, and general rules about clothing, different levels of formality and other social rules (many of which are unwritten), and of course, how terrible bus stations are.

ChatGPT seems to be pretty good at answering “artifical general intelligence” questions, or at least pretty good at faking it. I thought I’d ask it Dr. Glasgow’s question, and this is how it replied:

It is unlikely that someone sitting in the waiting area of a bus station would be wearing a tuxedo. Tuxedos are typically worn for formal occasions such as weddings, black tie events, or proms. It is more common for people waiting at a bus station to be dressed in casual or practical clothing that is suitable for travel. That being said, it is always possible that someone might be wearing a tuxedo for any number of reasons, but it would not be a typical or expected sight in a bus station waiting area.

Damn.