AI, ML and DL
You have heard all three of these. People use them as if they meant the same thing. They do not — and the exam is far more interested in how they fit together than in any one definition.
1The three terms
2Which sits inside which
This is the part that is actually examined. They are not three things standing side by side — they are three circles, each inside the last.
Pick a term to light up its shell. Drag sideways to turn the stack and see how deep each one sits.
Read it outward: DL is inside ML, and ML is inside AI.
Russian dolls
The handbook calls it a funnel: there are a great many applications of AI, out of which a few come under ML, out of which very few go all the way into DL.
3ML and DL, side by side
Both learn from data. The difference is how much data, and how much help they need from the programmer.
| Machine Learning | Deep Learning | |
|---|---|---|
| Learns from | Past or historical data fed to it | Vast amounts of data |
| Features | Often pointed out by the programmer | Extracted automatically, with no input from the programmer |
| Built from | One learning algorithm | Many ML algorithms working together, as a neural network |
| Examples | Object classification, anomaly detection | Object identification, handwritten digit recognition |
Two ways to recommend a film
Machine Learning notices both are tagged “Aamir Khan” and “sports drama”, and suggests Bhaag Milkha Bhaag, which carries the same tags. Somebody had to write those tags first.
Deep Learning has no tags. It looks at the colours of the posters, the background music and the plot summaries of what you watched, works out your taste on its own, and suggests something you might love even though nothing obvious connects it.
That is automatic feature extraction: ML works from features a human wrote down, DL finds its own.
4From the board papers
▶Show the answer
Deep Learning (DL). Two clues in the question point only at DL: vast amounts of data and neural networks. Machine Learning on its own does not require either.
▶Show the answer
AI is any technique that enables a computer to mimic human intelligence. ML is a subset of AI that enables machines to improve at a task with experience, learning from the data fed to it. DL is a subset of ML that enables software to train itself with vast amounts of data, using several machine learning algorithms together.
AI is the umbrella term: DL lies inside ML, and ML lies inside AI.
5Check yourself
Which of these is the umbrella term that holds the other two?
Deep Learning is a subset of:
Which one can extract features from data automatically, without the programmer pointing them out?