Does Machine Learning focus on discriminative AI while Deep Learning also focus on generative AI?

Question

I know that Deep Learning is subset of Machine learning

But is it correct that classical ML algorithms mainly focus on implementing Discriminative AI while DL algorithms implement both Generative AI and Discriminative AI?

Answer 1

It's not accurate to say that classical machine learning implements only discriminative AI while deep learning implements both generative and discriminative AI. Both classical machine learning and deep learning have methods for both generative and discriminative tasks. For example, the classical naive Bayes for classification and some NLP tasks and GMMs used for clustering and density estimation are typically considered as a generative model.

In the case of discrete inputs (indicator or frequency features for discrete events), naive Bayes classifiers form a generative-discriminative pair with multinomial logistic regression classifiers: each naive Bayes classifier can be considered a way of fitting a probability model that optimizes the joint likelihood ${p(C,\mathbf {x} )}$, while logistic regression fits the same probability model to optimize the conditional $p(C\mid \mathbf {x} )$.[17]... Discriminative classifiers have lower asymptotic error than generative ones; however, research by Ng and Jordan has shown that in some practical cases naive Bayes can outperform logistic regression because it reaches its asymptotic error faster.