Machine Learning.pdf

Machine learning and data mining involve key concepts such as unsupervised learning, supervised learning, and probabilistic modeling. Probabilistic modeling is crucial because inferences from data are uncertain, and probability theory can model this uncertainty. The goal is to overview probabilistic modeling, key concepts, and its application to classification and clustering.

A dataset D consists of instances (x, y), where x is a vector in an n-dimensional space, and y is the output. Prediction involves making assumptions about y at an unseen input x, which requires a model H that encodes these assumptions and depends on parameters θ.

Uncertainty appears in measurement, parameter, and model selection. Probability theory is used to represent this uncertainty. The modeling process involves making assumptions, learning, and inference.

Basic concepts in probability theory include the space of outcomes S, events E, and random variables. Probability represents the likelihood of an event A occurring, denoted by P(A), and is the proportion of the subspace where A is true.

Key probability concepts include:

0 ≤ P(A) ≤ 1
P(true) = 1
P(false) = 0
P(A or B) = P(A) + P(B) - P(A, B)
P(not A) = 1 - P(A)
P(A) = P(A, B) + P(A, ~B)

These concepts are essential for understanding probabilistic modeling and its applications in machine learning and data mining.