Study Notes on "Deep Learning" - Part 2: Probability Theory

This document covers many important concepts in probability theory and machine learning, including the distributions of random variables, commonly used functions, and correlation coefficients. Below is a summary of some key content: ### 1. Random Variables and Probability Distributions - **Bernoulli Distribution**: The distribution of a single binary random variable. - **Multinoulli Distribution (Categorical Distribution)**: The distribution over a single discrete random variable with \( k \) distinct states. - **Gaussian Distribution (Normal Distribution)**: \[ \mathcal{N}(x \]