Distribution Functions

FOR SOLVED PREVIOUS PAPERS OF ISS KINDLY CONTACT US ON OUR WHATSAPP NUMBER 9009368238

FOR SOLVED PREVIOUS PAPERS OF ISS KINDLY CONTACT US ON OUR WHATSAPP NUMBER 9009368238

---

Distribution Functions

Distribution functions are fundamental tools in probability and statistics, providing a complete description of the behavior of random variables. They help us understand how probabilities are distributed across different outcomes and are essential for modeling, analysis, and inference. In this blog, we’ll explore the two main types of distribution functions—Cumulative Distribution Functions (CDFs) and Probability Mass/Density Functions (PMFs/PDFs)—and their key properties.

---

1. What Are Distribution Functions?

Distribution functions describe how the probabilities of a random variable are distributed across its possible values. They come in two main forms, depending on whether the random variable is discrete or continuous.

1. For Discrete Random Variables:

• Probability Mass Function (PMF): Gives the probability that a discrete random variable takes a specific value.
• Cumulative Distribution Function (CDF): Gives the probability that the random variable is less than or equal to a specific value.

1. For Continuous Random Variables:

• Probability Density Function (PDF): Describes the relative likelihood of the random variable taking a specific value.
• Cumulative Distribution Function (CDF): Gives the probability that the random variable is less than or equal to a specific value.

---

2. Probability Mass Function (PMF)

The PMF applies to discrete random variables and specifies the probability of each possible outcome.

Definition:

For a discrete random variable ( X ), the PMF ( P(X = x) ) is defined as:
[
P(X = x) = p(x)
]
where ( p(x) ) is the probability that ( X ) takes the value ( x ).

Properties:

1. Non-Negativity: ( p(x) \geq 0 ) for all ( x ).
2. Normalization: The sum of all probabilities is 1:
   [
   \sum_{x} p(x) = 1
   ]
3. Probability of an Event: The probability of an event ( A ) is the sum of the probabilities of the outcomes in ( A ):
   [
   P(A) = \sum_{x \in A} p(x)
   ]

Example:

Consider rolling a fair six-sided die. The PMF is:
[
P(X = x) = \frac{1}{6} \quad \text{for } x = 1, 2, 3, 4, 5, 6
]

---

3. Probability Density Function (PDF)

The PDF applies to continuous random variables and describes the relative likelihood of the variable taking a specific value.

Definition:

For a continuous random variable ( X ), the PDF ( f(x) ) is a function such that:
[
P(a \leq X \leq b) = \int_{a}^{b} f(x) \, dx
]
The PDF itself is not a probability but a density. Probabilities are calculated as areas under the PDF curve.

Properties:

1. Non-Negativity: ( f(x) \geq 0 ) for all ( x ).
2. Normalization: The total area under the PDF curve is 1:
   [
   \int_{-\infty}^{\infty} f(x) \, dx = 1
   ]
3. Probability of an Interval: The probability that ( X ) lies in an interval ( [a, b] ) is:
   [
   P(a \leq X \leq b) = \int_{a}^{b} f(x) \, dx
   ]

Example:

The PDF of a standard normal distribution is:
[
f(x) = \frac{1}{\sqrt{2\pi}} e^{-x^2/2}
]

---

4. Cumulative Distribution Function (CDF)

The CDF applies to both discrete and continuous random variables and gives the probability that the random variable is less than or equal to a specific value.

Definition:

For a random variable ( X ), the CDF ( F(x) ) is defined as:
[
F(x) = P(X \leq x)
]

Properties:

1. Monotonicity: ( F(x) ) is non-decreasing: if ( x_1 \leq x_2 ), then ( F(x_1) \leq F(x_2) ).
2. Limits:
   [
   \lim_{x \to -\infty} F(x) = 0 \quad \text{and} \quad \lim_{x \to \infty} F(x) = 1
   ]
3. Right-Continuity: ( F(x) ) is right-continuous for continuous random variables.
4. Probability of an Interval: For any ( a < b ):
   [
   P(a < X \leq b) = F(b) – F(a)
   ]

Example:

For a standard normal distribution, the CDF is:
[
F(x) = \Phi(x) = \int_{-\infty}^{x} \frac{1}{\sqrt{2\pi}} e^{-t^2/2} \, dt
]

---

5. Relationship Between PMF/PDF and CDF

• For Discrete Random Variables:
  [
  F(x) = \sum_{t \leq x} p(t)
  ]
  The CDF is the cumulative sum of the PMF.
• For Continuous Random Variables:
  [
  F(x) = \int_{-\infty}^{x} f(t) \, dt
  ]
  The CDF is the integral of the PDF.
• Inverse Relationship:
  For continuous random variables, the PDF is the derivative of the CDF:
  [
  f(x) = \frac{d}{dx} F(x)
  ]

---

6. Applications of Distribution Functions

1. Modeling Real-World Phenomena:

• PMFs for counting events (e.g., number of customers, defects).
• PDFs for measuring quantities (e.g., height, temperature).

1. Statistical Inference:

• Estimating parameters of distributions (e.g., mean, variance).
• Hypothesis testing and confidence intervals.

1. Machine Learning:

• Building probabilistic models (e.g., Naive Bayes, Gaussian processes).
• Generating synthetic data using known distributions.

1. Risk Analysis:

• Calculating probabilities of extreme events (e.g., financial crashes, natural disasters).

---

7. Key Takeaways

• PMF: Describes probabilities for discrete random variables.
• PDF: Describes probability densities for continuous random variables.
• CDF: Gives cumulative probabilities for both discrete and continuous random variables.
• Distribution functions are essential for modeling, analysis, and decision-making under uncertainty.

---

Conclusion

Distribution functions are the backbone of probability and statistics, providing a complete picture of how random variables behave. Whether you’re analyzing data, building models, or making predictions, understanding PMFs, PDFs, and CDFs is crucial. By mastering these concepts, you’ll be well-equipped to tackle a wide range of problems in science, engineering, finance, and bey