Mathematical Expectation and Conditional Expectation

FOR SOLVED PREVIOUS PAPERS OF ISS KINDLY CONTACT US ON OUR WHATSAPP NUMBER 9009368238

FOR SOLVED PREVIOUS PAPERS OF ISS KINDLY CONTACT US ON OUR WHATSAPP NUMBER 9009368238

---

---

Mathematical Expectation and Conditional Expectation

In probability theory, mathematical expectation (or simply expectation) and conditional expectation are fundamental concepts that help us quantify the average behavior of random variables and their relationships. These tools are essential for understanding uncertainty, making predictions, and building probabilistic models. In this blog, we’ll explore mathematical expectation and conditional expectation in detail, including their definitions, properties, and real-world applications.

---

1. What is Mathematical Expectation?

The mathematical expectation (or expected value) of a random variable is a measure of its central tendency, representing the long-run average value of the variable if the experiment is repeated many times.

Definition:

For a random variable ( X ), the expected value ( E[X] ) is defined as:

• Discrete Case:
  [
  E[X] = \sum_{x} x \cdot P(X = x)
  ]
• Continuous Case:
  [
  E[X] = \int_{-\infty}^{\infty} x \cdot f_X(x) \, dx
  ]
  Here:
• ( P(X = x) ) is the probability mass function (PMF) for discrete ( X ).
• ( f_X(x) ) is the probability density function (PDF) for continuous ( X ).

Interpretation:

• The expected value is the “center of mass” of the distribution of ( X ).
• It provides a single-number summary of the distribution, useful for decision-making and predictions.

---

2. Properties of Mathematical Expectation

1. Linearity:

• For any constants ( a ) and ( b ), and random variables ( X ) and ( Y ):
  [
  E[aX + b] = aE[X] + b
  ]
  [
  E[X + Y] = E[X] + E[Y]
  ]

1. Independence:

• If ( X ) and ( Y ) are independent, then:
  [
  E[XY] = E[X]E[Y]
  ]

1. Variance:

• The variance of ( X ) is defined in terms of expectation:
  [
  \text{Var}(X) = E\left[(X – E[X])^2\right] = E[X^2] – (E[X])^2
  ]

1. Monotonicity:

• If ( X \leq Y ) almost surely, then ( E[X] \leq E[Y] ).

---

3. What is Conditional Expectation?

The conditional expectation of a random variable ( Y ) given another random variable ( X ) is the expected value of ( Y ) when ( X ) takes a specific value. It provides a way to model the relationship between ( X ) and ( Y ).

Definition:

For random variables ( X ) and ( Y ), the conditional expectation ( E[Y \mid X = x] ) is defined as:

• Discrete Case:
  [
  E[Y \mid X = x] = \sum_{y} y \cdot P(Y = y \mid X = x)
  ]
• Continuous Case:
  [
  E[Y \mid X = x] = \int_{-\infty}^{\infty} y \cdot f_{Y \mid X}(y \mid x) \, dy
  ]
  Here:
• ( P(Y = y \mid X = x) ) is the conditional PMF of ( Y ) given ( X = x ).
• ( f_{Y \mid X}(y \mid x) ) is the conditional PDF of ( Y ) given ( X = x ).

Interpretation:

• The conditional expectation ( E[Y \mid X = x] ) is the average value of ( Y ) when ( X ) is known to be ( x ).
• It is a function of ( x ), often denoted as ( g(x) = E[Y \mid X = x] ).

---

4. Properties of Conditional Expectation

1. Law of Total Expectation:

• The expected value of ( Y ) can be computed using its conditional expectation:
  [
  E[Y] = E\left[E[Y \mid X]\right]
  ]

1. Linearity:

• For any constants ( a ) and ( b ), and random variables ( Y ) and ( Z ):
  [
  E[aY + bZ \mid X] = aE[Y \mid X] + bE[Z \mid X]
  ]

1. Independence:

• If ( Y ) and ( X ) are independent, then:
  [
  E[Y \mid X] = E[Y]
  ]

1. Tower Property:

• For nested conditioning:
  [
  E\left[E[Y \mid X, Z] \mid X\right] = E[Y \mid X]
  ]

---

5. Example: Applying Mathematical and Conditional Expectation

Let’s walk through an example to see how these concepts work in practice.

Problem:

Suppose ( X ) and ( Y ) are two random variables with the following joint PMF:

	Y = 1	Y = 2	Y = 3
X = 1	0.1	0.2	0.1
X = 2	0.2	0.1	0.3

1. Compute ( E[X] ) and ( E[Y] ).
2. Compute ( E[Y \mid X = 1] ) and ( E[Y \mid X = 2] ).

Solution:

1. Compute ( E[X] ) and ( E[Y] ):

• First, find the marginal PMFs:
  [
  P(X = 1) = 0.1 + 0.2 + 0.1 = 0.4
  ]
  [
  P(X = 2) = 0.2 + 0.1 + 0.3 = 0.6
  ]
  [
  P(Y = 1) = 0.1 + 0.2 = 0.3
  ]
  [
  P(Y = 2) = 0.2 + 0.1 = 0.3
  ]
  [
  P(Y = 3) = 0.1 + 0.3 = 0.4
  ]
• Now, compute the expectations:
  [
  E[X] = 1 \cdot 0.4 + 2 \cdot 0.6 = 1.6
  ]
  [
  E[Y] = 1 \cdot 0.3 + 2 \cdot 0.3 + 3 \cdot 0.4 = 2.1
  ]

1. Compute ( E[Y \mid X = 1] ) and ( E[Y \mid X = 2] ):

• For ( X = 1 ):
  [
  E[Y \mid X = 1] = 1 \cdot \frac{0.1}{0.4} + 2 \cdot \frac{0.2}{0.4} + 3 \cdot \frac{0.1}{0.4} = 1 \cdot 0.25 + 2 \cdot 0.5 + 3 \cdot 0.25 = 2.0
  ]
• For ( X = 2 ):
  [
  E[Y \mid X = 2] = 1 \cdot \frac{0.2}{0.6} + 2 \cdot \frac{0.1}{0.6} + 3 \cdot \frac{0.3}{0.6} = 1 \cdot 0.333 + 2 \cdot 0.167 + 3 \cdot 0.5 = 2.167
  ]

---

6. Applications of Mathematical and Conditional Expectation

These concepts are widely used in various fields to model and analyze random phenomena. Here are some examples:

a. Finance:

• Example: Calculating the expected return of an investment portfolio.
• Mathematical expectation is used to estimate average returns, while conditional expectation can model returns given market conditions.

b. Machine Learning:

• Example: Building predictive models using conditional expectation.
• Conditional expectation is used in regression models to predict outcomes based on input features.

c. Engineering:

• Example: Modeling the expected lifetime of a system.
• Mathematical expectation is used to estimate the average lifetime, while conditional expectation can model lifetime given specific conditions.

d. Medicine:

• Example: Estimating the expected effect of a treatment.
• Conditional expectation is used to model treatment outcomes based on patient characteristics.

---

7. Key Takeaways

• Mathematical expectation is the average value of a random variable, providing a measure of central tendency.
• Conditional expectation is the expected value of a random variable given the value of another variable, modeling relationships between variables.
• These concepts are essential for understanding uncertainty, making predictions, and building probabilistic models.

---

8. Why Do These Concepts Matter?

Mathematical and conditional expectation are powerful tools for:

• Quantifying uncertainty and making informed decisions.
• Modeling relationships between variables in fields like finance, machine learning, and engineering.
• Building accurate probabilistic models for real-world phenomena.

---

Conclusion

Mathematical expectation and conditional expectation are foundational concepts in probability and statistics, offering a way to quantify uncertainty and model relationships between variables. Whether you’re analyzing financial returns, building predictive models, or estimating system lifetimes, these tools provide the mathematical framework to understand and predict outcomes. By mastering these concepts, you’ll be well-equipped to tackle a wide range of problems in science, engineering, and beyond.

---