1
$\begingroup$

Imagine two events $A$ and $B$ that are not mutually exclusive, such that $P(A) = 0.3$ and $P(B)=0.4.$ Consider the Venn diagram of the two overlapping sets, and visualize moving them closer together or further apart, thus varying the size of the overlapping region $A \cap B$. It should be $\color{darkorange}{\text{clear}}$ that $P(A \cap B)$ could take on any value between $0$ and $0.3$, but of that infinite set of possible values, the only one that would make $A$ and $B$ independent would be $P(A \cap B) = 0.12.$

After reading this answer (excerpted above), I drew Venn diagrams below for $P(A \cap B) =0$ (when $A$ and $B$ are disjoint), $P(A \cap B) =0.12,$ and for $P(A \cap B) =0.3$ (when $B \subsetneq A)$.

However, it is $\color{darkorange}{\text{not clear}}$ to me that the only one that would make $A$ and $B$ independent would be $P(A \cap B) = 0.12$. I still can't intuit or visualize independence.

enter image description here

$\endgroup$
2
  • 1
    $\begingroup$ Essentially, you want $B$ to be proportionally as big in $U$ as $A\cap B$ is in $A$. In other words, since $40$ percent of $U$ belong to $B$, you also want $40$ percent of $A$ to belong to $B$. $\endgroup$
    – Zuy
    Commented Dec 30, 2021 at 8:21
  • $\begingroup$ Please be aware, that independence is a property of the given probability measure, not of the event space. $\endgroup$ Commented Jul 8 at 13:14

4 Answers 4

4
$\begingroup$

It's not feasible to represent independence. Most people think drawing Venn Diagrams that are disjoint demonstrates independence, but that is false. If two events are disjoint, they are inherently dependent. Because if I know A occurs, I know B cannot occur and vice versa.

So what about the opposite: drawing Venn Diagrams that intersect? This method isn't quite useful for visualizing independence either. For example, let A be the event Susan studies for her test and let B be the event Susan eats chocolate. The intersection in the Venn Diagram means that Susan studies for her test and she eats chocolate. Let's say these two events are independent. That doesn't mean these two events can't co-occur, i.e. intersect. They can. Likewise, let's say the events are dependent. They can still co-occur or not co-occur. So there, we have shown that we can't demonstrate independence via intersection either.

$\endgroup$
3
$\begingroup$

enter image description here

In the above universe, $a,b,c$ and $d$ denote probabilities. \begin{align}&\text{events }X \text{ and } Y \text{ are }\textbf{independent} \\\iff &P(X\cap Y)=P(X)P(Y) \\\iff &\frac{c}{a+b+c+d}=\frac{b+c}{a+b+c+d}\times\frac{c+d}{a+b+c+d} \\\iff &ac=bd.\end{align}

Imagine two events $X$ and $Y$ that are not mutually exclusive, such that $P(X) = 0.3 \,$ and $P(Y)=0.4.$ Consider their Venn diagram.

It should be clear that the only value of $P(X \cap Y)$ that makes $X$ and $Y$ independent is $P(X \cap Y) = 0.12.$

$$b=0.3-c\tag1$$$$d=0.4-c\tag2$$$$a=1-0.3-(0.4-c)=0.3+c\tag3$$

For events $X$ and $Y$ to be independent, $$ac=bd\tag4.$$

Solving $(1),(2),(3),(4)$ gives $$c=0.12,$$ as required.


Independence of events is not straightforward to intuit from Venn diagrams (unlike mutual exclusivity, which is observed by inspecting their intersection).

For example: enter image description here

$$\begin{array}{r} \begin{array}{c|c|c} \style{font-family:inherit}{} & \style{font-family:inherit}{U_1} & \style{font-family:inherit}{U_2} & \style{font-family:inherit}{U_3} \\\hline P(X\cap Y) & 0 & \frac14 & \frac14 \\\hline P(X)P(Y) & \frac14\times\frac12=\frac18 & \frac14\times\frac34=\frac38 & \frac12\times\frac12=\frac14 \\\hline \text{$\therefore X$ and $Y$ are$\ldots$} & \textbf{dependent} & \textbf{dependent} & \textbf{independent} \end{array}\hskip-5.5pt \end{array}$$ [Universe $U_1$ above is also an example of the fact that for events with nonzero probabilities, $\big(\text{mutual exclusivity}\implies\text{dependence}\big)$.]

For these multiple-event examples, note that $\big(\,\text{(i) and (ii)}\;\iff\text{(iii)}\,\big)$: enter image description here

$$\begin{array}{r} \begin{array}{c|c|c|c} \style{font-family:inherit}{} & \style{font-family:inherit}{U_4} & \style{font-family:inherit}{U_5} & \style{font-family:inherit}{U_6} & \style{font-family:inherit}{U_7} \\\hline \text{(i) } \mathbf{P(X\cap Y\cap Z)=P(X)P(Y)P(Z)} & \text{no} & \text{no} & \text{yes} & \text{yes} \\\hline \text{(ii) } \text{$X,Y,Z$ are }\textbf{pairwise independent} & \text{yes} & \text{yes} & \text{no} & \text{yes} \\\hline \text{(iii) } \text{$X,Y,Z$ are }\textbf{(mutually) independent} & \text{no} & \text{no} & \text{no} & \text{yes} \end{array}\hskip-5.5pt \end{array}$$


When the probability experiment has just $2$ trials, a table like this is a good way to understand/visualise conditional probability as working in a reduced sample space: $$ \begin{array}{r} \begin{array}{c|c|c} \style{font-family:inherit}{\text{time of complaint}\bigg\\ \text{reason for complaint}} & \style{font-family:inherit}{\textbf E\text{lectrical}} & \style{font-family:inherit}{\textbf M\text{echanical}} & \style{font-family:inherit}{\textbf L\text{ooks}} \\\hline \style{font-family:inherit}{\textbf D\text{uring guarantee period}} & 18\% & 13\% & 32\% \\[0pt]\hline \style{font-family:inherit}{\textbf A\text{fter guarantee period}} & 12\% & 22\% & 3\% \end{array}\hskip-5.5pt \end{array} $$ The calculation (notice that the figure ‘$32$’ was obtained from the intersection of column $L$ and row $D$) $$P(L|D)=\frac{P(L\cap D)}{P(D)}=\frac{32}{18+13+32}=51\%\neq32\%+3\%=P(L)$$ shows that $L$ and $D$ are dependent events.

$\endgroup$
1
0
$\begingroup$

click to see diagramThe accepted answer by @Stats Data Enthusiast is certainly relevant, but I beg to differ on the question of whether it is possible to represent independence with Venn diagrams. The crucial observation is to use the area of the Venn diagram to represent a product of two, linearly independent, measurable subspaces.

Let the universe of the Venn diagram be a unit square in the Cartesian plane, and let the unit intervals in the X and Y axes be probability spaces of their own. Just really skinny - lengths rather than areas. Then the unit square is the product of those two subspaces, and the area measure is the product measure.

The two events identified in the original question with probability .3 and .4 would be represented on each axis as a segment of length .3 on on the X-axis and .4 on the Y-axis. Within each respective unit interval, each event has the stated probability. Let each sub-interval begin at the origin, (0,0).

Next consider the regions formed by treating each sub-segment as the short side of a rectangle - a region within the unit square, whose long side is the adjacent unit interval on the other axis, from (0,0) to (0,1) or to (1,0) respectively. In the theory of product spaces these rectangles are called cylinders, because they have a subset on one side and a whole space as their other side. In a probability space, the whole has measure 1, so the area of a cylinder is numerically equal to the length of its short side.

Now it's easy to see that the intersection of these two rectangles (cylinders) is a smaller rectangle with area .3 * .4 = .12! So we have a perfect Venn diagram which demonstrates the independence of the two events. And meanwhile shows the relation between probabilistic independence and linear independence.

$\endgroup$
0
$\begingroup$

I can think of one way drawing it. Definition is the knowledge of event A occurring does dot affect event B probability. One way of that happening is when A=S the sampling space. But this seems useless.

May be if you think in higher dimensions not in 2d you can come up with proper diagram In 2d you represent each elementary event as points with x,y coordinates you need to have something where two events use different coordinate spaces. Let's say 4d sample space with dimensions (xa,ya,xb,yb) you draw A in first 2 dimensions and B in second 2 dimension. What would be xb yb coordinates of elementary events inside event A? Not sure about notation but I would say they should fill the whole xb,yb as if you drawn shape in one surface and extruded/repeated/filled it along xb yb. (xa,ya,Sxb,Syb)

Looking into it this way if you try to bring concept back to 2d then you differentiate each event along 1 dimension and fill the space along other dimension. A will be a row across S sample space abd B will be a column

$\endgroup$

You must log in to answer this question.