Problem
Suppose that $Z \sim \mathcal{N} (0, 1)$. Find $\mathbb{E}[Z^{-1}]$ and $\mathbb{E}[Z^{-\frac 1 3}]$ if they exist.
My working
Consider when $Z \geq 0$. Since $f_Z(z)$ is continuous at $0$ and $f_Z(0) > 0$, then $\exists \epsilon > 0$ such that $f_Z(z) > \epsilon$ for some $0 \leq z < \epsilon$. Consequently, $f_Z(\frac 1 z) > \frac 1 {\epsilon}$ for some $\frac 1 {\epsilon} < \frac 1 z < \infty$. Now, let $x = \frac 1 z$, then $\mathrm{d}x = -\frac 1 {z^2}\mathrm{d}z$.
$\begin{aligned}[t] \implies \mathbb{E}[Z^{-1}] & = \int^{\infty}_{0} z^{-1} f_Z(z)\ \mathrm{d}z \\[1 mm] & = \int^{0}_{\infty} x f_X\left(\frac 1 x\right) (-z^2)\ \mathrm{d}x \\[1 mm] & = -\int^{0}_{\infty} x f_X\left(\frac 1 x\right) \left(\frac 1 {x^2}\right)\ \mathrm{d}x \\[1 mm] & = \int^{\infty}_{0} x^{-1} f_X\left(\frac 1 x\right)\ \mathrm{d}x \\[1 mm] & > \epsilon \int^{\infty}_{\frac 1 {\epsilon}} x^{-1}\ \mathrm{d}x \\[1 mm] & = \infty \end{aligned}$
Thus, since $\mathbb{E}[Z^{-1}]$ does not exist when $Z \geq 0$, it can be concluded that $\mathbb{E}[Z^{-1}]$ does not exist without further considering when $Z < 0$.
I have two questions here.
Is my reasoning for why $\mathbb{E}[Z^{-1}]$ does not exist mathematically sound?
Since $\mathbb{E}[Z^{-1}]$ does not exist, can I simply conclude that $\mathbb{E}[Z^{-\frac 1 3}]$ does not exist either? In fact, is this true for all negative powers of $Z$ i.e. does $\mathbb{E}[Z^c]$ not exist $\forall\ c \in \mathbb{R}^-$?