Use the divergence theorem to evaluate $$\iint_S\vec{F}$$ where $\vec F(x,y,z)=\langle xy^2,x^2y,y \rangle$ and $\vec S$ is the surface oriented outwards of the cylinder $x^2+y^2\leq 3$ bounded above by the plane $z+x=0$ and below by $z=0.$
My solution goes like this:
In order to use, divergence theorem, we must first evaluate $\operatorname{div}(\vec F).$
We note that, $\operatorname{div}(\vec F)=x^2+y^2.$
Now, if $E$ is the solid region corresponding to which $\vec S$ is the boundary then, by divergence theorem we have, $\iint_S\vec{F}=\iiint_{E}\operatorname{div}(\vec F)\, \mathrm{d}V=I.$
We note that, $I=\iint_{D}\int_0^{-x}x^2+y^2\, \mathrm{d}z\, \mathrm{d}A,$ where $D$ is the disk of radius $\sqrt 3$ in the $xy$ plane.
So, $I=\iint_D-x(x^2+y^2)\, \mathrm{d}A=\iint_D-x^3-xy^2\, \mathrm{d}A.$
Converting to polar coordinates, we have, $I=-\int_0^{2\pi}\int_0^{\sqrt 3}r^4\cos^3 t +r^4\sin^2t\cos t\, \mathrm{d}r\, \mathrm{d}t.$
So, $$\begin{align*} I&=-\int_0^{2\pi}\int_0^{\sqrt 3}r^4\cos t(\cos^2 t+\sin ^2 t)\, \mathrm{d}r\, \mathrm{d}t \\ &=-\int_0^{2\pi}\int_0^{\sqrt 3}r^4\cos t\, \mathrm{d}t \\ &=-\frac{9\sqrt 3}{5}\int_0^{2\pi}\cos t\, \mathrm{d}t \\ &=-\frac{9\sqrt 3}{5}[\sin t] \bigg|^{2\pi}_0 \\ &=0 \end{align*}$$
However, I think my solution is wrong. This is because the answer given is $\frac{18\sqrt 3}{5}.$ I checked my calculations over and over again but was unable to find my mistake. There are two possibilities, either my answer is incorrect or the given answer. Any help regarding this will be greatly appreciated.