Say there is a polarized sphere with polarization density $\vec{P} = \alpha \hat{r}$. How can I tell if the electric field outside of the sphere will also be radial? I see in many places that it is taken as obvious, but why is it?
*Edit: rephrase
Pay attention to the fact that the sphere you are considering is not uniformely polarized: only the magnitude of the polarization density is uniform, while its direction changes at each point. In particular the direction of $\vec{P}$ is radial. Therefore the system has a symmetry with respect to the center of the sphere and it is possible to say that the electric field outside the sphere has to have the same symmetry. This is why it is radial.
Note that if $\vec{P}$ is taken "really" uniform on the sphere (i.e. it has same magnitude and direction at each point on the sphere) the external electric field outside is not radial: it is a dipole field.
It's because the whole system (including the polarization density) has spherical symmetry.
Think of it this way, if I rotate the sphere by an arbitrary angle around an axis passing its origin, the sphere, and the associated polarization density $\mathbf{P}(\mathbf{x}) = \alpha \hat{\mathbf{r}}$ are both going to coincide with the non-rotated case. So the same has to be true for the electric field distribution; i.e. not only is the electric field outside the sphere radial, but so is the field inside.