Baryon decay can be avoided if you build something out of stable non-baryonic matter. Given our currently known particles that leaves electrons/positrons, and neutrinos.
Stable electron clouds are tricky to do, since they need a gravitational potential that balances their electromagnetic repulsion. Since electromagnetism is much stronger than gravity, this is not doable with electrons. Coulomb repulsion dominates gravitational attraction for any pair of electrons.
However, neutrino stars have been suggested in atrophysics as possible compact objects (back when neutrinos were thought to be heavy) or explaining part of dark matter potentials (now when neutrinos are seen as light). Basically, being fermions cold neutrinos could form spherical condensates kept together by gravity that could be stable. They are not very likely to form according to current theory and observation but are certainly allowed by known physics.
The limit to neutrino star survival is likely set by quantum gravity decay: ocasionally small pieces tunnel into a black hole state that decays into photons that escape. Over very long timescales (I got a number around $10^{555}$ years, but my math is shaky) they would evaporate. Assuming this scenario actually happens.