Your supply has some overshoot. This isn't an issue with bypassing (although it has some influence), rather, it's an issue with the control loop.
Without knowing what kind of converter it is (current mode, voltage mode, COT, etc.) it’s hard to give a precise, prescriptive answer to your issue. Generally, you will need to modify your feedback network. There's different types depending on the regulator in use.
If you have access to Spice or similar, this would be a good time to use this tool to experiment with the feedback. Here’s a slide deck that introduces some concepts: https://www.onsemi.com/pub/Collateral/TND349-D.PDF (full disclosure: author is here on EE-SE as Verbal Kint.)