I was going to use superglue, not sure how it'd handle the heat though and I'd be afraid of it getting in the jack. Two way tape seems to be a plausible solution (I've used it in automotive applications before) since it looks like that's what's on it now.
Everytime I google how to do this, it mentions soldering, but since my jack is not on my motherboard, probably not relevant to my application.
Here are the two items that need to be tied down.