Your plansplans don't matter - the member state where you currently have normal residence does:
Also, note that a member state where you do not have normal residence can still take measures in order to reduce the validity of your driving licence in its territory further to a violation of the road rules. See case C-260/13, Refusal of a Member State to recognise, in the case of a person having driven under the influence of narcotic substances, the validity of a driving licence issued by another Member State
The thing is, the French state does not want to give me my driving licence back
They are under no obligation to do so; in fact, it's obligatory for you to exchange your driving license when you commit a traffic offense in the country where you live:
Obligatory exchange of your driving licence in another EU country
You have to exchange your driving licence if:
- Your licence is lost, stolen or damaged
- After 2 years of usual residence, if you have a driving licence
with an indefinite validity period (only if this is required by
the national authorities in the country where you live)
- You commit a traffic offence in the country where you live