As Poutnik explains, phosphorus is not more electronegative than hydrogen, but "electronegativity" is not the real criterion for rendering an attached hydrogen atom acidic.
Electronegativity is essentially a combination of electron affinity with ionization energy, whereas making an attached hydrogen acidic is instead a combination of electron affinity minus bond strength between the element and hydrogen (if the bond with hydrogen is weak, the hydrogen may be dissociated as a proton even if the attached atom has low electron affinity, as is the case with iodine).
The net result is that the acidity of an attached hydrogen atom correlates with the group the atom attached to the hydrogen is in: Group 16 and 17 elements, whose electron configurations are just short of a noble gas, have relatively high electron affinities compared with their bond strengths to hydrogen, and it is these elements that then tend to acidic hydrogen atoms in water solvent.
So hydrogen attached to sulfur, let us say, is likely to be acidic in water solution, whereas hydrogen attached to nitrogen is not given the different group/electron configuration associated with nitrogen.