In the US you are very likely qualified for an entry into a doctoral program in a different field. But it would be a long, hard, journey from there. I'm guessing it would be another six or seven years to complete it.
But here in the US a bachelors graduate can enter a doctoral program in most fields with a very general background. Having no biology at all would be an issue. You might need a few undergraduate biology courses to make a serious case, however. But you wouldn't need the equivalent of a masters.
Your physics background wouldn't do you a lot of good other than to show you are capable of learning. The research process in the two fields is, I suspect, vastly different.
Also, complicating the case, is that your prior education (undergraduate...) may not look at all like a general US education which is very broad. If your entire journey to now has been physics based it would be harder than if you had a more general background. You will also be competing with people better prepared in field.
I wonder why you would want to make such a great leap, however. But if you want it bad enough and can spend the time doing it you can probably make it work. Others in the application process will also have that question, I think.
The only way to know for sure, however, is to make application. If you are situated to do so you might want to visit an interesting department and talk with them about what you might need to get accepted. Your case is unusual.