Teams doesn't have a setting to use the default audio devices set in Windows. It just remembers its own (rather buried) device settings, and if those devices aren't present, decides on its own what devices you'll use. (And you'll like it, mister.)
I move between workstations with different audio setups. Sometimes I change my default audio device while at one workstation - maybe I want to use my headset, maybe the laptop speakers are good enough. Teams ignores me and does what it wants.
Zoom and other conferencing apps have an option to use whatever the default audio devices set in Windows for meetings. How can we force Teams to do the same?
(If it were quick and easy to change the audio devices like in Zoom, this wouldn't be as much of a problem.)
Update (2023-08-04): The reason for this behaviour appears to be Teams protecting you from attempting to use a device that doesn't exist. Teams seems to read the list of audio device drivers that are present and functioning. Computer 2 is missing the headphones of computer 1, so the driver is unavailable to Teams. Teams now looks at the order of present and functioning drivers to determine which device to use when a new meeting is started. Removing a driver is easy. It's not clear how we can influence the order of availability of drivers to the system. The web version of teams just asks Windows to use its default devices - a very different and saner approach.