This would be Piers Anthony's Split InfinityApprentice Adept series. The first three books are Split Infinity (1980), Blue Adept (1981), and Juxtaposition (1982). I've read those as a trilogy in one go, so I'm a bit hazy on what happens in which book, but I think that while most of the plot points you remember are present in the first book of Piers Anthony's, they feature more prominently in the second.
-
I remember reading it in the late 80s or early 90s.
The first book, Apprentice AdeptSplit Inifinity series, is from 1980, so that's entirely possible.
-
It was about a man who was a slave on a planet where the absurdly wealthy slave owners would have a planet-wide series of games; everything from chess to football.
The protagonist is the serf Stile, competing in these eventsgames. Games are chosen from a grid, with one contestant naming one aspect and the othertheir opponent the other. I think "chance, physical" led to a game of rock, paper, scissors
Their turn came, and they went to the grid. Stile got the letters, and was afraid the boy would go for CHANCE—and was correct. It came up 3C, Machine-Assisted CHANCE. Any CHANCE was bad; Stile had tried to mitigate it, but ultimately it remained potential disaster.
If he could steer it into one of the more complex mechanical variants, a pinball machine—for a person like him, with experience and a fine touch, one of those became a game of skill.
—Blue Adept
The planet is called Proton.
Another of the games was playing harmonica (blues harp) against a virtuoso
-
A slave would compete in a random event then move forward in the bracket. The citizens would bet on the slaves. The slave who won the last bracket would earn their freedom and enough money to fit in with the masters on the planet.
Not just serfs compete. Stile tied in the first round, because while the virtuoso had better technique, Stile had more soulCitizens and presentationaliens can compete too. During the break, Stile taught the virtuoso how to play with more soul and how to present himself betterA winning serf is indeed granted citizenship. The virtuoso then outplayed Stile, but Stile won, since if playing with him suddenly made someone better
Stile was spared the awkwardness of answering by the Game Computer's introductory announcement. "Attention all entrants. The Tourney roster is now complete: four hundred Citizens, six hundred serfs, and twenty-four aliens.
Pairing for individual matches is random each Round.
The Tourney is double-elimination; only entrants with two losses are barred from further competition. Serfs among the final sixty-four survivors will receive one year extension of tenure. Those proceeding beyond that level will receive commensurately greater rewards. The Tourney winner will be granted Proton Citizenship."
—Blue Adept
-
Only the masters were allowed to wear clothing so that slaves could be easily identified.
Serfs go naked while citizens usually do not, then he must be the better playeralthough they're allowed to.
Stile knew they were Citizens, though they were naked, because of their demeanor and the deference the clustered serfs were paying. Clothing distinguished the Citizen, but was not the basis of Citizenship; a Citizen could go naked [...]
—Split Inifinity
AnotherA large part of the plot was a parallel world called Phaze, where magic worked by singing. One could only pass from one world to the other if their counterpart in the other world was dead. There was some unbalance between the worlds, which was resolved in the end. Stile opted to remain in the magic world, where magic only was half as powerful now, which he noticed when he sang a lamp on and it only shone half as bright as he had expected.
Note: this is actually the plot of the first three books: Split Infinity, Blue Adept, and Juxtaposition. I've read them as a trilogy; I can't quite recall what exactly is in which book.