Searching for the ways to generate or get the list of CLSIDs, I found this link, that actually does it.
But it's rather incomplete in my opinion, the complete list would include CLSIDs with their associated COM Object names, as mentioned in question.
How do I get such complete CLSIDs list ?