Try "WinMerge" (it's free) to compare any 2 files. It has various options to compare 2 or more files - or even directories/folders. NB: Any search engine will find WinMerge for you.
I think you will always have to unzip the 2 files you need to compare first.
WinMerge uses 2-panes to show the contents of each file & highlights differences. It has many options to let you see just what you want. Please investigate them first.
I don't know of any program which can let you browse the contents of zip files and then compare 2 files from within each - which is what I think you'd like to do ..
Even if you can find such a program, it would still have to unzip the 2 files into a temporary area or folder first, though that would of course, save you some effort... & cleanup.