Zipeg is free. It allows you to view the file hierarchy without extracting any files. It automatically extracts all of the files in the currently viewed directory when that folder is opened, including the archive's root directory. This means that opening an archive and viewing different directories in it are expensive processes. It deletes these files when the viewed folder is changed or the archive is closed. It uses these temporary files to provide previews. It does not support creation of archives, though.
BetterZip is $20, and people seem to love it. I don't think it's that good. It seems to support Previews by just extracting the entire archive to a temporary folder, but it does have a built-in preview pane that seems to support more than Preview.app does.