Some components will wear faster when pulling a trailer, but the key question is "how much faster?"
Brakes
As you already pointed out, the brake pad and disk wear rate will be the most noticeable change
Tyres
Everytime your brake pad wear rate goes up you can count on tyres' wear rate going up too. Trailer has no brakes, so all braking forces will go through your brakes and tyre-to-surface contact. Expect to wear through tyres quicker (especially rear)
Drivetrain
Depending on how you ride when you pull the trailer, you may be putting more or less strain on ouryour drivetrain and it could increase the wear rate
Frame
I would not expect any considerable increase in wear / fatigue to a steel frame as long as trailer hitch is well designed and properly attached.
Wheel and bb bearings
Pulling a trailer should not increase wear of bearings by noticeable amount