I did exactly that flight combination last week (and also a few months ago), QF1 and BA578 to Venice, in economy, and had plenty of time for a shower and breakfast in the BA lounge after transferring terminals.
The terminal transfer bus is quick and easy, and free, so you don't go through...