I got some of the Ortlieb bags, and had a "pretend" load up for a trip at the weekend and a ride-out.
I basically cribbed JMo's idea of a Rack Pack (31ltr) and a 35ltr Dry Sack.
ALL my camping gear went in the Dry Sack...JUST! (ideally the next size up would be better)
(Tent, footprint, mattress, sleeping bag, pillow, cooker, 3 pans, washing-up stuff, gas cannister, oil and coffee, mug, plate, knife and fork, lantern, etc.)
And my clothing including hiking boots went in the Rack Pack easily. (4 t's, 4x underwear, sweatshirt, thermals, wash bag, towel, trousers, etc.) with room for a jacket I think.
So, I now have a fully-flexible luggage system, with those bags, the panniers and top box. I can now carry so much more!!!!!!!!!!!!!
I had a ride with it loaded up like this, and it wasn't as bad as I thought it would be. I don't think its all THAT heavy.....I put the heaviest bag on the rear seat.