I think you are an avid enough off-road rider, riding with hard luggage would be a matter of getting used to it. Initially it would be a liability, perhaps the number of falls (and lifting up the bike) would double as you have had on your trip. During the transition, you may be more cautious in terms of choosing the route, you may think about traveling with a buddy, strategizing how to lift up the fallen bike, and yes it would be somewhat inhibiting to your 'freedom' of movement. At the end, you probably won't think about it anymore, then you will just ride to nowheresville away from civilization with your belongings that are sufficient to make you self-sufficient no matter where you are. That's an added freedom. Then again, if you can find and are happy with a 'base' wherever you go, then riding unloaded is thrilling.