Nice report there. There is quite a few people who have came from sports bike type back rounds and they mostly all like the easy get up and go but still want the speed.
As for can it handle, well ive an R and both pegs have been down, 1 pannier, and also nearly no toe sliders left, and the X is suppose to handle better.
Yes at some points the bike might feel under powered but if you short shift thats where you get the best acceleration. Had a ride out today with some spirited riding and i let a marshal past on a new gsxr600 and he give it the beans and i stuck with him and here near pasted out when he looked in his mirrors to see me flying fully behind him.