have somebody else ride your bike and see how they feel.
it could be so many things... even loose spokes could cause alot of imbalance...