Do I have hormonal imbalance?

I bodybuild and I'm ripped. No weight problems, no drugs, great diet. However, I have male gynecomastia and this lower back fat that wont go away; sort of like female love handles and the *** of a dancer. It doesn't make sense. Nothing I do makes it go away so I'm left with 2 assumptions. 1, I'm magically turning into a woman. 2, I have a hormonal imbalance. How can I cure this?