Hi DSmart! We would recommend bringing these changes up to your prescribing doctor. While sexual side effects are a common occurrence with phentermine, and often go away in a couple of weeks, they're also very distressing (as you know). Your doctor can help you find a solution faster, and advise on your treatment going forward.
You may also be interested in this blog post about Phentermine for Men.
Best of luck!