From the way your question is framed, I assume that you do not intend to boot from your external HDD. As I understand, your system normally boots from the internal HDD but fails to do so when the external HDD is connected.
I think it is because of booting sequence. You must change the booting sequence so that the internal HHD comes before the USB.
