Stuck on Recovery Screen when trying to load TWRP

Whenever I try to boot to the recovery through the bootloader the phone just gets stuck on the screen that says "Entering Recovery..." with the HTC logo below it.
I have left the phone like this for about an hour and I still see no change so i'm not being impatient, everything else about the phone is fine.