Should set HSEBYP before or at the same time as HSEON.
HSERDY will remain clear until HSE is active. So perhaps you don't have a clock source coming in. What is your hardware? Verify clock with an oscilloscope.
Also note you can't disable HSI while it's being used as a clock source.