Train eligibility

Hello, I'm visiting Japan for the second time in November and I'll be exploring further north than I did on my previous trip and also using trains around the country which I didn't use last time. I have a question about whether or not the ordinary JR Pass will cover the trains below -

Shinkansen Hayabusa / Hayate

JR OU Line

Ltd Express Super Hokuto

JR Rapid Service

JR Nara Line rapid/local

Also, will I need to buy a ticket for just the Shinkansen trans, or do any of the other trains above require a ticket/seat reservation too?

Thanks,
Luke.