Tokyo-Mt.Fuji-Kyoto-Tokyo

Greetings,

I am planning to travel into Tokyo NRT (2 adults +1 infant) on 30th September with following plan:
Stay in Tokyo : 2 days
Visit Mt. Fuji: 1/2 day
Stay in Kyoto: 1 day
Return to Tokyo and stay: 2 days
Would it be feasible for me to get the JR pass for 7 days for 2 adults. I would like to go to Mt. Fuji (general area, not necessarily to 5th station - just want great views/ photograph opportunities) in the morning and then proceed onwards to Kyoto directly via bullet train and spend one night in Kyoto. Return to Tokyo next day.

Please advise most convenient (least number of stops as I have an accompanying infant) route using the JR pass.

Many thanks!
Taha