Problems with going out alone?

My horse used to be okay with riding out alone. now he despises it. Whenever it try he trys to turn around, he wont go. I will hit him with the reins or crop and he will back up. and try to run home. Ive gone out with other people. hes not spooky at all. How can i get him to do so? im going on a trail today, not sure if i will be with people or not. how can i get him to do so? i was thinking lead him out part of the trail and then get on sometime.