Intermittent No Crank No Start

I have a 2005 Altima S 227K miles sometimes when I go to start it all the light will turn on but it won't crank. I think it is caused by my neutral safety swtich, because when I slide the shifter with my key in the start position it will eventually fire up. Could it be loose or adjusted? Or do I need to replace the part? Other times it will make growling noisea like it can't enough juice to the starter and sollonoid. I don't know if that would be a related issue or separate. And other times it will start right up no problem. Any advice would be greatly appreciated.