It actually sounds like a bad/loose battery connection. The high current drain when you hit the starter will cause a spark and carbon up the bad connection causing no current flow.
Try loosening the battery connections, CLEAN them, and re-tighten well.