I find the same and just put it down to natures way of stopping you/us doing something stupid ?
As the 'feeling' returns you regain the skill/ courage or judgement to do more . I think this is why somelike Cookee can do 100mph without too much stress , where as I have really really focus at anything above 40 as I dont do it very often at all !
I feel it most over the winter when I may not drive about for weeks at a time ..
Good news is the courage did/does return