I hate to say this, but if you are too apprehensive to ride and are worried all the time, maybe you do need to rethink the whole notion.
Your life is worth more than that.
I actually gave up downhill skiing for a similar reason. I had a bad crash, broke my shoulder and arm. Since then I don't have any fun as I am too apprehensive and it just takes all the fun out of it. When it's no fun. and all nerves, forget it, time to hang it up and move on to something else.
