Been there, bought some land and set up a homestead for awhile. There's no difference between not trying and failing. When I got out the Army I was terrified of being a civilian. Long story short I ended up spending 2 years on our farm leaving maybe a dozen times because I was afraid of not being able to properly interact with people. During those 2 years I failed everyone, My wife, my children, myself, and God. All because I let fear convince me not to try.
Galatians 1:10
Am I now trying to win the approval of people or of God? Or am I trying to please people? If I were still trying to please people, I would not be the Messiah's servant.
Fear of failure goes hand in hand with our fear of how others will perceive us. The good thing about fear is when He guides us to over come it, He is glorified.