There are more than 100.000 commercial (excludes private, military ++) flights per day. Commercial aviation accidents are veeery rare. In other words, commercial flying is probably statisticly safer than walking down the street to buy groceries.
However, when shit goes "down", it goes down hard. I guess that's the fear people have.