I don't think that they're nearly as dangerous as people are portraying them, but you do have to recognize that even a minor accident on a bike can have potentially fatal consequences. I fucked around on a tiny Honda 50cc dirt bike up until I was 6 years old, and then didn't ride anything else until I bought my bro's 2005 Yamaha R6 when I was 26. I taught myself how to drive it, in parking lots and industrial areas. But then I took the safety course, and I was very glad I did. Any asshole can drive a bike in a straight line at 60mph, but handling a bike in a parking lot or traffic isn't something that you will learn on your own without direction. In any case, I've since added a 2011 Ducati Multistrada to my collection, and will likely pick up another one next year. I have never been in any accident, nor have either of my bikes touched the ground. I haven't done a HUGE amount of riding, however, as I don't tend to commute on either bike with any regularity. I do try to do one big, 4-10 day trip each year, and then a few weekend trips and day trips as I find time. In the 7 years I've been driving a bike, I've only put about 25,000km on them. On the other hand, I am not overly cautious in terms of speed on fun roads.
I've got a lot of friends who also ride bikes, and thankfully none have been killed. However a couple that was riding tandem while on a trip to Alaska were t-boned by a car that blew a stop sign, with both breaking their legs (one with a femur, one tib/fib). My brother laid down his Ducati 998 on a twisty, wet road on Vancouver Island because he was following a slow driver too close and locked his front when she braked unexpectedly for no reason. He was maybe going 20 mph. His foot got caught either by the road surface or a wheel, and he ended up with a spiral fracture of his tibia that required a rod from ankle to knee.
So it doesn't take much to go wrong to end up with some serious consequences. But that being said, if you are meticulous about safety and only ride when you can 100% concentrate on the road and traffic around you, personally I think riding a bike can be quite safe over the long term. But unfortunately, you can only control what you do on the road, not others. An accident in a car that would be a fender bender can easily kill you on a bike.
None of us can make the decision for you. Personally I love getting out on my bike and I doubt I'll ever sell my bikes or stop riding. On the other hand, my brother pretty much hasn't touched his 998 since his accident, it's just been sitting in the garage getting dusty.