We hear about people being injured or killed, or property being damaged or destroyed, by flash floods all the time. Or by straight line winds. Or by hail. Or by tornadoes. Why not lightning?
Annually, about 51 people die from lightning strikes per year in the United States. Part of the reason is the low probability of being hit by lightning. Tornadoes, hail, and straight line winds sweep large areas, while one lightning bolt covers a rather small area, and may even be harmless if it doesn't make contact.
Think of it this way: if you were struck by lightning, a person 500 feet away may not be harmed by it, but if straight line winds cause your house to collapse, you can say with relative certainty that your neighbor will have some damage.
Another factor is the reliability of protection. Major hail can total a car. Strong straight line winds and tornadoes can collapse or remove your house. A lightning bolt will cause property damage, but you will be safe inside, provided you aren't touching metal.
Unlike storms and floods, lightning strikes a single point. So the area directly affected by lightning is small in comparison. Another thing to consider is that when you see lightning, that does not mean it touched down to the ground.
However, keep in mind the fundamental way that lightning causes destruction, death, property damage, etc: wildfires. Most wildfires are caused by lightning. In the USA alone, over 10,000 lightning-caused wildfires are reported each year. And, nearly 4 million acres are burned by those fires. See the NIFC for more information. So, while it is unlikely to get struck directly by lightning, the fires that are caused by lightning cause many deaths and vast amounts of property damage, which dwarfs the damage caused by floods and storms.