Wow seriously, there are so many downsides, but most people don't realize and just admire people who are tall.
No clothes fit, all trousers are too short, all sweaters and shirts the arms will be too short, you often don't fit into sports equipment of clubs like Kajak (not much space for legs), and dozens more, any sports you need to "fit" into some equipment basically, you need larger bike frame, you always need to duck down for doors or if the ceiling is not too high, every desk and surface will be too low for you to work on decently, and as funny as it sounds your posture suffers quite a lot because you always have to look "down" on people (shoulder forwards, head/neck looking down) - constantly, 16h/day. And these are just examples, I'm sure I forgot many other things. Many of these things make life much more expensive as well (nothing from the sale or from a regular shop fits you).
If you're in a country like Netherlands, I am sure it's a bit easier to find clothes etc. because the height average is much bigger - but go to Spain, UK, ... and you're completely fucked.