Doesn't make sense to me either, maybe context would help.
Some people’s dreams are harmful to others, and sometimes even destroy them completely. (Think of fierce competition, or even war)
It was easy understanding the quote compared to understanding what you were trying to say
I think it's talking about how dreams can affect others:
Saying "many can pursue their dreams in solitude..."
It means that sometimes, people's dreams can be achieved by themselves, and will not affect others, whereas other people's dreams perhaps might ruin the dreams of others. It's talking about the broader extent of people's dreams and how they might extend beyond the individual.
"some people pursue their dream without impacting other people.
some people pursue their dream, but destroy the dreams of anyone who gets in their way"
Problem with basic English
I think it has something to be with the idea that the people who dream big AND act on those dreams, putting in the hard work, will make them come true, which means they would destroy the dreams of the people who had the same idea, but did not act on them