You don't get elo for queuing with players with too high an elo gap.
I play pretty much only with friends now that I'm not a competitive player anymore. I'll just remove all of them from my friends list because thug_81 tells me I can't queue with them.
In most of our lobbies we have a guy with 3.2k elo, me with 3.1k, another 1-2 friends with 2.6 - 2.8k, and then 1 or 2 that are level 6 - 8 usually. That still means we play vs level 10's on most games, unless they are also 5 man premade with 3 - 4 high elo level 10's and a couple lower levels.
You need to relax.