Love the game but 1 prob

I love the game I have been playing for around a year now but I have not been playing in siege so my castle is only level 4 and for some reason it keeps matching me with levels 25-31 so I cant beat anyone

Oabdiahjsudh about Heroes vs Monsters, v3.4