How to discourage villagers from sleeping in my house?

So I started a new survival world on my Minecraft server a few days ago after several years of not playing. I spawned near a village and built a nice house there.

Now all the villagers have taken it upon themselves to move in, in my house – I even ended up putting some extra beds in so now there’s usually one available even if a villager or two is already sleeping there, but I’m still kind of annoyed by this.

I know this is hypocritical, of course, because god knows I’ve been in all their houses already but let’s ignore that for the moment.