Listen, I'd rather talk about this tomorrow, when we've both calmed down.
I'd rather we didn't argue, but this is very important to me.
We use would rather with the infinitive without to to talk about present / future preferences, as an alternative to would prefer to.
I'd rather go on holiday in July than August.
Would you rather stay in or go out tonight?
I'd rather not go out tonight, I'm really tired.
NOT I'd not rather.
We can also use would rather + person + past tense to talk about what we would like another person to do, as an alternative to I would prefer it if..., e.g.
I'd rather you came on Saturday. I'm a bit busy on Friday.
I'd rather you didn't smoke in here, if you don't mind.
I'd prefer to go to the cinema than to a club.
I'd rather go to the cinema than to a club.
I'd prefer not to go to the party if my ex is going to be there.
I'd rather not go to the party if my ex is going to be there.
Would you prefer to meet on Thursday morning or afternoon?
Would you rather meet on Thursday morning or afternoon?
I'd prefer it if you didn't take photos.
I'd rather you didn't take photos.
I'd prefer it if your parents stayed in a hotel and not with us.
I'd rather your parents stayed in a hotel and not with us.