Is putting a tiny home in the back yard an option?
I lived in one most of the last 6 years.
That way both of you maintain your privacy, mostly.