If I have a restraining order on someone, and have to go somewhere like the market for example. Can I drive past their house?
It might be wise not to, but unless mutual restraining orders are in place there is nothing legally preventing you from driving by the restrained person's house.
I agree you are playing with fire. I woukd not do it, if it were me...
If YOU are the one that got an order restraining someone else from bothering you, then YOU can go anywhere you like.
If YOU are the one that got restrained [limited], then read your sentencing and restraining order from court to know what you are not allowed to do. Violation will land you in jail.