You’re fine so long as they don’t have horses or other livestock. There is a Minnesota law prohibiting shooting within 500 feet of a livestock corral or barn whether or not you are hunting.
If you are shooting 150 feet from someone else’s house, you should probably make sure they are OK with it.