So where is the risk? The buyer is gone, so what? Buyers come and go. You could scare them off for life and it won't matter. If you don't care if you move or not...it really doesn't mean much. You just stay home, problem solved. The only issue I could see is if you sit your house on the market for 6 months not caring if you move and then all of a sudden you have to move for some unexpected reason. Then your house recently failed to sell for half a year in a hot market and it is going to make people assume there are a bunch of issues with it. Though, even then, I can't imagine it being a huge hurdle once your realtor explains it to prospective buyers agents.
Real risk is buying a house while still owning one and the purchase isn't contingent on your current house selling. That is a true mess and I have seen it play out a few times around me the last few years. People think their house will easily sell for what they expect and something quirky about the house makes it difficult.
The entire concept is kind of dumb though. The odds someone "makes you move" is just not likely at all and not worth the hassle. Not sure where such a thing would happen...but probably not Wisconsin.