Owner occupied multi-family or not

[Ed Sanborn]

Does anyone know what the rules and ultimately enforcement of those rules for owner-occupied multi-family properties?  What I specifically want to know is.. if I purchase a multi-family home and live in the property in order to only have to put down 3%, am I supposed to stay living in the property as long as I own it?  What if I want to move out after 3 months or a year?  What if I want to purchase a 2nd multi-family the same way in, say, 6 months?  I have heard that some people have relationships with lenders that allow this and some do not.  I would like to hear your experience?