House Hacking- How do I find out what I can/can't rent out?

[Grant Shipman]

I'm going to house hack my first rental property that I'm closing Nov 10th on by renting out the extra bedrooms.  There are 5 conforming bedrooms (windows & closets). There are also two non-conforming bedrooms that look exactly like a bedroom, except they do not have a window. 

Is it legal to rent out a room in my house to someone if that room doesn't have a window?  How do I find out if it is legal or not? 

If I was a renter, I would actually prefer to rent one of the non-conforming bedrooms b/c they have much more square footage.