Lender is not confident in Primary Residence Loan

[Prash Sun]

Hi, I am planning to buy into a condo in NJ and spoke to the same lender who financed my primary residence in 2017. Now I’d like to buy another one that is smaller in size and would like to move-in to the unit for personal reasons and also convert to investment. My lender says there is no real argument for Primary Residence I just purchased one in 2017. So my question is, is th lender right in refusing because they think I could do this for all the reasons? If I make a reason that I am starting a new job in the area, will they be asking me for offer letter et al? Just curious.