I would work something into your future contracts or draft up an addendum about prohibiting contract assignment. 

This would be a non arms length prohibited transaction and would potentially result in the entire IRA being distributed is my understanding...the only way this could be possible is if the OP is or becomes retirement age in the next two years.

Also generally speaking, zoning restrictions where low-rise buildings are located prohibit high rise development.

The “due on sale” clause does not, in fact , legally CAN NOT, prohibit a transfer of property where the mortgage lien is not paid off.  

I wanted to invest down there back in the 80s, but they had that law in effect then that prohibited foreigners from owning/leasing land with 8 miles of the coast IIRC (?)

California Prohibit State Limitations on Local Rent Control Initiative (2024).

With this said, I'm taking it as it's not prohibited at least. 

It has been recently introduced and is supposed to put a cap on the cost to install utility hook ups for new construction and ban hedge funds and corporate entities from buying single family homes in California):SB 1210"This bill would, for new housing construction, prohibit a connection, capacity, or other point of connection charge from a public utility, as defined, or a special district, as defined, for electrical, gas, sewer, or water service from exceeding 1% of the reported building permit value of that housing unit.

That is prohibited by current code.

This bill also prohibits the development of small subdivisions and prohibits ministerial lot splits on adjacent parcels by the same individual to prevent investor speculation.