What are the pro's and cons to building a prefab house?

I am considering building a prefab house as my own contractor and with a help from friends and families as a way to afford a big home in these inflated times. Is there any downside? Financing, appraised value quality etc???