Fannie Mae and Freddie Mac have a limit on the maximum sized loan they will guarantee. ... HUD annually sets the limit of the size of a conforming loan based on the October to October changes in mean home price, above which a mortgage is considered a non-conforming jumbo loan. If doing a loan that is greater than the conforming county limit, and up to the specific County limit for the area, your loan will fall into this category.