Mortgage lenders fall into two broad categories: conventional (conforming) lenders and portfolio lenders. A conventional lender writes your loan to Fannie Mae and Freddie Mac rules and usually advertises the lowest rates, but it is rigid about the standard boxes. A portfolio lender keeps the loan on its own books, sets its own rules, and can be more flexible for self-employed, foreign-income, jumbo (a loan above the conforming limit), and newly arrived buyers, usually in exchange for a higher rate or a larger down payment. The lowest advertised rate is only cheap if you actually qualify under that lender's rules, so a "no" from one bank is often a sign you are at the wrong category of lender, not an unqualified buyer.
This page explains both categories and who tends to need each, plus the non-QM (non-qualified mortgage, a loan that does not meet the standard "qualified mortgage" rules) and bank-statement options. Confirm loan specifics with a licensed mortgage professional.
What does a portfolio lender actually do?
A conventional (conforming) lender fits you into the standard boxes set by Fannie Mae and Freddie Mac, the agencies that buy most US mortgages, then sells the loan on, so its qualification criteria are rigid, but the process is mechanical once you fit the box. A portfolio lender keeps the loan in-house, on its own balance sheet (its own books), and because it lives with the risk for the life of the loan, it sets its own rules: flexible on the product and the qualification criteria, but with a harder look at each individual borrower. That harder look is the price of the flexibility, and the flexibility is the part that matters for buyers who do not fit the standard boxes.
| Conventional (conforming) | Portfolio | |
|---|---|---|
| Qualification criteria | Rigid: the Fannie and Freddie boxes | Flexible: the lender sets its own rules |
| Borrower scrutiny | Mechanical once you fit the box | Harder look at each individual borrower |
| Rates and down payment | Usually the lowest advertised rates | Usually a higher rate, a larger down payment, or both |
| Who it tends to fit | W-2 income, established US credit, loan within the conforming limit | Self-employed, foreign-income, jumbo, and newcomer buyers |
Why the cheapest advertised rate can mislead
The lowest rate you see advertised almost always comes from a conventional lender, and it is only cheap if you actually qualify: the criteria are rigid, and no amount of context gets an edge case through a box it does not fit. A portfolio lender is the mirror image: flexible on the criteria, but scrutinizing each borrower harder, because it carries the risk itself. So the real question is never which billboard rate is lower; it is which category of lender your profile passes at all.
One thing has been true of every lender since the 2008 financial crisis: income has to be verified the same way, no matter how long you have banked somewhere or how much you keep on deposit. A large balance sitting in your own account at the same bank buys you no underwriting accommodation (no easing of the approval rules): the lender still has to document where your income comes from and that it is likely to continue. Knowing that going in saves a lot of frustration later.
Who often needs a portfolio or non-QM lender?
Non-QM means outside the federal Qualified Mortgage rules (the borrower-protection rules conforming loans meet), and four profiles land there most often. Self-employed buyers who run their income through their business and minimize their taxable income often look weak on paper even when they are not; a bank-statement loan can help, underwriting roughly a year of bank deposits instead of two years of tax returns to estimate real cash flow. Buyers paid from foreign income, where the money and the employer sit outside the US, frequently need a lender set up to document that. Jumbo buyers need one too: a jumbo loan is simply a mortgage larger than the conforming limit, the ceiling above which Fannie and Freddie will not buy the loan (the limit changes and varies by county, so confirm the current figure with your lender). And recent immigrants without a long W-2 history (the standard US wage-and-tax statement an employer issues each year) or an established US credit record often fit a portfolio program better than a conforming one. The tradeoff across all of these is consistent: more flexibility, usually in exchange for a higher rate, a larger down payment, or both.
If one bank said no
A no from one bank is one of the most misread moments in the whole process. Many newcomers and self-employed buyers who get turned down were never unqualified. They were simply the wrong profile for that one lender's product shelf, and a single bank can only offer what is on it. That is a matching problem, not a verdict on you.
The fix is to match your profile to the right category of lender, which is often easier through someone with access to many loan programs than through one bank selling its own products. This matters especially if you are buying in a second language, are paid in ways a standard W-2 worker is not, or are early in your US financial history. The loan that fits you may well exist; it just may not exist at the first place you asked.
Recast vs refinance
These two get confused, and they do very different things. A recast keeps your existing loan and rate: you pay a lump sum toward principal and the servicer simply recalculates the monthly payment downward over the remaining term. A refinance replaces the loan entirely (new rate, new appraisal, new credit pull, new closing costs), which is what you want when the goal is a different rate, a cash-out, or different terms. The full recast-vs-refinance breakdown, including when each tends to make sense, lives in my guide to cash-out refinance and home equity in the Bay Area.
The practical close
The point of all of this is simple: the right loan is a matching problem, not a contest for the lowest billboard rate, and the answer depends on your specific income, history, and goals. If a bank has told you no, that is usually the start of the conversation, not the end of it.
If you want introductions to licensed mortgage professionals who can run your specific profile, message me. Every situation is different, and the right next step is to look at yours directly rather than guess from a general rule.
I am a REALTOR, not a lender, so confirm any loan specifics, rates, limits, and program rules with a licensed mortgage professional.
Lily Garipova, REALTOR, in real estate since 2007, California licensed since 2016 (Cal DRE #02010731).
Email: lilyagaripova@gmail.com
Phone: (415) 910-3958
Web: lilygaripova.com
Fremont, CA
FAQ
What is the difference between a conventional and a portfolio lender?
A conventional (conforming) lender writes your loan to the standard rules set by Fannie Mae and Freddie Mac, then typically sells the loan to those agencies within a few months and lends the money out again. A portfolio lender keeps the loan in-house on its own books and sets its own rules. Because the conventional lender plans to sell the loan, it focuses on whether you pass the standard boxes; because the portfolio lender holds the risk, it looks harder at each borrower but can be more flexible on cases that do not fit the standard mold.
What is a non-QM loan, and is it risky?
Non-QM means the loan does not meet the federal Qualified Mortgage rules that conforming loans are built around, so it is funded by specialty lenders rather than the Fannie and Freddie pool. It is not automatically predatory, but non-QM loans lack some of the borrower protections of qualified mortgages and usually cost more (a higher rate, a larger down payment, or both), so understand the full terms with a mortgage professional before committing. Mostly it is a way to document income that does not fit the standard two-years-of-tax-returns mold, such as self-employment or foreign income.
I'm self-employed and write off most of my income. Can I still get a mortgage?
In many cases, yes. A bank-statement loan can underwrite roughly a year of bank deposits to estimate your real cash flow, instead of relying on two years of tax returns that understate it. The rate or down payment may be higher than on a conforming loan, but the path exists, and matching your profile to a lender who offers it is the key step.
I'm new to the US with no W-2 history. What are my options?
A W-2 is the standard US wage-and-tax statement employers issue each year, and many newcomers do not have a long record of them yet. Portfolio and non-QM lenders are often set up to work with newer arrivals, including those paid from foreign income or still building US credit. The terms vary by lender, so the practical move is to match your specific situation to a lender who handles this profile rather than assume the first bank's answer is final.
Do portfolio and non-QM loans cost more?
Usually, yes, in the form of a higher rate, a larger down payment, or both. You are paying for flexibility and for a lender that keeps the risk on its own books. Whether the tradeoff is worth it depends on your situation, and it is something to weigh with a mortgage professional rather than rule out in advance.
Can Lily recommend a lender?
I am a REALTOR, not a lender, so I do not set rates or approve loans. What I can do is introduce you to licensed mortgage professionals suited to your specific profile, which is often the missing piece for self-employed, foreign-income, jumbo, and newcomer buyers, and help you understand the transaction side. If that would help, message me to start the conversation.
We're on H-1B visas and our bank said no. Are there Bay Area lenders that work with visa borrowers?
A single bank saying no is usually a matching problem, not a verdict on you as a borrower. Many banks offer only conforming loans (loans written to the standard Fannie Mae and Freddie Mac rules), and some of those programs stay cautious about visa status even when your income and credit are strong. Several categories of Bay Area lender are more often set up to work with H-1B and other visa borrowers: credit unions, portfolio lenders (banks that keep loans on their own books instead of selling them to Fannie Mae or Freddie Mac, so they set their own rules), and non-QM lenders (non-qualified-mortgage lenders, whose loans do not meet the federal Qualified Mortgage rules that conforming loans are built around, so they set their own underwriting guidelines). This flexibility usually comes in exchange for a larger down payment and a somewhat higher rate than a comparable conforming loan; the current figures come from a licensed lender, vary widely between lenders, and change often, so confirm current offerings before you count on any one of them. The practical move is to match your situation to a lender who handles visa cases rather than treat the first no as final, which is easier to do with a mortgage professional who can see many programs than through one bank selling its own.
Can I borrow against my stock portfolio to buy a house instead of selling shares and triggering tax?
Start with the risk, because it is real: with a pledged-asset line (sometimes called a securities-backed line of credit) your investments serve as collateral, the rate usually floats, and if the portfolio falls in value the lender can require you to add cash or sell holdings (a margin call), market risk a plain mortgage does not carry. This is a decision to weigh with a mortgage professional, a tax advisor, and a financial adviser before you commit; treat this answer as general educational information, not tax or investment advice. The tool itself is real: the line lets you borrow against the value of your stock or brokerage account while the shares stay invested, so you avoid selling and the capital-gains tax a sale can trigger. Whether it beats simply selling shares depends on your rate, your tax situation, and your appetite for that risk.
DSCR loan or conventional loan for a Bay Area rental: which do small landlords use?
When adding a rental strains your debt-to-income ratio (DTI, the share of your monthly income already committed to debt payments), the usual answer is to change how the loan is qualified rather than to give up. A conventional loan counts the new mortgage against your personal DTI and limits how many financed properties you can carry, which is where strong-salary buyers often hit a wall even on property number one or two. A DSCR loan (debt-service-coverage-ratio loan) instead qualifies on whether the property's own rent covers its loan payment, so your personal DTI matters far less; many small Bay Area landlords use these, or a portfolio lender that keeps the loan on its own books, once conventional financing gets tight. Which one fits depends on your rate, your down payment, and the property's numbers, so compare the full terms with a mortgage professional rather than assume a strong salary alone settles it.