Mortgage lenders fall into two broad categories: conventional (conforming) lenders and portfolio lenders. A conventional lender writes your loan to Fannie Mae and Freddie Mac rules and usually advertises the lowest rates, but it is rigid about the standard boxes. A portfolio lender keeps the loan on its own books, sets its own rules, and can be more flexible for self-employed, foreign-income, jumbo (a loan above the conforming limit), and newly arrived buyers, usually in exchange for a higher rate or a larger down payment. The lowest advertised rate is only cheap if you actually qualify under that lender's rules, so a "no" from one bank is often a sign you are at the wrong category of lender, not an unqualified buyer.
This page explains both categories and who tends to need each, the non-QM (non-qualified mortgage, a loan that does not meet the standard "qualified mortgage" rules) and bank-statement options, and how a loan recast differs from a refinance. Confirm loan specifics with a licensed mortgage professional.
Two categories of lender
Lenders fall into two categories. A conventional (conforming) lender fits you into the standard boxes set by Fannie Mae and Freddie Mac, the agencies that buy most US mortgages, then sells the loan on, so its job is confirming you pass. A portfolio lender keeps the loan on its own books, sets its own rules, and scrutinizes each borrower harder.
A portfolio lender works differently. It keeps the loan in-house, on its own balance sheet (its own books), and does not sell it to the agencies. Because the portfolio lender lives with the risk for the life of the loan, it sets its own rules and looks harder at each borrower. That extra scrutiny is the tradeoff for the flexibility a portfolio lender can offer, which is the part that matters for buyers who do not fit the standard boxes.
Why the cheapest advertised rate can mislead
The lowest rate you see advertised almost always comes from a conventional lender, and there is a structural reason for it. Because that lender intends to sell your loan, it can sometimes be more forgiving on an edge case, as long as the file still passes the Fannie and Freddie boxes. A portfolio lender that plans to hold the loan does the opposite: it scrutinizes each borrower harder, because it carries the risk itself. The cheapest quote is only cheap if you actually qualify under that lender's rules.
One thing has been true of every lender since the 2008 financial crisis: income has to be verified the same way, no matter how long you have banked somewhere or how much you keep on deposit. A large balance sitting in your own account at the same bank buys you no underwriting accommodation (no easing of the approval rules). The lender still has to document where your income comes from and that it is likely to continue. Knowing that going in saves a lot of frustration later.
Who often needs a portfolio or non-QM lender
Buyers who often need a portfolio or non-QM lender are the self-employed (who minimize taxable income), those paid from foreign income, jumbo borrowers (a loan above the conforming limit), and recent immigrants without a long W-2 (the standard US wage-and-tax statement) or established US credit. Non-QM means outside the federal Qualified Mortgage rules (the borrower-protection rules conforming loans meet).
Self-employed buyers who run their income through their business and minimize their taxable income often look weak on paper even when they are not. A bank-statement loan can help: instead of two years of tax returns, the lender underwrites roughly a year of bank deposits to estimate real cash flow. Buyers paid from foreign income, where the money and the employer sit outside the US, frequently need a lender set up to document that. Jumbo buyers need one too: a jumbo loan is simply a mortgage larger than the conforming limit, the ceiling above which Fannie and Freddie will not buy the loan (the limit changes and varies by county, so confirm the current figure with your lender). And recent immigrants without a long W-2 history (the standard US wage-and-tax statement an employer issues each year) or an established US credit record often fit a portfolio program better than a conforming one. The tradeoff across all of these is consistent: more flexibility, usually in exchange for a higher rate, a larger down payment, or both.
If one bank said no
A no from one bank is one of the most misread moments in the whole process. Many newcomers and self-employed buyers who get turned down were never unqualified. They were simply the wrong profile for that one lender's product shelf, and a single bank can only offer what is on it. That is a matching problem, not a verdict on you.
The fix is to match your profile to the right category of lender, which is often easier through someone with access to many loan programs than through one bank selling its own products. This matters especially if you are buying in a second language, are paid in ways a standard W-2 worker is not, or are early in your US financial history. The loan that fits you may well exist; it just may not exist at the first place you asked.
Recast vs refinance
These two get confused, and they do very different things. A recast is when you pay a lump sum toward your loan principal (the balance you still owe) and the servicer (the company that collects your monthly payment) re-amortizes the loan, meaning it recalculates your monthly payment downward over the remaining term. Your interest rate does not change. There is usually a small one-time fee, and typically no new appraisal and no new credit pull. A refinance is the opposite in spirit: it replaces your old loan with an entirely new one, with a new rate, a new appraisal, a new credit pull, and a fresh set of closing costs.
When does each one win? A recast is the move when you already have a low locked-in rate you want to keep and you have come into cash, from a bonus, a sale, or equity in another property, and simply want a lower monthly payment. A refinance is the move when the goal is a different rate, a cash-out (replacing your loan with a larger one and taking the difference in cash), or a change in the loan's terms. In a higher-rate stretch, many owners with a low existing rate prefer a recast precisely because it lowers the payment without surrendering the rate they already have. Lenders vary on whether they allow recasts and on the minimum lump sum, so confirm the rules with your servicer.
The practical close
The point of all of this is simple: the right loan is a matching problem, not a contest for the lowest billboard rate, and the answer depends on your specific income, history, and goals. If a bank has told you no, that is usually the start of the conversation, not the end of it.
If you want an introduction to a mortgage professional who can run your specific profile, message me. Every situation is different, and the right next step is to look at yours directly rather than guess from a general rule.
Lily is a REALTOR, not a lender, so any loan specifics, rates, limits, and program rules should be confirmed with a licensed mortgage professional.
Lily Garipova, REALTOR, in real estate since 2007, California licensed since 2016 (Cal DRE #02010731).
Email: lilyagaripova@gmail.com
Phone: (415) 910-3958
Web: lilygaripova.com
Fremont, CA
FAQ
What is the difference between a conventional and a portfolio lender?
A conventional (conforming) lender writes your loan to the standard rules set by Fannie Mae and Freddie Mac, then typically sells the loan to those agencies within a few months and lends the money out again. A portfolio lender keeps the loan in-house on its own books and sets its own rules. Because the conventional lender plans to sell the loan, it focuses on whether you pass the standard boxes; because the portfolio lender holds the risk, it looks harder at each borrower but can be more flexible on cases that do not fit the standard mold.
What is a non-QM loan, and is it risky?
Non-QM means the loan does not meet the federal Qualified Mortgage rules that conforming loans are built around, so it is funded by specialty lenders rather than the Fannie and Freddie pool. It is not inherently risky; it is mostly a way to document income that does not fit the standard two-years-of-tax-returns mold, such as self-employment or foreign income. The tradeoff is usually a higher rate, a larger down payment, or both, so it is worth comparing the full terms with a mortgage professional.
I'm self-employed and write off most of my income. Can I still get a mortgage?
In many cases, yes. A bank-statement loan can underwrite roughly a year of bank deposits to estimate your real cash flow, instead of relying on two years of tax returns that understate it. The rate or down payment may be higher than on a conforming loan, but the path exists, and matching your profile to a lender who offers it is the key step.
I'm new to the US with no W-2 history. What are my options?
A W-2 is the standard US wage-and-tax statement employers issue each year, and many newcomers do not have a long record of them yet. Portfolio and non-QM lenders are often set up to work with newer arrivals, including those paid from foreign income or still building US credit. The terms vary by lender, so the practical move is to match your specific situation to a lender who handles this profile rather than assume the first bank's answer is final.
Do portfolio and non-QM loans cost more?
Usually, yes, in the form of a higher rate, a larger down payment, or both. You are paying for flexibility and for a lender that keeps the risk on its own books. Whether the tradeoff is worth it depends on your situation, and it is something to weigh with a mortgage professional rather than rule out in advance.
What is a loan recast?
A recast is when you pay a lump sum toward your loan principal and the servicer re-amortizes the loan, meaning it recalculates your monthly payment downward over the remaining term. Your interest rate stays the same, and there is usually just a small one-time fee, with typically no new appraisal and no new credit pull. It is a way to lower your monthly payment without taking out a new loan.
Recast or refinance, which is better for me?
A recast tends to win when you already have a low locked-in rate you want to keep and you have come into cash and simply want a lower monthly payment. A refinance tends to win when the goal is a different rate, a cash-out, or a change in your loan's terms, since it replaces the old loan entirely. The right choice depends on your current rate, your goals, and the lender's rules, so confirm the specifics with your servicer or a mortgage professional.
Can Lily recommend a lender?
Lily is a REALTOR, not a lender, so she does not set rates or approve loans. What she can do is introduce you to a mortgage professional suited to your specific profile, which is often the missing piece for self-employed, foreign-income, jumbo, and newcomer buyers. If that would help, message her to start the conversation.
We're on H-1B visas and our bank said no. Are there Bay Area lenders that work with visa borrowers?
A single bank saying no is usually a matching problem, not a verdict on you as a borrower. Many banks offer only conforming loans (loans written to the standard Fannie Mae and Freddie Mac rules), and some of those programs stay cautious about visa status even when your income and credit are strong. Several categories of Bay Area lender are more often set up to work with H-1B and other visa borrowers: credit unions, portfolio lenders (banks that keep loans on their own books instead of selling them to Fannie Mae or Freddie Mac, so they set their own rules), and non-QM lenders (non-qualified-mortgage lenders, whose loans do not meet the federal Qualified Mortgage rules that conforming loans are built around, so they set their own underwriting guidelines). This flexibility usually comes in exchange for a higher rate or a larger down payment: illustrative, mid-2026, that can mean a down payment near 25% and a rate roughly 1 to 2 percentage points above a comparable conforming loan, figures that vary widely by lender and are shown only to set expectations, not as a live quote. Programs change often, so confirm current offerings before you count on any one of them. The practical move is to match your situation to a lender who handles visa cases rather than treat the first no as final, which is easier to do with a mortgage professional who can see many programs than through one bank selling its own.
Can I borrow against my stock portfolio to buy a house instead of selling shares and triggering tax?
It is a real tool, not a myth. A pledged-asset line, sometimes called a securities-backed line of credit, lets you borrow against the value of your stock or brokerage account while the shares stay invested, so you avoid selling and the capital-gains tax a sale can trigger. The tradeoffs are genuine: your investments serve as collateral, the rate usually floats, and if the portfolio falls in value the lender can require you to add cash or sell holdings (a margin call), so this carries market risk a plain mortgage does not. Whether it beats simply selling shares depends on your rate, your tax situation, and your appetite for that risk, so treat this as general educational information to weigh with a mortgage professional and a tax advisor, not tax or investment advice.
DSCR loan or conventional loan for a Bay Area rental: which do small landlords use?
When adding a rental strains your debt-to-income ratio (DTI, the share of your monthly income already committed to debt payments), the usual answer is to change how the loan is qualified rather than to give up. A conventional loan counts the new mortgage against your personal DTI and limits how many financed properties you can carry, which is where strong-salary buyers often hit a wall even on property number one or two. A DSCR loan (debt-service-coverage-ratio loan) instead qualifies on whether the property's own rent covers its loan payment, so your personal DTI matters far less; many small Bay Area landlords use these, or a portfolio lender that keeps the loan on its own books, once conventional financing gets tight. Which one fits depends on your rate, your down payment, and the property's numbers, so compare the full terms with a mortgage professional rather than assume a strong salary alone settles it.
