NEW YORK ( TheStreet) - Bank stocks were tumbling once again on Friday, with all eyes on Bank of America ( BAC), but a more meaningful concern may be trends outlined in JPMorgan Chase's ( JPM) earnings report this week.

>>>Wall Street Whispers: The Big Worry for 3Q

Mortgage problems continued to drag on the sector, with many observers pointing to escalating foreclosure issue as a reason for the sell-off. A damning report from a hedge fund on the West Coast regarding BofA also seemed to be having a big impact on bank stocks.

An analysis by Branch Hill Capital found that Bank of America had $74 billion in exposure to mortgage-security buybacks from Fannie Mae ( FNMA.OB) and Freddie Mac ( FMCC.OB). The report was compiled in August, but began getting notice on Thursday. Branch Hill suggested selling bank stocks and buying shares of title insurers, which helps explain the movement in both.

By late morning, banks with the biggest mortgage exposure were getting hit hard. Bank of America shares were down 5.8% at $11.88, while JPMorgan was shedding 4.7% at $36.92. Wells Fargo ( WFC) was dropping 4.9% at $23.52, with Citigroup ( C) down 2.7% at $3.95 - the second day it slid under the $4 mark.

The KBW Index of large-cap bank stocks was down 2% at 45.42. Besides the four large money-center banks, other heavy losers were SunTrust ( STI), down 4.3% at $24.48 and Capital One ( COF), down 3.5% at $38.51.

Fidelity National Financial ( FNF), the largest title insurer, was flat on Friday morning while other big title insurers First American ( FAF) and Old Republic ( ORI) were up marginally at $14.63 and $13.92, respectively. Those stocks had come under heavy pressure in earlier sessions due to their unknown exposure to foreclosure litigation.

But Branch Hill's calculations seemed dubious on their face. As of mid-September federal regulators said there was just $4.5 billion worth of outstanding repurchase requests. Another analysis by Oppenheimer bank analyst Chris Kotowski shows that the entire industry may only be required to buy back $7.7 billion worth of Fannie-Freddie debt over the next year. Kotowski called Branch Hill's claims "exaggerated" in a report on Friday.

"The most readily quantifiable component of the argument is demonstrably flawed," Kotowski said in a report Friday, "and this should cast doubt on the rest of the numbers, which we think were arbitrarily derived in any case."

Apart from a hedge-fund boasting its stock thesis, uncertainty surrounding the "robosigning" issue continued to weigh on investor confidence. Big mortgage servicers have gotten much attention in recent days for their practice of "robosigning" documents without having properly vetted the information. This has caused several large banks to halt foreclosure proceedings and begin reviewing practices and potentially faulty documents. It has also brought up an array of potentially costly legal issues.

If you liked this article you might like

How to Make Your Life Successful Just Like Billionaire Warren Buffett

How to Get Rich Using Warren Buffett's Favorite Stock Market Indicators

With the Fed, It's Different This Time

How to Live Just Like Billionaire Warren Buffett

Why Hurricanes Won't Force the Fed to Ditch a December Rate Hike