"I think the market is concerned about some possible recessionary issues coming out of global issues as well as certain issues in the United States," said Sidhu.
Shares in Customers have dropped 16% year to date, joining the overall selloff in the sector.
Still, Sidhu is telling Wall Street analysts that he plans to grow earnings per share over 20% in 2016. Customers Bank's average annual compound growth rate in earnings has been over 25% for the past five years.
Sidhu said a lack of M&A is also pushing bank stocks lower. He said large banks are afraid to get bigger due to regulatory headaches and political rhetoric. And even if those banks were interested in going shopping for a smaller bank like Customers, which has 14 branches in the Northeast, they would not necessarily get the necessary bang for their buck.
"When you buy a bank, you are buying branches and you are acquiring customers, and the big banks are scratching their heads and saying 'Why should I buy something which comes with yesterday's model, when the model of the future is using technology to acquire customers, not branches?'" said Sidhu.
Sidhu has been growing his customer base through his BankMobile division, which offers no-fee online banking with access to over 55,000 surcharge-free ATMs nationwide. Sidhu launched BankMobile last year. It now has over 100,000 users, he said. He expects it to have over 2 million users by this summer.
Sidhu said BankMobile will make the bulk of its profits from interchange fees. The card-issuing bank in a credit or debit-card transaction deducts the interchange fee from the amount it pays the acquiring bank that handles a transaction for a merchant.
"People are not using cash now. They are swiping their cards for a coffee at McDonald's or an Uber," said Sidhu. "We can make 1.3% or 1.4% interchange income on that. That is a model. Why should you make money by charging ridiculous overdraft fees?"