Bank stocks large and small have been hammered since the start of 2016. Jay Sidhu, CEO of Customers Bancorp (CUBI) , said his bank is growing just fine. The problem is more macro, he said.

"I think the market is concerned about some possible recessionary issues coming out of global issues as well as certain issues in the United States," said Sidhu.

Shares in Customers have dropped 16% year to date, joining the overall selloff in the sector.

Still, Sidhu is telling Wall Street analysts that he plans to grow earnings per share over 20% in 2016. Customers Bank's average annual compound growth rate in earnings has been over 25% for the past five years.

Sidhu said a lack of M&A is also pushing bank stocks lower. He said large banks are afraid to get bigger due to regulatory headaches and political rhetoric. And even if those banks were interested in going shopping for a smaller bank like Customers, which has 14 branches in the Northeast, they would not necessarily get the necessary bang for their buck.

"When you buy a bank, you are buying branches and you are acquiring customers, and the big banks are scratching their heads and saying 'Why should I buy something which comes with yesterday's model, when the model of the future is using technology to acquire customers, not branches?'" said Sidhu.

Sidhu has been growing his customer base through his BankMobile division, which offers no-fee online banking with access to over 55,000 surcharge-free ATMs nationwide. Sidhu launched BankMobile last year. It now has over 100,000 users, he said. He expects it to have over 2 million users by this summer.

Sidhu said BankMobile will make the bulk of its profits from interchange fees. The card-issuing bank in a credit or debit-card transaction deducts the interchange fee from the amount it pays the acquiring bank that handles a transaction for a merchant.

"People are not using cash now. They are swiping their cards for a coffee at McDonald's or an Uber," said Sidhu. "We can make 1.3% or 1.4% interchange income on that. That is a model. Why should you make money by charging ridiculous overdraft fees?"

More from Investing

Why The FANG Stocks' Dominance May Not Be So Bad For The Market

Why The FANG Stocks' Dominance May Not Be So Bad For The Market

Danica Patrick's Final Race at 2018 Indianapolis 500: What She Thinks About Cars

Danica Patrick's Final Race at 2018 Indianapolis 500: What She Thinks About Cars

At End of May, Investors Signalling They May Stay Away

At End of May, Investors Signalling They May Stay Away

Inside Carnival's Mind Blowing New Horizon Cruise Ship (Video)

Inside Carnival's Mind Blowing New Horizon Cruise Ship (Video)

Neel Kashkari: The Heart of Our Financial System Is More Radioactive Than Ever

Neel Kashkari: The Heart of Our Financial System Is More Radioactive Than Ever