Retail stocks have slumped this year.

While many chalk up the declines to competition from online retail behemoth Amazon (AMZN) , famed market expert Peter Schiff, CEO of Euro Pacific Capital, doesn't agree.

"Amazon has been here for a long time - this is the worst year for retail - it's worse than 2008 and 2009," he said. "This is because consumers are broke - they have lousy jobs, they're loaded up with debt and they can't afford to buy stuff."

He pointed to Foot Locker's (FL) 25% decline on Friday.

Schiff isn't comforted by the double-digit gains in earnings growth for the past two quarters in U.S. stocks.

More From TheStreet:

More from Video

Week Ahead: It's All About Retail and the Consumer

Week Ahead: It's All About Retail and the Consumer

Fisker CEO: Autonomous Electric Shuttle Will Debut Soon at Major Tech Company

Fisker CEO: Autonomous Electric Shuttle Will Debut Soon at Major Tech Company

60 Seconds: Get Financial Aid to Pay For College

60 Seconds: Get Financial Aid to Pay For College

Rewind: Jim Cramer on Home Depot, Tapestry, Nordstrom and Square

Rewind: Jim Cramer on Home Depot, Tapestry, Nordstrom and Square

Market Madness: MoviePass Disappoints Again

Market Madness: MoviePass Disappoints Again