NEW YORK (TheStreet) -- Americans don't trust self-driving cars yet, according to a survey released earlier today from vehicle valuation and automotive research company Kelley Blue Book.

The survey of more than 2,200 Americans between the ages of 12 and 64 revealed that 80% of Americans say humans should always have the option to take over driving their car. In addition, 64% of those surveyed said they feel the need to be in control of their vehicle. 

Perhaps more telling, six out of 10 people said they know little or nothing about self-driving cars.

Meanwhile companies such as Alphabet's (GOOGL) - Get Report Google, Ford (F) and Uber are all reportedly working to develop self-driving technology, noted CNBC's Joe Kernen on "Squawk Box" on Wednesday morning. 

Part of the hesitation could be because the incident from this past May, when a Tesla (TSLA) self-driving vehicle ran into the side of a truck without breaking, is still fresh on people's minds, Kernen claimed. Neither the driver nor the self-driving technology detected the truck in front of the vehicle. 

"Everybody has a vision of just sitting there, not really paying attention and not even slowing down when you see them," he said. 

Even if self-driving cars make the roads safer, people won't be satisfied, Sorkin said. 

About 36,000 people died from car-related deaths in America in 2015.

"If I told you I got the number down to 5,000 a year, you would say, 'That's great!' But if I told you the computer might be the one that kills you, then you have a different view," Sorkin explained. 

"That's because we all think we're better drivers than we probably are," CNBC's Becky Quick said. 

(Alphabet is a core holding of Jim Cramer's charitable trust Action Alerts PLUS. See all of his holding with a free trialhere.)

(Ford is held in the Dividend Stock Advisor portfolio. See all of the holdings with afree trial.)