That depends on how differentiated you are from existing products and if having your product next to a dozen competitors on a shelf will help sell it. Do customers need to touch it to see why it's different/better? If not, brick-and-mortar might not be necessary, at least initially.

Warby Parker overcame this issue by making their glasses easy to return. Try on a few frames and return the ones you don't want.