A hedonistic pursuit of the good life does not strongly invite people who are interested in philosophy. And pleasure seekers may not be all that interested in philosophy.
I think that hits the nail on the head. The issue is not "sex drugs and rock and roll" - the issue is that pleasure is a feeling, and Epicurean philosophy is essentially a war to explain that "feeling" is ultimately what life is all about, rather than "logic" or "reason" or "virtue" or "piety to the gods."