Do I really need a 'side-sleeper specific' pillow?

Not strictly, but the geometry matters. A pillow marketed for side sleepers will generally have higher loft and firmer support than an all-position pillow. If you're a true combo sleeper, an adjustable model is the safer bet than a fixed-loft side-sleeper-only pillow.