What happens if you actually try to drag the indicator? "Unfortunately", in your case, the standard slider-widget you're using accepts touch input for the entire area of its container (indicator + rest of the bar). You could modify the code (it's open to you) to only accept touch input for the indicator.
The remaining "challenge" is to handle when the touch goes to the swipe container and when it goes to the indicator. Because the standard behavior for the swipe container is to "steal" all touch input unless you handle it specifically. If you, as in your case, have other touch sensitive elements inside the swipe container.
/Martin
