Stop vs. Pause

Tap the Pause button to pause.
Long press the Pause button to stop.

The pause can be change to stop for streams from: Settings → Behavior → Don't pause streams