Mute is only 'supposed' to mute system sound; ringer, alerts, keyboard, etc. For whatever reason, intentional or bad programing, some apps are also muted.
To turn off all sound hold the volume down button for a couple seconds. Hold in mind the headphone jack and internal speaker remember their own sound settings, so turning down one won't turn down the other.