Similar to Facebook's "Unfollow" and Snapchat's "Do Not Disturb" features, you can still go to the account if you want to see their posts or story, even if the profile is private. You're still following each other; you just don't get updates on their activity.
And if you change your mind, you can always Unmute the account's posts and stories the exact same way.