Upvoted. But there are some things to consider.
When I use the default settings and mute a tab, then sure, I want the Unmute button to always be visible even when the tab doesn't play any sound. But I have changed the site permissions for some websites and set the sound permission to "Block" (e.g. some sites with an annoying support chat that plays a notification sound when you open the page). For them I don't want the Muted Speaker icon to always be visible. So I think this should only apply to tabs that have been manually muted.