The activity/tool continues to appear on the player even though I've finished testing and/or stopped the live event.

By default, the Studio saves and retains the last activity launched. Before leaving the Studio, make sure your activity or tool is hidden.