@dannyswift Chrome should automatically hibernate extensions if they're not in use, except for "persistent" background extensions.
As for your request, you can set this behaviour yourself:
Go to vivaldi://extensions
Find an extension you want to limit to work on click only
Scroll until you find the "Site access" choice:
Set it to "on click"
Then, that extension will only activate when you click it's button.