It’s reverse threaded you unscrewed it.
It should be taken off to reset it, take it off and get a gasket for it first, put it back together (without tension) and then put it back on assembled , then turn the bolt head counter clockwise until it clicks only once (tensioned).
Verify this with a mechanic when you buy the gasket. Both style are automatic tensioners; I believe but different designs.