Vile Knight question

I'm just wondering if the Vile Knight's damage boost ("Deal 4% increased damage with hits to rare or unique enemies for each second they've ever been in your presence, up to a maximum of 200%") needs them to still be in your presence for it to work?

With the way it's worded I assume the bonus doesn't decrease / disappear if they leave your presence, at least.