So I suppose you never decrease the time?
You can do :
system > every X seconds (every 0.1 second for example)
add an action > system > subtract from
and you subtract 0.1 from your time variable.
Now your time will decrease by 0.1 every 0.1 second and the code above will work.