Yep the timing belt tension is spring loaded that is why you have to put a pin in it when you reinstall then pull the pin out to put tension on the belt. Do you have a seal going bad? Maybe. Anything that bolts into the block should not have access to the oil system. Timing cover, etc otherwise you would lose oil everytime you chagned the belt.