David Tennant has shared the "heartbreaking" reality that his children never got to know his parents, admitting the loss still weighs heavily on him.