I know it might not make sense to you... but I think I get it.

Alice... he loves you. And watching you... suffer. Die. There... there wasn't anything he could do about it. He can't go kill the Milkman. He can't kill the milk. Yeah, he told me about his power. He loves you... and he couldn't do anything to stop what happened. And there's nothing worse than having all that power and not being able to protect the ones you love.

...so he's doing the one thing he can; he's preventing it from happening again, consequences be damned.

And I understand this... because I'd do the same thing for Patchy.