Journal 30 Chapter 15 pg 153

"...a circle of ominous shadow moving along with his deformity, whichever way he turned himself?" (153)

That is saying that there is a dark shadow following Chillingworth that is showing his darker side.