At first Cas honestly understand; then, for a terrifying second of emotional freefall, he refuses to understand.

That confusion falls under the weight of the fury that slowly seeps through Castiel all the way down to his toes. "Where is he." It doesn't occur to Cas to check his temper in the face of a thing much, much stronger than he.