The Cobie Smulders ABC drama dropped slightly to 4 million in its second week, but didn't budge in the key 18-49 demo.