Even if it went from grey stone to grey plastic siding, you could tell when it goes from stone to plastic. That should be enough to meet their “different” criteria, but not be such an outrageous eyesore.