To be fair since Pasteur we have made enormous progress in refrigeration and supply lines, so if the cow is healthy, and the raw milk is fresh, you should be fine. The main issue is that you should treat the milk in your fridge like something that spoils quickly (like fish), rather than something that can stay in the fridge safely for a week or two. Of course if the cow is sick none of this applies, so it has to come from a trusted source.

TLDR; raw milk can be okay if you are taking far more precautions than you normally would with milk.