A fly in the ointment.

expression that

refers to a small flaw or imperfection that spoils something that is otherwise perfect or ruins the overall impression of something.