proverb

That’s where the shoe pinches!

difficulty

expresses that

Something is the source of trouble, sadness or difficulty,