Why is it Important?

Letting them act (unless their actions become way too malicious) reduces the mental energy exerted. You don't get too affected by their opinions and help you clarify your judgments. All of these would be redirected towards gaining focus and achieving your goals. You may acknowledge their criticisms and use it as your fuel, however don't let it be the sole reason why you are fighting for your goals every day.