English Standard Version (ESV)
"So we built the wall."
There are many reasons people will oppose the work you are doing. Some will dislike the cause, some will despise you, while others may not like the people your work is assisting. Others just like to jeer at anything noble that comes along.
The more attention paid to the scoffers, the less energy you have to pour into your work. It is an argument you cannot win, and it will distract you from your labors. People will oppose your work, that is simply a fact, and in the face of it, you can choose to stay faithful, to stay committed, and to work for the glory of God, trusting God to sort out the skeptics later.
In the face of opposition, Nehemiah and the Israelites refused to let the taunts distract them, and they eventually restored Jerusalem.
In the face of whatever opposes your faithful service today, will you focus on the glory of God and work for that purpose?