Yes, you should. Some of them might offer useful feedback or good advice. And don’t just moderate such positive posts; be sure to reply as well. Interacting with your audience will be appreciated.
Feedback won’t always be positive, so be prepared for judgmental opinions and unhinged hatred. These are the comments you have to moderate. How you go about that is your decision. Usually it’s best to ignore anyone hating on you or your product, but if it’s directed at another user, you should consider removing the comment.
Just remember to not be mean or rude to anyone. Keep it positive and professional.