They will not know...

In Snort, muting is public but blocking is private. But yeah, both is worse than unfollowing as you wouldn't see them even if others replied them.