It's not about 'how many people' follows you. That is easily manipulated. It's about who follows you. Web of Trust.