Best way to get fewer refugees is to stop chasing people out of their homelands in the first place. In lieu of that, you need a border, and high taxes to cover the costs of patrolling it. In lieu of that, you need more draconian laws and policing. And in lieu of that, you need more guns, and the willingness to use them.
Personally, I find pushing for making fewer refugees in the first place to be the preferable solution. An easy way to get started there is to stop funding wars of foreign aggression, and the existence of belligerent entities such as the Zionist occupation.
But, you do have some options.
