Catholicism: How to treat beggars?

My country is full of beggars asking for money, sometimes it's kinda family controlled business, the parents ask their children to beg for money and then steal the money from them, some beggars are really poor, others are just scammers. But you don't have anyway of telling, the vast majority of people either yell at them or ignore them or tell them to go away or act as if they never saw them. I don't imagine that one could pay each and every beggar he sees on a daily basis, and the people in my country aren't rich and there are too many beggars out there. From a roman catholic point of view, how should common people treat beggars? Is ignoring them a sin? What does the church and saints have to say about that?