"Out of sight, out of mind"
I think the characters in this book don't want to know there were children in the wilderness. "Ignorance is bliss." The people didn't have to become problem solvers and deal with the situation. The children were victims on many levels - The Hungry Man as well the others they simply chose to ignore them.
This attitude reminds me somewhat of homeless people we see on the streets. True, homelessness represents a serious problem in our society. Somehow, if we make rules that keep them moving around from city to city, we don't have to deal with solutions.