If you didn't catch it, the people from Terminus were not always cannibals. Terminus was at one time an actual "Sanctuary" but a group of "bad guys" came in and destroyed their spirit and did horrible things that made them into who we saw. That was the whole "Then" and "Now" sequence was about. Also talking dead offered some extra insight into the people of terminus. Travelers who would come in were always greeted nicely, if they were weak, they'd be immediately put into a container (train car, cargo container, etc..) but if they were strong, they would feed them let them relax, and then tell them what they were eating, if they accepted it they could become one of them, if not, off to the storage.
As we saw in the last episode the survivors from terminus are the Hunters from the comics, with a back story. Also in the comics the reason they switched to cannibalism was because they lacked the ability to do things right with growing crops and farming in general.
Daryl thought he had heard something that night, the next day he looked around and found no signs of anyone other than their group. So yes it was dismissed. As Daryl is a skilled tracker and his skill has been proven to be successful in previous episodes.
After these two episodes how they portray the "hunters" is very mixed and not well maintained with what we have seen so far. They were shown to have a very tightly ran process, yet when there was no response from one of their people no one was sent to check on him. So we see them go from proficient to sloppy.. Now we see them stalking Rick's group with no trace.. again we see them suddenly switch from sloppy to proficient. I wish the writers would see that they did this, because it does draw some of my interest away trying to keep up with how I am supposed to perceive them.
Other than that this season is great, and looks like it will be a very good one.