If your male ancestor died, is it possible that the mother married again and that her children with the first husband are listed in subsequent records with their step-father’s last name? Children could easily be enumerated in census records with the mother and actual step-father under his last name with no real indication that he was not the biological father and regardless of whether he legally adopted them or not.