Are you using an 1820 census enumeration where the names appear to be listed in roughly alphabetical order?
Census takers and some tax collectors, in an attempt to be helpful, roughly sorted names by the first letter of the last name. The problem for genealogists is that this strips the record of all sense of neighborhood. Keep this in mind when you think all the “B”s in an area lived together. No group of people are that organized.