Not every immigrant naturalized. Many did, particularly if they wanted to vote. But before the early part of the 20th century a significant portion of immigrants to the United States did not bother with becoming citizens. Your ancestor may have been one of them.
Just remember though that just because you cannot find a naturalization record for your ancestor, it does not mean he did not naturalize. You just may not be able to find it.