As the U.S. Census Bureau notes, "This growth is not the result of immigration alone. The United States has experienced net in-migration since 1980, and it is this out-migration that has led to the increased population growth."
People are leaving the United States.