English (Sussex): topographic name for someone who lived by a holt, a small wood, + the suffix -er denoting an inhabitant. North German (also Hölter): habitational name from places called Holter or Hölter.