Colonial affairs were later added and it became the Colony Department .
The Secretary 's department was at first unofficially known as the War Department .
Colonial affairs were later added and War Department became the Colony Department .
The Secretary 's department was at first unofficially known as the War Department .