The township was originally chartered in 1762 and named Preston, after Richard Graham, 1st Viscount Preston of Scotland. Settlers failed to meet the terms of the original grant, so the plantation was transferred in 1770 to grantees including Sir James Cockburn, 8th Baronet, after which it was named Cockburn Town, incorporated in 1797. In 1811, in the lead-up to the War of 1812, Governor John Langdon changed the name to Columbia.
Although the surface is uneven and mountainous, the soil was of good quality. Maple sugar became an important product, and lumber was cut and transported on rafts down the Connecticut River to markets. By 1859, when the population was 762, Columbia had four sawmills, three gristmills, two clapboard machines, and a starch mill.
In November, 2009 a history of Columbia was published. This book covers the period from 1770 to 2009. The book is available during normal business hours at the Town Office for a price of $37.95. Books can be mailed to you for an additional $8.00. If you are interested in purchasing a copy, please feel to call, e-mail or stop by the office.