In 1850, Glusburn had about 600 inhabitants, who mainly lived around Glusburn Green, the bottom of Green Lane, Rycroft, Harrison and Town End Place. Many were engaged in textile work, with farming as the second income.

John William Hartley had a small weaving shed in Glusburn and a John Horsfall came over from Oxenhope, to learn the trade with him.  John Horsfall then married his daughter and became first a partner, then the sole owner of the weaving shed. He was extremely successful and the business grew rapidly. He needed more workers which meant building additional terraced housing, the stone for these being quarried at Kildwick. The main building of the mill, dates from this time. John Horsfall then went on to build Hayfield Hall for his family, the Institute, and a Park across the road from the Mill. At its peak about 500 people were employed at the Mill. In the 1950’s there was a shortage of workers in the area and the Horsfall family recruited girls from Malta. A hostel was built on the edge of the bowling green to accommodate them.