College Hill is the home of Brown University and Rhode Island School of Design. ... The photo from the early 1900s shows the red-brick Victorian building that was once Westerly's Town Hall.