The Census boundary does not create a town hall
Swan Lake is mapped so the Census Bureau can publish useful local statistics. The government crosswalk shows that it crosses the towns of Liberty and Bethel. Use the exact address to choose the right municipality and county.