Pools and sports halls across England are at risk as council budget cuts bite, say town hall bosses.