Delays to speech and language skills are a top concern for primary schools, researchers say.