As fears grow of a backlash against asylum seekers and a summer of disorder, polling shows a change in people’s priorities ...