Clean air campaigners have said they fear London Mayor Sadiq Khan could be making air pollution less of a priority.