The PM's biggest challenge could lurk in Friday's commitment on infrastructure. He promised to "fast-track planning decisions ...