Robert Fleming, Minister