As long as the port in is completed and calls to the ported number are ringing through to your new VOIPo line, canceling with your old provider is OK.

In fact, at that point if you needed to go back to your old provider, it would be handled just like a new port would be,so there's really not much of a reason to continue paying for the old service.