Yes. Once permanently rejected neither incoming nor outgoing messages will not be delivered again automatically. This also applies to the Continuity Service. 

 

The automatic resending of mail is only attempted when dealing with deferred messages.