When sending or deleting messages in your mobile they are not saved on the mail server but on the phone.
- Settings> Passwords and accounts> select your account.
- Click on your email address at the top> Advanced Settings.
- Here you can choose what should happen to Rejected Emails:
Mailbox Deleted or Mailbox Archive
Click image for full version.