6.2.17 The rmdir command: remove remote directories
To remove a directory on the server, type rmdir and then the directory name or names:
rmdir oldstuff
rmdir *.old ancient
Directories will be deleted without further prompting, even if multiple directories are specified.
Most SFTP servers will probably refuse to remove a directory if the directory has anything in it, so you will need to delete the contents first.