Are you positive that your binding on that workflow task is to the correct form scenario step/stage that allows you to delete the attachment(s)?
Also did you look at OSS note...
2010600 - Open workflow attachments versus completed workflow attachments
or
2019974 - Deleted attachment still displays for tasks of the same workflow process
Just checking.