There are a number of "recycle bin" apps in the Play Store, but I've never used any of them so can't recommend one or comment on whether they will do what you actually want.
(As an old-school unix/linux user who finds terminals more efficient than GUIs I'm perfectly comfortable with "delete it and it's gone", and it makes particular sense to me on resource-limited devices like phones. Hence I've never investigated these things beyond noting that they exist.)