Yes, although this feature is reserved for administrator use only.
Administrative users will have the option in the context menu to permanently delete an item. If a node has children items, you must delete the children first before permanently deleting the parent. This ensures that the action is intentional, as permanent deletion is a destructive action.