It is true that items deleted from removable storage devices, such as a USB flash drive, are stored in the Recycle Bin until the Recycle Bin is emptied.
When we delete a file the deleted file is removed from its original location and is stored on another location (Recycle Bin), which means that the file is not yet permanently deleted.