Niki. XDA has Windows Mobile and it doesn't have any recycle bin. If the files are deleted, there is no way you can get them back. Make it a habit to put a backup in your desktop.
For softwares, go to
FreewarePPC.com - Freeware Pocket PC: the one and only site for downloading freeware files for Pocket PC handhelds.. They have hell lot of freewares for Windows mobile.