bash rm tout sauf

$ shopt -s extglob 
$ rm -- !(keepOnlyThisFile.txt)
Unsightly Unicorn