Removing Old Teflon Tape

I moved into a new home (actually about 14 years old) and my wife wanted a new shower head. The instructions for the new device specify that it is attached without teflon tape, and it specifically instructs that any existing teflon tape must be removed before installing the new replacement shower head. I peeled off as much of the old teflon as possible, but there is still some of it down there in the pipe threads. I don't want to use anything metal to try to dig it out because I am afraid of cross-threading the existing pipe. Can anyone tell me if there is an approved way for a total amateur to get rid of old teflon tape?