I gave him up with some sadness, but I know he’ll be well taken care of with the neighbors.

Well I think it's for the best. Allergies don't go away unless you're no longer exposed to the source of the allergy. Plus you won't be able too actually take good care of the cat because of that.