Agreed, release the little Fence lizard. That is the best you can do for him. That way he can find a mate and make more lizards for you to enjoy outdoors
I have plenty here, and they are pretty chill little lizards, but better left in their natural habitat.