I have created some Lambda functions on AWS for testing purposes (named as test_function
something), then after testing I found those functions can be used in prod env.
Is it possible to rename the Lambda function? and how?
Or should I create a new one and copy paste source code?
The closest you can get to renaming the lambda function is using an alias, which is a way to name a specific version of a lambda. The actual name of the function though, is set once you create it. If you want to rename it, just create a new function and copy the exact same code into it. It won't cost you any extra to do this (since you are only charged for execution time) so you lose nothing.
For a reference on how to name versions of the lambda function check out the documentation here.