I'm sorry, that doesn't make sense. It sounds like you are separated or divorced with visitation rights and you are asking about the location the child is returned to after a visit. At that point, you lost me. Can you explain the situation in a little more detail?
The court order that set up visitation rights should list anyone other than the custodial parent that can receive the child after your visit otherwise, never leave the child with anyone but the custodial parent. Any place that's convenient to both of you, like a friend's house is ok if the mother is there.
Child custody is about who has responsibility for anything that might happen to the child.