Neither here nor there
Of no consequence either one way or the other.
This is a 16th century phrase and is first recorded in Arthur Golding's translation of The sermons of J. Calvin upon Deuteronomie, 1583:
"True it is that our so dooing is neither here nor there (as they say) in respect of God."
'As they say' in that quotation suggests an earlier origin.
See other phrases and sayings from Shakespeare.
See also, hither and yon.