Math isn't concerned with what exists or not, circles doesn't exist in reality either. And infinity is useful, if we didn't have it we would need to reinvent it in a clumsier form, like "the limit if x goes to a very, very big number, bigger than anything you could name".