When the arg cache already exists, we still need to increment n_to_py_child_args if this is an output argument.