perf(add_files): stream manifest entries for duplicate-files check#3287

laichunpongben wants to merge 6 commits intoapache:mainapache/iceberg-python:mainfrom

laichunpongben:fix-add-files-dup-check-perflaichunpongben/iceberg-python:fix-add-files-dup-check-perfCopy head branch name to clipboard