Skip to content

Rework creation of zips from subset of WARCs - #28

Merged
lfoppiano merged 9 commits into
mainfrom
fix/repackaging-with-metadata
Oct 18, 2026
Merged

lfoppiano merged 9 commits into
mainfrom
fix/repackaging-with-metadata

Conversation

@lfoppiano

Copy link
Copy Markdown
Collaborator

This PR reframe the #14 correction on the usage of warc2zip to create zips from subset of WARCs

@lfoppiano lfoppiano mentioned this pull request Oct 12, 2026
5 tasks done
@lfoppiano lfoppiano linked an issue Oct 18, 2026 that may be closed by this pull request
5 tasks done

@wumpus wumpus left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The one comment I have is that the examples of using --select should start off with "load the manifest.csv file into a spreadsheet and do whatever you want to write out a csv with just the subset of rows that you want"

The audience for this tool is not "people who use awk or miller"

@lfoppiano

lfoppiano commented Oct 18, 2026 •

Copy link
Copy Markdown
Collaborator Author

Thanks! I added a note and made a much simpler and smaller example for bash lovers, in case they decide to use bash/awk/miller.

@lfoppiano
lfoppiano merged commit 76fbb39 into main Oct 18, 2026
27 checks passed
@lfoppiano
lfoppiano deleted the fix/repackaging-with-metadata branch October 18, 2026 15:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

FIXME all the FIXME in README.md

2 participants