new feature: s3 conditional copy & delete

[jachewz]

Feature Description

s3 now supports If-None-Match and If-Match headers for CopyObject and If-Match for DeleteObject. OpenDAL s3 service doesn't support this yet.

https://docs.aws.amazon.com/AmazonS3/latest/userguide/conditional-requests.html

Problem and Solution

• Add the copy_with_if_not_exists capability to s3 and implement adding the If-None-Match: * header.
• Define new copy_with_if_match capability and add to s3 and implement it
• Define new delete_with_if_match capability and add to s3 and implement it

Additional Context

No response

Are you willing to contribute to the development of this feature?

• Yes, I am willing to contribute to the development of this feature.

[Xuanwo]

Nice idea!

[sksingh2005]

Can i contribute to this issue ??

[YuangGao]

Looks like the PR #7600 (@dentiny) covered the copy pieces (copy_with_if_not_exists + copy_with_if_match).

The remaining delete_with_if_match is still open, I would like to pick it up

[dentiny]

Looks like the PR #7600 (@dentiny) covered the copy pieces (copy_with_if_not_exists + copy_with_if_match).

I think s3 also supports conditional copy with check on source object

[YuangGao]

Looks like the PR #7600 (@dentiny) covered the copy pieces (copy_with_if_not_exists + copy_with_if_match).

I think s3 also supports conditional copy with check on source object

yes — x-amz-copy-source-if-{match,none-match,modified-since,unmodified-since} is for the source-side

Looking at the CopyObject API request syntax, it treats these as two distinct sets of headers (destination-side If-Match etc. vs source-side x-amz-copy-source-if-*)

should we expand this isssue's scope to cover source-side too, or track it as a new issue? happy to take it on after #7607 merges.

[dentiny]

should we expand this isssue's scope to cover source-side too, or track it as a new issue?

I personally think it's better to track in this issue :)

[dentiny]

happy to take it on after #7607 merges.

Doesn't seem to be related to delete, might go in paralle