OpenDAL #433

[joepio]

TODO:

• Fix compile issue with OpenDAL
• Deal with async stuff (or make entire atomic_lib async Async support for atomic-lib #12 )

PR Checklist:

• Funcionally ready
• Link to related issues: consider alternative KV store #433 Feature: Atomic Server can store blobs on S3 compatible storage - like AWS S3, Cloudflare durable objects #543
• Add changelog entry linking to issue, describe API changes
• Add tests (optional)
• (If new feature) add to description / readme

[AlexMikhalev]

If it is still relevant, I stored it in atomic using Opendal. Do you want any help progressing it?

[AlexMikhalev]

@joepio I think it's an excellent idea and worth progressing. For collections API, check out the code https://github.com/jinyus/related_post_gen/blob/main/rust_con/src/least.rs#L25. This is a highly optimised data structure for fetching related items; I will reuse it, too; at the same time, if open dal service supports high-performance queries - i.e. Redis you will be able to offload heavy lifting to the service.