AWS S3 Storage with pre-signed URLs

[sylr]

Hi,

I think it would be great if, instead of uploading encrypted data to privatebin which then uploads it again to S3, we could have privatebin use Pre-signed URL so that the client uploads directly to S3, e.g.:

sequenceDiagram
    WebUI->>+WebUI: User clicks on create button
	WebUI->>+PrivateBin: WebUI requests pre-signed URL
    PrivateBin->>+S3: Creates a pre-signed URL
    S3->>-PrivateBin: Returns a pre-signed URL
    PrivateBin->>-WebUI: Returns a S3 pre-signed URL
    WebUI->>S3: Uploads encrypted data to pre-signed URL

Loading

The point of this is to be able to upload large files which don't have to travel through PHP and the memory limits it may have.

Regards.

[rugk]

If you can implement it and want to do so, feel free. I guess nobody has anything against this idea in principle, except maybe that it leaks metadata to Amazon… (and if this feature exists on Amazon S3 – a link to the docs from them instead of only the mermaid sequence diagram would be helpful.

However, note that such storages like the S3 storage are purely community contributions and we cannot provide feature maintenance for them:
https://github.com/PrivateBin/PrivateBin/blob/master/lib/Data/S3Storage.php

Thus, I'd ping previous contributors to that S3 topic: @fenak (Felix J. Ogris as the original contributor seems to have deleted his GitHub account)

Also BTW, to gather more interest discussions may not be thing. If you want, create an issue from it. At the right side on GitHub you should have a button to do that: Create issue from discussion

[sylr]

Relevant links:

• https://docs.aws.amazon.com/AmazonS3/latest/userguide/using-presigned-url.html
• https://github.com/awsdocs/aws-doc-sdk-examples/blob/main/php/example_code/s3/PresignedPost.php

[rugk]

Another thing: Technically though you would still need to store some metadata (or maybe better all, as otherwise more metadata would leak to Amazon) on the PrivateBin instance itself. And to retrieve it again you obviously also need to store "something". I don't know which order is suggested here, though.