It's A Digital Disease!

The original post: /r/datahoarder by /u/biggunns2012 on 2024-08-08 11:20:07.

Hi!

I've been trying to download images from a website in full resolution, and the method I have found works for SOME of the URLs but not all, and I am struggling to figure out why, I guess it's something regarding encryption, but I'm not sure. The parts in bold are the key differences between the working and non-working URLs.

Site with example links:

https://heartbreakmanagement.com/curve/maria-k-66468

Here's a link where simplifying works:

https://bucket-prod-01.s3.eu-west-1.amazonaws.com/uploads/content/cfc8c15223fb5c0b1132a49fa31fecf6/talent/image/06f449d4fbcbff3c235d6dafc970b2b2**/4/5/**4592741-big.jpeg?X-Amz-Content-Sha256=UNSIGNED-PAYLOAD&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAY55CGH2VECWAZGTW%2F20240805%2Feu-west-1%2Fs3%2Faws4_request&X-Amz-Date=20240805T222257Z&X-Amz-SignedHeaders=host&X-Amz-Expires=259200&X-Amz-Signature=38d58544e4de38476118b80922dee7069b7fb0b867838bf031fba6bd4b59464a

You can simplify this link by removing the encryption part of it.

https://bucket-prod-01.s3.eu-west-1.amazonaws.com/uploads/content/cfc8c15223fb5c0b1132a49fa31fecf6/talent/image/06f449d4fbcbff3c235d6dafc970b2b2/4/5/4592741-big.jpeg

Further, you can change the file name from "big" to "original" in order to get the full sized image.

https://bucket-prod-01.s3.eu-west-1.amazonaws.com/uploads/content/cfc8c15223fb5c0b1132a49fa31fecf6/talent/image/06f449d4fbcbff3c235d6dafc970b2b2/4/5/4592741-original.jpeg

Here's a link where simplifying doesn't work:

For URLs with the variation /5/3/ and above the method used above doesn't work. I get an access denied error once I remove the encryption.

https://bucket-prod-01.s3.eu-west-1.amazonaws.com/uploads/content/cfc8c15223fb5c0b1132a49fa31fecf6/talent/image/06f449d4fbcbff3c235d6dafc970b2b2**/5/7/**5713802-big.jpeg?X-Amz-Content-Sha256=UNSIGNED-PAYLOAD&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAY55CGH2VECWAZGTW%2F20240805%2Feu-west-1%2Fs3%2Faws4_request&X-Amz-Date=20240805T222257Z&X-Amz-SignedHeaders=host&X-Amz-Expires=259200&X-Amz-Signature=9270a5fbb3ab98ef26899c3154305ddb4254fd9a1875e5343d9418e984793e13

Non working simplified link:

https://bucket-prod-01.s3.eu-west-1.amazonaws.com/uploads/content/cfc8c15223fb5c0b1132a49fa31fecf6/talent/image/06f449d4fbcbff3c235d6dafc970b2b2/5/7/5713802-big.jpeg

Does anybody know a method on how to work around this?

Thanks in advance!