All Questions
Tagged with amazon-s3 amazon-web-services
80
questions
1
vote
1
answer
1k
views
How does FFMpeg read from a remote s3 url
I'm intrigued how does FFMpeg read a video file from a remote url (for example, an aws s3 presigned url).
Does it download the file in chunks and then process it chunk by chunk?
Or does it download ...
- 123
1
vote
1
answer
148
views
Connect to S3 Web Console with Access and Secret Key
Is it possible to authenticate in the Amazon S3 console (https://s3.console.aws.amazon.com) using an access key/secret key pair? It looks like it only accepts user credentials. If not, is there any ...
- 251
0
votes
1
answer
394
views
aws sync doesn't download the file and instead create an empty directory
The file I'm trying to download is:
s3://ont-open-data/gm24385_q20_2021.10/analysis/20210805_1713_5C_PAH79257_0e41e938/guppy_5.0.15_sup/align_unfiltered/chr19/calls2ref.bam
This is an open dataset. I ...
- 25
2
votes
0
answers
268
views
AWS S3 Bucket CORS Error
I have an amazon s3 bucket called cs-ia.
This is my CORS configuration:
[
{
"AllowedHeaders": [
"*"
],
"AllowedMethods": [
...
- 121
0
votes
2
answers
1k
views
make new objects in s3 bucket public by default
I have an s3 bucket in which the objects within it need to be made public, right now anytime I upload a new file I have to click on it and then click "make public using acl" I wonder if ...
- 113
0
votes
1
answer
139
views
What IAM policy is appropriate for gitlab S3 buckets when using KMS encryption?
I'm setting up GitLab with S3 storage backend and would like to use KMS to encrypt the buckets. I'd like to avoid giving out permissions broadly. I'm using terraform to provision these resources.
How ...
- 1,101
0
votes
1
answer
505
views
How to create AWS S3 key
I've set up an AWS S3 bucket, and it's working for transfers using the web UI, but I want to be able to use the "aws s3 sync" command. The only way I know how to use that command requires ...
- 147
1
vote
1
answer
267
views
Is there a way we can way to minimize or eliminate warning when a recipient receives an email from AmazonSES
When we are sending emails using Amazon SES from the application, recipients of the email are seeing warning messages like below:
I have tried to find possible things that we can do to avoid ...
- 11
0
votes
1
answer
53
views
Streaming file via HTTP to S3
Currently we have a function on one of our EC2 instances (running C# .NET) that, upon request, opens an HTTP connection to an external site (for the sake of argument, let's say https://www.example.com/...
- 101
0
votes
1
answer
651
views
Whitelist IP addresses for access to AWS S3 static web hosting
I have seen several references that use a Bucket Policy similar in structure to the following
{
"Version": "2012-10-17",
"Id": "Policy1607646663558",
...
- 3,835
0
votes
1
answer
569
views
Upload multiple files to S3 from stdin
I found the option to upload to S3 from stdin:
cat test.txt | aws s3 cp - s3://mybucket/test.text
But I have a tgz archive coming in via curl and containing multiple files. I want to write the ...
- 111
1
vote
1
answer
350
views
AWS Access Key Issue while accessing s3 bucket on Azure VM
I am trying to access AWS s3 bucket from Azure HDInsight Cluster VM. I generated new keys and added to .aws/credentials. "aws s3 ls" is working fine in Azure VM. If I do hadoop distcp or read a s3 ...
- 11
0
votes
0
answers
178
views
Download all S3 files uploaded within a given time period
I would like to all files uploaded to an S3 button within a given time period.
For all example, everything that was uploaded between 05-11-2017 and 07-11-2018.
Please note that due to the size of ...
- 101
0
votes
1
answer
4k
views
Selectively uploading multiple folders to AWS S3 using CLI
I have around 50 folders, which contain subfolders, I want to upload the folders and subfolders to an S3 bucket, while keeping the subfolders structure.
I read I can use --include command multiple ...
- 179
0
votes
0
answers
14
views
AWS Beanstalk s3 issue
I wanted to update a nodejs app and ruined my s3 server. Instead of updating properly from services -> elastic beanstalk, I deleted the .zip file on s3 and replaced it with a new one. I rebuilt my ...
