All Questions
Tagged with amazon-s3 command-line
7
questions
1
vote
1
answer
1k
views
How does FFMpeg read from a remote s3 url
I'm intrigued how does FFMpeg read a video file from a remote url (for example, an aws s3 presigned url).
Does it download the file in chunks and then process it chunk by chunk?
Or does it download ...
- 123
0
votes
1
answer
569
views
Upload multiple files to S3 from stdin
I found the option to upload to S3 from stdin:
cat test.txt | aws s3 cp - s3://mybucket/test.text
But I have a tgz archive coming in via curl and containing multiple files. I want to write the ...
- 111
0
votes
1
answer
4k
views
Selectively uploading multiple folders to AWS S3 using CLI
I have around 50 folders, which contain subfolders, I want to upload the folders and subfolders to an S3 bucket, while keeping the subfolders structure.
I read I can use --include command multiple ...
- 179
1
vote
1
answer
11k
views
Get all files (or file names) out of s3 bucket for specific date
I need to get all the files from yesterday from the s3 bucket, i know how to do this in the CLI when i know the file name:
#aws s3 cp s3:{Path}/{FileName} {diretoryToCopyTo}
but how would I do this ...
- 111
2
votes
0
answers
605
views
AWS S3 CLI: sum bytes in all top-level prefixes with a single --query?
I have an S3 bucket with a bunch of top-level prefixes. I have a relatively inefficient way of summing the bytes across top-level prefixes:
Get the list of prefixes via aws s3 ls [bucket name], ...
1
vote
1
answer
462
views
How to copy a .zip from within a .tar to a given location without extracting entire .tar using AWS S3 CLI
OSX 10.11 - python3.5 or AWS CLI (or other tool?)
I have ~ 5,000 subdirectories within an Amazon S3 bucket, each subdirectory contains a single .tar. In each .tar it contains only one .zip, ~<1mb ...
- 113
85
votes
7
answers
159k
views
Uploading files to S3 account from Linux command line
I've got several large files sitting in my Linux hosted account that I need to upload to my S3 account. I don't want to download them first and then upload them into S3.
Is there any way I can "...
- 2,777