Skip to main content

All Questions

Tagged with
0 votes
1 answer
340 views

How to safely upload many GB of data to Amazon S3?

I am backing up my personal photo/video library to Amazon S3 (several hundred GB). I am currently using Cyberduck on my Mac to drag & drop, but I've already had a few fail without a clear retry/...
Andrew's user avatar
  • 15.1k
10 votes
3 answers
11k views

How to upload big files to S3 on a flaky connection?

I have a bunch of files (between 500MB and 7GB) that I need uploaded to an S3 bucket. My connection is very flaky. I tried uploading a 500MB file via s3cmd but it timed out after it was 91% done (...
user2254's user avatar
  • 663
0 votes
3 answers
2k views

Upload very many files to S3

I have about 1 million images (organized in directories) that I need to get into S3. I started using s3sync.rb, but since it is built for syncing it creates tons of extra files for keeping track of ...
therealsix's user avatar
85 votes
7 answers
159k views

Uploading files to S3 account from Linux command line

I've got several large files sitting in my Linux hosted account that I need to upload to my S3 account. I don't want to download them first and then upload them into S3. Is there any way I can "...
siliconpi's user avatar
  • 2,777