All Questions
20
questions
0
votes
0
answers
164
views
ffmpeg stream image flow to AWS S3
For a video monitoring solution, I want to push thumbnails of an incoming video (TS/UDP) to a S3 bucket from where those thumbnails are shown on a web page
Currently the following bash loop is working:...
3
votes
0
answers
380
views
How to use AWS S3 for linux file system backup?
As many who have used AWS S3 realize, it isn't a file system, but everything in the bucket is an object. While using the aws cli to do backups of a Linux server to S3, it doesn't preserve the ...
- 557
0
votes
1
answer
230
views
Cannot seem to access s3 bucket for training after mounting onto ec2 instance
I am using data on a s3 bucket for deep learning purposes. I mounted the s3 bucket onto ec2 instance using How to Mount S3 bucket on EC2 Linux Instance - Cloudkul.
When I cd into my local directory ...
- 1
1
vote
1
answer
3k
views
S3FS ownership and permissions
I am trying to mount a S3 bucket to my local machine using secret password key with the following command:
s3fs mybucket /mnt/mybucket -o allow_other -o umask=0000,uid=$UID -o use_cache=/tmp -o ...
- 111
0
votes
1
answer
1k
views
Linux - How to disable disk cache for a specific mount point?
Is it possible to disable disk cache for a mount point on Linux system?
I have a s3fs mount on multiple systems and i need to disable disk cache for it. how can i achieve this?
0
votes
0
answers
726
views
goofys mount point on multiple linux systems
I have a Minio bucket which is mounted on three different linux systems. the problem is when a file changes on one of mount points but file size doesn't changes that change doesn't get reflected on ...
2
votes
2
answers
6k
views
copy specific files from s3 bucket
I have some files in s3 bucket.
aws s3 ls s3://bucketname/
file-111-100x100.jpg
file-112-1400x1400.jpg
file-123-250x250.jpg
file-231-1400x1400.jpg
file-222-700x700.jpg
file-333-100x100.jpg
file-131-...
- 63
0
votes
2
answers
152
views
Centralizing data AWS
I want to centralizer about 1TB of data in AWS for 3 on premise locations (5 users each location). We are going growing but still small. Each location has a 30/5mpbs connection. Each has its own Linux ...
- 644
0
votes
0
answers
678
views
Tar a very large file directly to a drive
I was running my code to download some data on the Amazon cloud. The instance that I was running had an 8GB storage that I had bought with it plus 140GB extra instance storage (sort of plugged in as a ...
- 31
2
votes
1
answer
175
views
Where are these S3 requests coming from?
I've recently been working to create a CentOS 6.4 Amazon machine image (AMI) from scratch to be used as a base image for running Postfix email services on EC2. In my quest to learn the process, I ...
- 31
0
votes
1
answer
47
views
How to know what are in a file and what aren't in another?
I doing a nrpe check for my nagios about the files that I backup, sending to Amazon S3.
I have two files then, s3, which list all my files that are in Amazon already. And local which list all my files ...
- 1,381
1
vote
4
answers
6k
views
How sync files with s3cmd to Amazon S3, check if sent and remove locally?
I'm trying to use Amazon S3 service to store logs from my applications.
Given /user/bin/s3cmd --help tells me what I need to know how send the files:
s3cmd --help
usage: s3cmd [options] COMMAND [...
- 1,381
1
vote
3
answers
924
views
Initiate restore of directory hierarchy in Glacier to S3?
Using software that runs under Linux, is there a way to initiate a restore from Glacier to S3 of an entire directory hierarchy? The files are transferred to Glacier using a S3 bucket lifecycle rule.
...
- 30k
4
votes
1
answer
4k
views
How can I download a copy of an S3 public data set?
i was naively assuming I could do something like
s3cmd sync s3://snap-d203feb5 /var/tmp/copy
but I seem to have the wrong idea of how to go about this. I cannot even get a simple thing to work;
...
- 3,231
3
votes
0
answers
721
views
s3fs gives me an empty directory
I built s3fs, and now I'm getting an empty directory where I mounted the s3 bucket. I put a text file in the directory, and I can see it in there, and it transfers into the bucket. How can I see the ...
- 211