Questions tagged [amazon-s3]
Amazon S3 (Simple Storage Service) is a web service which provides storage and various interfaces for accessing data stored there.
174
questions
1
vote
1
answer
3k
views
Sonatype Nexus: How to create Blob stores using Amazon S3?
I try to create a blob stores on Sonatype Nexus as below:
Then, I'm getting this error:
Unable to initialize blob store bucket: s3jenkins-cache, Cause: Unable
to execute HTTP request: Connect to
...
- 11
0
votes
0
answers
72
views
AWS S3 Upload Broken Up
perhaps this is my own misunderstanding of how AWS CLI works, but I uploaded a converted qcow2 VM image converted to a .raw using the AWS CLI. It took about 6 hours to move the 128GB file. I let it ...
0
votes
1
answer
75
views
Is there an industry standard tool available which parses s3 files and loads them to database tables?
I have text files of multiple content formats on s3 buckets.
The simplest format had delimited content as dhwon below:
Field1|field2|field3|field4
I would like to parse the above delimited file and ...
- 11
3
votes
0
answers
380
views
How to use AWS S3 for linux file system backup?
As many who have used AWS S3 realize, it isn't a file system, but everything in the bucket is an object. While using the aws cli to do backups of a Linux server to S3, it doesn't preserve the ...
- 557
1
vote
1
answer
3k
views
I am trying to use a kms key alias in a bucket policy
I am using the following bucket policy:
{
"Version": "2012-10-17",
"Id": "Policy1566337631537",
"Statement": [
{
"Sid": "Stmt156",
"Effect": "Deny",
...
- 11
1
vote
1
answer
11k
views
Get all files (or file names) out of s3 bucket for specific date
I need to get all the files from yesterday from the s3 bucket, i know how to do this in the CLI when i know the file name:
#aws s3 cp s3:{Path}/{FileName} {diretoryToCopyTo}
but how would I do this ...
- 111
2
votes
1
answer
885
views
Can i trigger an AWS lambda function when a sagemaker labeling job is completed using CloudWatch events?
I'm new using CloudWatch events and I'm trying to create an event rule that triggers a lambda function when a Sagemaker Ground Truth Labeling Job is completed.
It seems to me that this is possible, ...
0
votes
1
answer
230
views
Cannot seem to access s3 bucket for training after mounting onto ec2 instance
I am using data on a s3 bucket for deep learning purposes. I mounted the s3 bucket onto ec2 instance using How to Mount S3 bucket on EC2 Linux Instance - Cloudkul.
When I cd into my local directory ...
- 1
0
votes
1
answer
576
views
Source url prefix appended to destination url when using CloudFront and S3 AWS
I am trying to redirect a url, example.io, to www.example.org/survey/imagine.
Currently, my S3 bucket handles redirection with the following redirection rules:
<RoutingRules>
<RoutingRule&...
0
votes
1
answer
332
views
Serving tar.gz file through AWS Cloudfront?
I would like to keep things tidy on the S3 bucket where my website's assets live.
Currently I am uploading all assets to S3, as part of the CI/CD pipeline, this has got a bit messy since generated ...
- 101
0
votes
0
answers
582
views
Bash completion not working for 'aws cli' after installed via brew
After I use brew to install aws cli, here is the message form brew:
==> awscli
The "examples" directory has been installed to:
/usr/local/share/awscli/examples
Bash completion has been ...
- 5,088
1
vote
1
answer
3k
views
S3FS ownership and permissions
I am trying to mount a S3 bucket to my local machine using secret password key with the following command:
s3fs mybucket /mnt/mybucket -o allow_other -o umask=0000,uid=$UID -o use_cache=/tmp -o ...
- 111
0
votes
1
answer
1k
views
AWS ACCESS KEY ISSUE
I accidentally pushed my access keys up to github and amazon contacted me with instructions on "fixing" the issue. I messed up and accidentally deleted the access key, thinking thats what i was ...
1
vote
1
answer
111
views
How do I set up DNS, AWS S3, AWS Cloudfront, and AWS Certificate Manager to secure multiple sites
I am trying to secure multiple static AWS S3 websites delivered via AWS Cloudfront CDN with one certificate.
This AWS article says I should be able to do this, but it's not working.
One is a web-app,...
- 111
3
votes
1
answer
1k
views
Nginx SSL Preread Sporadically Gets Requests Where No Server Name Is Extracted
I am using the nginx stream module to leverage nginx as a tcp reverse proxy in front of s3. Recently, I needed to add logic to accommodate an additional upstream. To do this, I chose to make use of ...
- 143