Questions tagged [amazon-s3]
Amazon S3 (Simple Storage Service) is a web service which provides storage and various interfaces for accessing data stored there.
174
questions
0
votes
1
answer
53
views
Streaming file via HTTP to S3
Currently we have a function on one of our EC2 instances (running C# .NET) that, upon request, opens an HTTP connection to an external site (for the sake of argument, let's say https://www.example.com/...
- 101
0
votes
1
answer
651
views
Whitelist IP addresses for access to AWS S3 static web hosting
I have seen several references that use a Bucket Policy similar in structure to the following
{
"Version": "2012-10-17",
"Id": "Policy1607646663558",
...
- 3,835
0
votes
0
answers
334
views
Why does s3.amazonaws.com respond with 400 Bad Request when I connect over telnet?
This is what my request looks like. I have confirmed that the end of line separator is CRLF:
telnet s3.amazonaws.com 80
GET / HTTP/1.1
Host: s3.amazonaws.com
User-Agent: Mozilla/5.0 (Windows NT 10.0; ...
- 101
0
votes
2
answers
213
views
Windows7 command prompt show number of objects as list from dir command
I'm using Windows7, and I want to know the number of files (or objects) for comparison to objects in Amazon S3 buckets. I'm not interested in size, as the size can differ between file types.
I want ...
- 1
0
votes
0
answers
192
views
GPG piping help for an S3 encrypted postgresql backup into RDS
I was wondering if there was a trick that I am missing.
I am trying to get an encrypted Postgresql backup dump from S3 -> decrypt it in GPG -> pg_restore into RDS.
However, I am not able to get ...
- 101
0
votes
1
answer
569
views
Upload multiple files to S3 from stdin
I found the option to upload to S3 from stdin:
cat test.txt | aws s3 cp - s3://mybucket/test.text
But I have a tgz archive coming in via curl and containing multiple files. I want to write the ...
- 111
5
votes
2
answers
10k
views
How to search for nested files in my S3 bucket?
I'm on the S3 Management Console and I see the instructions to type a prefix to search:
However, when I search, it only finds files in the current folder. Is there a way to search for files that ...
- 157
1
vote
1
answer
350
views
AWS Access Key Issue while accessing s3 bucket on Azure VM
I am trying to access AWS s3 bucket from Azure HDInsight Cluster VM. I generated new keys and added to .aws/credentials. "aws s3 ls" is working fine in Azure VM. If I do hadoop distcp or read a s3 ...
- 11
0
votes
0
answers
178
views
Download all S3 files uploaded within a given time period
I would like to all files uploaded to an S3 button within a given time period.
For all example, everything that was uploaded between 05-11-2017 and 07-11-2018.
Please note that due to the size of ...
- 101
0
votes
1
answer
4k
views
Selectively uploading multiple folders to AWS S3 using CLI
I have around 50 folders, which contain subfolders, I want to upload the folders and subfolders to an S3 bucket, while keeping the subfolders structure.
I read I can use --include command multiple ...
- 179
0
votes
0
answers
14
views
AWS Beanstalk s3 issue
I wanted to update a nodejs app and ruined my s3 server. Instead of updating properly from services -> elastic beanstalk, I deleted the .zip file on s3 and replaced it with a new one. I rebuilt my ...
0
votes
1
answer
51
views
Prepopulated AWS Access Key ID when creating a new profile?
A new counter-party has provided me with an AWS S3 Access Key ID
and a Secret Key so I can send files to them.
I was expecting to run
$ aws s3 configure
and enter those values when prompted.
...
- 1,163
1
vote
1
answer
85
views
Creating folders by file names
I'm trying to find a way to create a folder for every file in a directory. I then want to copy each file into its created folder. These files are currently hosted on AWS (S3).
So for example if I ...
1
vote
1
answer
2k
views
How to configure amazon S3 bucket for read-only access to host a static website?
I have a very small (static) website hosted on Amazon S3. Yesterday I received the following message, that had this subject line:
Notification of Amazon S3 buckets configured for public access
And ...
- 567
1
vote
1
answer
2k
views
Setting up a custom idp for AWS SFTP using Active Directory
I've been digging into setting up custom auth for AWS SFTP and it's one hell of a black hole. There's lot's of references to being able to use a custom idp, but no concrete examples.
We're using ...
- 13