Questions tagged [gsutil]
gsutil is a command-line program that allows you to store, share and manage data hosted at cloud-based storage providers.
gsutil
877
questions
0
votes
0
answers
44
views
Does gsutil cp use up local storage?
I am now copying a large file from a GCS bucket to Google Drive using a Colab notebook with:
from google.colab import auth
auth.authenticate_user()
project_id = 'my_project_id'
!gcloud config set ...
- 485
1
vote
0
answers
37
views
How to transfer file from someone else's gscloud bucket to google collab/python?
I have access rights to only a part of a google cloud bucket of another person. I can download the files from there to my desktop using terminal or using the bang(!) operator to get the files in my ...
0
votes
1
answer
23
views
Google Cloud Storage Signed URL not Accessible in HTML but Works in Browser
`I'm using Python with the Google Cloud Storage library to generate signed URLs for my objects in a bucket. These URLs are meant to be embedded in HTML to display images on a webpage. However, while ...
0
votes
1
answer
54
views
Error in executing gcloud commands in bash script in crontab
I have written a bash script that uses
gcloud command to activate service account and
gsutil command to move files to GCS bucket.
When I run the script using bash command, it executes well.But when I ...
- 85
1
vote
2
answers
210
views
gcloud storage cp is not working for larger files
I am trying to use gcloud storage cp command for copying large files to gcp bucket. The command is working fine for smaller files. But it gives permission issue for larger files.
gcloud storage cp ...
- 85
1
vote
2
answers
35
views
ipython installation on mac
I have uninstalled Anacond on mac. Now trying to install ipython using pip3.
When I try to install ipython, getting a prompt "User for us-central1-python.pkg.dev: ". This asks for user and ...
- 253
0
votes
0
answers
8
views
How we restrict service account to create/share docs in our domain only
How we restrict service account to create/share docs in our domain only ? we have few custom integration app with Google workspace to create docs/sheets, while create docs through apps, its default ...
0
votes
1
answer
101
views
Unable to download data from Google Cloud Storage to local directory using Google Cloud SDK Shell
Up until a year ago I was able to download folders and directories from my bucket on Google Cloud Storage, now I keep getting errors when I try to download using the same commands that previously ...
0
votes
1
answer
57
views
how to prepend value in content-disposition metadata for all files of GCP bucket wth gs util
I am having files in GCP bucket already uploaded and want to prepend "attachment" value for all files content-disposition property using gs utils.
Below command we have for updating property
...
- 27
0
votes
0
answers
70
views
Google Cloud Storage: How make a recursive copy with storage class filter
I currently have this command:
gsutil -m cp -R gs://myBucket /myDir
It copies all the content of a backup to a local directory, with all its objects and directory hierarchy. The problem is that I ...
0
votes
2
answers
175
views
How can a billing project be stated in Google's command line tool `gsutil cp` on Linux?
I have to use Google's gsutil to download data from a project with "Requester pays" enabled. This does not seem to be possible.
Two different options are suggested on the internet for this ...
- 2,128
0
votes
0
answers
54
views
What can I do to make the "gcloud beta interactive" feature work for the "gsutil" and "bq" commands in the Google Cloud SDK?
I installed "Google Cloud SDK". Afterwards I installed the "beta" component with the command "gcloud components install beta". Afterwards I activated the "gcloud ...
- 1
0
votes
0
answers
24
views
Gsutil does not work on gcloud, but localy works
Il'show you part of code. When i use in my python script, which get files from Firebase to download. Works everything fine
command = '''gsutil -m cp -r gs://mk-dev.appspot.com/"Images/Project/...
1
vote
2
answers
252
views
GCS - Secure Way to Authenticate to GCS From On-Premises Server
I am looking for the secure/recommended way to connect and perform actions on GCS.
Need:
We have files on an on-premises Linux environment that needs to be uploaded to GCS on a hourly basis. Newer ...
- 607
0
votes
0
answers
81
views
Resumable copying of a large file to GCS
I am copying a large (19Gb) file from the internet to Google Cloud storage using the method described here and here (I use GC shell https://cloud.google.com/shell). So far so good, but it is expected ...
- 3,549