downloading file using python format becomes invalid

Question

hey i am trying to download stock data from the nse website of india

so i am using python for this

the link is

 import urllib
   urllib.urlretrieve("https://www.nseindia.com/content/historical/DERIVATIVES/2016/JAN/fo01JAN2016bhav.csv.zip","fo01JAN2016bhav.csv.zip")

but when i try to open the file that is downloaded it says that the

compressed zipped file is invalid  

when i try it normal download from the website by simply pasting the link the file that gets downloaded gets opened

link

https://www.nseindia.com/content/historical/DERIVATIVES/2016/JAN/fo01JAN2016bhav.csv.zip

so if i try using urllib 2 i get this

f=urllib2.urlopen('https://www.nseindia.com/content/historical/DERIVATIVES/2016/JAN/fo01JAN2016bhav.csv.zip')

Traceback (most recent call last):
  File "<pyshell#6>", line 1, in <module>
    f=urllib2.urlopen('https://www.nseindia.com/content/historical/DERIVATIVES/2016/JAN/fo01JAN2016bhav.csv.zip')
  File "C:\Python27\lib\urllib2.py", line 127, in urlopen
    return _opener.open(url, data, timeout)
  File "C:\Python27\lib\urllib2.py", line 410, in open
    response = meth(req, response)
  File "C:\Python27\lib\urllib2.py", line 523, in http_response
    'http', request, response, code, msg, hdrs)
  File "C:\Python27\lib\urllib2.py", line 448, in error
    return self._call_chain(*args)
  File "C:\Python27\lib\urllib2.py", line 382, in _call_chain
    result = func(*args)
  File "C:\Python27\lib\urllib2.py", line 531, in http_error_default
    raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
HTTPError: HTTP Error 403: Forbidden

how do i fix this ?

it happens for this link only i have tried downloading images from imgur and the code works fine

why is the http 403 error coming when i can normaly access it through my browser?

Answer 1

This link provides an example of what you want to do: https://stackoverflow.com/a/22776/6595777

Found another question regarding downloading zip files. Try this:

url = "http://www.nseindia.com/content/historical/DERIVATIVES/2016/JAN/fo01JAN2016bhav.csv.zip"
download = urllib2.urlopen(url)
with open(os.path.basename(url), "wb") as f:
    f.write(download.read())

I don't have commenting permissions yet so I'm posting as an answer. I can't browse to your link via https, http works though. Have you tried changing your link in your script to http?

It is possible that your script is downloading the error page that I get when trying to use https (ERR_SSL_PROTOCOL_ERROR.) This means that what you download will have the file name you specify (ending in .zip,) but it is actually html. This means it will give you the error that the zip file is invalid

Answer 2

hey i do not know why this is happening in urllib and urllib2 libraries but when i used the requests library

r = requests.get(url)
with open("code3.zip", "wb") as code:
    code.write(r.content)

it worked

this might be an indirect solution to my answer