Getbhavcopy: Free NSE and BSE data downloader

Blog

Getbhavcopy version 2.1.0a released

Posted on February 16, 2010 at 9:52 AM

Update: Version 2.1.0 has been released. Please refer to the release post


There is not much activity on the forums these days. May be everyone is really busy like I have been over the past few weeks (causing me to delay this release which i promised to do on 31 Jan). Anyway, i hope this new release spices things up a bit.


First of all I would like to draw your attention to the 'a' after the version number for this relese. If you noticed, none of the earlier releases had that. The 'a' stands for Alpha Release, which means that this is not a stable release (also called as a Release Candidate). In other words this release is not tested fully.


There are considerable new features that have been implemented, but I cannot test all of them in different environments that Getbhavcopy may be subjected to run. Hence there could be some potential bugs or issues that you can notice. This is more of a test version (or an early peek) to get your feedback to improve Getbhavcopy.

 

 

What's new ?


NSE futures data download.


Most of you have been asking for this for a long time, so here is the much needed feature for you. Both FUTIDX and FUTSTX data is downloaded for near, next and far series. Userdefined symbols can be added to these series. By default -I, -II and -III are appeneded to the symbols respectively. The cycles will also rollover to the previous ones providing a continuous chart for analysis.


Support for Proxy authentication to avoid 407 errors.


This is totally untested and I really need help of those who are behind proxy to test this. Plese post your findings in the forums.

 

Multithreading support.


Have you observed Getbhavcopy UI kind of hanging when it is downloading data? Well not any more as now the UI update and data download threads are different.


NSE Indev volume calculate option.


NSE Indices data has now started providing volume information too. This was not available earliler, hence Getbhavcopy used to calculate it. Now you have the option to avoid this calculation which results in less data to be downloaded (so faster download). However NSE may turn it off anytime (as seen in past) so you still have the option to enable calculation to go back the old way.

 

VIX data download.


NSE VIX data will also be downloaded.


New Options form


The Options form has been removed from the main download window and converted into a wizard kind of the form. You need to click the Next button from all tabs till you reach the final tab that provides the Save option.


Download


The download link is on the Getbhavcopy Download page. Check the Alpha Release section.


Install Instructions


To install download the zip file and read the Readme.txt file in the zip for more details. It contains very important points that should be read first before using the alhpa version (even for the seasoned Getbhavcopy users)


Donation


Finally, the donations have really dried up. Haven't recieved anything since past two months. So guys please tend to donate something, it really helps keeping me motivated.



Finally, test this version and report your issues on Forums. Also mention the Getbhavcopy version henceforth when posting in forums as there are two active versions now.


The current stable version 2.0.7 will continue to work till this becomes stable


Categories: Version Updates

Post a Comment

Oops!

Oops, you forgot something.

Oops!

The words you entered did not match the given text. Please try again.

You must be a member to comment on this page. Sign In or Register

37 Comments

Reply SATISH KHANNA
10:18 AM on February 08, 2012 
Dear Hemenji,
I AM USING ADVANCE GET AND HAVE NO PROBLEM WITH NSE. BUT WHEN USE BSE ,ADVANCE GET CANNOT SUPPORT MORE THAN 1800 SCRIPS IN ONE DIRECTORY. CAN YOU PLEASE ADVISE HOW CAN I SPLIT THE DOWNLOADED BSE DIRECTORY INTO TWO SUB DIRECTORIES, ONE WITH FIRST 1500 ROWS AND THE SECOND WITH BALANCE ROWS. CAN YOU PLEASE ADVISE THE SOLUTION ON MY EMAIL ADDRESS "skkhannathane@gmail.com" . THANKS.
Reply balvinder chandiok
02:25 AM on December 17, 2010 
Dear Mr. Kapadia,
I have downloaded Getbhavcopy Version 2.1.0a and have also been sucessfuly able to download NSE Equity data, however after importing data into amibroker, I am not able to chart any symbols, I am especially interested in Nifty Spot. Have followed all instructions as guided in your site. The error is "Not enough data available. To plot any chartatleast 3 data bars are needed, but there are only 0 bars in NSENIFTY."
I have downloaded data since 1/1/2009.
Please help....
Many thanks
balvinder
Reply Arvind
08:27 AM on November 01, 2010 
Sir
I am still unable to download NSE EOD data
Message Downloading NSE Equity Bhavcopy
Error Error downloading NSE Equity Bhavcopy file
Error The remote server returned an error: (403) Forbidden.
Message Downloading index data for NSENIFTY
Error Error sending Index Data HTTP POST for NSENIFTY
Error The remote server returned an error: (403) Forbidden.
Message Downloading index data for NIFTYJUNIOR
Error Error sending Index Data HTTP POST for NIFTYJUNIOR
Error The remote server returned an error: (403) Forbidden.
Message Downloading index data for BANKNIFTY

pl tell me what to do?
Reply ankit dargan
02:08 PM on October 26, 2010 
Hemen je namaskar,
SUB - DELIVERABLE VOLUME IN OI COLUMME NOT GETTING ADJUSTED WHEN SPLIT OF STOCK TAKEN CARE OFF IN NSE BHAVCOPY
i have been ur great fan since i started using getbhavcopy coz along with ohlc and volume it also fetches deliverable volume too in columme of OI which is a good add on
but recently i noticed a problem in deliverable volume data (in OI columme) during time of split of stock price as in amibroker ohlc and volume get adjusted in by split ratio option but deliverable volume in OI columme doesnt get adjusted
ex take instance GENUSPOWER
on 21-10-2010 stock close 263.5 volume 380154 OI(deliverable volume) 154677
got splitted on 22-10-2010 as 10:1
now i adjusted that split
thus what i got now is
21-10-2010 close 26.35 volume 3801540 OI(deliverable volume) 154677
thus thats the error that oi doesnt get adjusted i hope same error is
also happeneing while taking future OI also adjust as per split in amibroker
PLZ HEMEN JE TRY TO PROVIDE A RELIABLE SOLUTION TO THIS PROBLEM IN AMIBROKER
Murthymsr sir plz u also luk in this matter as u are one of the senior and most respectable member in getbhavcopy n traderjee also
Reply Kishan Bobba
10:32 AM on June 30, 2010 
Thanks a Lot Hemen.
Nice Job.
I can not explain in words how much you are helping me.
Reply sub2501
12:48 AM on June 23, 2010 
Finally dream come true-- I've used Gbcopy version 2.1.0a and till now no issues found, With humble request--- is it possible to select the expiry to download( like i dont want to download the far month quotes), and is it possible to extract the options in another folder for viewing.
Thanks for your valuable support..............
Reply preetinder singh
06:24 AM on May 22, 2010 
hello ,
I'm facing problem in downloading data from bhavcopy v2.1.0a version . will someone plz help me to overcome this error , I'll be very thankful to u.


05/21/2010 17:21:32 Message ********* Downloading Data for 14-01-2005 *********
05/21/2010 17:21:32 Message Downloading BSE Equity Bhavcopy
05/21/2010 17:21:32 Error Could not extract BSE zip file.
05/21/2010 17:21:32 Error Cannot find central directory
05/21/2010 17:21:32 Message Downloading index data for SENSEX
05/21/2010 17:21:33 Message Downloading index data for MIDCAP
05/21/2010 17:21:34 Message Downloading index data for SMLCAP
05/21/2010 17:21:35 Message Downloading index data for BSE-100
05/21/2010 17:21:36 Message Downloading index data for BSE-200
05/21/2010 17:21:36 Message Downloading index data for BSE-500
05/21/2010 17:21:37 Message Downloading index data for AUTO
05/21/2010 17:21:38 Message Downloading index data for BANKEX
05/21/2010 17:21:39 Message Downloading index data for CONSDURBL
05/21/2010 17:21:39 Message Downloading index data for CAPGOODS
05/21/2010 17:21:40 Message Downloading index data for FMCG
05/21/2010 17:21:41 Message Downloading index data for HLTHCARE
05/21/2010 17:21:42 Message Downloading index data for IT
05/21/2010 17:21:42 Message Downloading index data for METAL
05/21/2010 17:21:43 Message Downloading index data for OILGAS
05/21/2010 17:21:44 Message Downloading index data for POWER
05/21/2010 17:21:45 Message Downloading index data for PSU
05/21/2010 17:21:45 Message Downloading index data for REALTY
05/21/2010 17:21:46 Message Downloading index data for TECK
05/21/2010 17:21:47 Message Downloading index data for DOL-30
05/21/2010 17:21:48 Message Downloading index data for DOL-100
05/21/2010 17:21:48 Message Downloading index data for DOL-200
05/21/2010 17:21:49 Message Processing downloaded data
05/21/2010 17:21:49 Error BSE Processor cannot open temporary bhavcopy file
05/21/2010 17:21:49 Error Could not find file 'J:\new bhavcopy\temp\BSEbhav.gbc'.
05/21/2010 17:21:49 Message ********* Downloading Data for 17-01-2005 *********
05/21/2010 17:21:49 Message Downloading BSE Equity Bhavcopy
05/21/2010 17:21:49 Error Could not extract BSE zip file.

so plz help me to overcome this problem hemen.
Reply nitin123
07:50 AM on April 11, 2010 
Dear Hemen Sir,

i'm getting this message since last weak

"Error NSE Processor cannot open temporary bhavcopy file
Error Could not find file 'E:\DOWNLOADED DOCUMENTS\temp\NSEbhav.gbc'
so plz sir do smthing.....................

thanks
Reply MiniTrader
08:18 AM on April 05, 2010 
Been using the alpha version since the day it was made available.
Works perfectly fine, absolutely no issues encountered so far.
Many many thanks for the futures data, it works like a breeze.

Very much appreciate your efforts, sincere thanks once again.
Reply adesara
11:41 AM on March 28, 2010 
algaeginger@gmail.com says...
hi hemen,

i'm getting this message since 19th march

Try deleting all the files in TEMP folder in GetBhavcopy folder.


"Error NSE Processor cannot open temporary bhavcopy file
Error Could not find file 'E:\DOWNLOADED DOCUMENTS\temp\NSEbhav.gbc'

any fix that i need to install??

thanks
Reply adesara
08:33 AM on March 25, 2010 
Hemen appreciate your efforts in providing free help to techies. I have a small suggestion of including delivery(open Interest) data for BSE scrips also while you are working on the next version. I use http://www.bseindia.com/BSEDATA/gross/2010/SCBSEALLDDMM.zip (where DDMM is date and month)
link to download delivery data just in case you are not aware of the link. I suppose this should not be a difficult task as you are already doing this exercise for NSE data.
Reply algaeginger@gmail.com
12:26 AM on March 23, 2010 
hi hemen,

i'm getting this message since 19th march

"Error NSE Processor cannot open temporary bhavcopy file
Error Could not find file 'E:\DOWNLOADED DOCUMENTS\temp\NSEbhav.gbc'

any fix that i need to install??

thanks
Reply Gopi
10:07 PM on March 22, 2010 
i can't download EOD on 22-03-2010 please help
Reply vadlapatis
07:17 AM on March 13, 2010 
i still face proxy error
Message Downloading index data for NSEIT
Error Error sending Index Data HTTP POST for NSEIT
Error The remote server returned an error: (407) Proxy Authentication Required.
Reply avggeek
04:53 AM on March 03, 2010 
Hi Hemen,

Since you asked for feedback on using 2.1.0a behind a proxy, I thought I should comment.


I'm using 2.1.0a from behind a WinGate HTTP Proxy running on localhost. Proxy address was defined in the options as http://127.0.0.1:8080 with no username/password. I am currently doing a batch download from 02/01/2009 to 02/03/2010 and so far the download is going smoothly.

I encountered only 1 issue so far. See the log below:
03/03/2010 17:32:33 Message ********* Downloading Data for 02-01-2009 *********
03/03/2010 17:32:33 Message Downloading BSE Equity Bhavcopy
03/03/2010 17:32:40 Error Could not extract BSE zip file.
03/03/2010 17:32:40 Error Cannot find central directory
03/03/2010 17:32:40 Message Downloading index data for SENSEX
03/03/2010 17:32:47 Message Downloading index data for MIDCAP
03/03/2010 17:32:53 Message Downloading index data for SMLCAP
03/03/2010 17:32:56 Message Downloading index data for BSE-100
03/03/2010 17:33:01 Message Downloading index data for BSE-200
03/03/2010 17:33:03 Message Downloading index data for BSE-500
03/03/2010 17:33:06 Message Downloading index data for AUTO
03/03/2010 17:33:11 Message Downloading index data for BANKEX
03/03/2010 17:33:13 Message Downloading index data for CONSDURBL
03/03/2010 17:33:18 Message Downloading index data for CAPGOODS
03/03/2010 17:33:22 Message Downloading index data for FMCG
03/03/2010 17:33:24 Message Downloading index data for HLTHCARE
03/03/2010 17:33:28 Message Downloading index data for IT
03/03/2010 17:33:31 Message Downloading index data for METAL
03/03/2010 17:33:33 Message Downloading index data for OILGAS
03/03/2010 17:33:37 Message Downloading index data for POWER
03/03/2010 17:33:39 Message Downloading index data for PSU
03/03/2010 17:33:41 Message Downloading index data for REALTY
03/03/2010 17:33:43 Message Downloading index data for TECK
03/03/2010 17:33:45 Message Downloading index data for DOL-30
03/03/2010 17:33:47 Message Downloading index data for DOL-100
03/03/2010 17:33:49 Message Downloading index data for DOL-200
03/03/2010 17:33:52 Message Processing downloaded data
03/03/2010 17:33:52 Error BSE Processor cannot open temporary bhavcopy file
03/03/2010 17:33:52 Error Could not find file 'C:\Programs\getbhavcopy\temp\BSEbhav.gbc'.

One general comment - is it possible to allow me to directly click to a tab in the Options rather than using the Prev/Next buttons. For ex. if I want to change BSE Data settings, it's much easier to directly click thru to that option than going through General and NSE Options.

FWIW, I'm using 2.1.0a on Win XP SP2 and with Admin rights.
Reply Anand
08:29 AM on February 22, 2010 
Hemen says...
Hi Anand,

Can you log this in the forums and provide more details. Can you provide an explicit date when you see the discrepancy.


Hi,

The 'problem' seems to be in data for some days between Mar'09 to Jun'09. This is what I get for:

Reliance -I
=========
2 Jun 2009 RELIANCE-I,20090602,2263,2263,2263,2263,1,300
3 Jun 2009 RELIANCE-I,20090603,0,0,0,2263,0,300
4 Jun 2009 RELIANCE-I,20090604,0,0,0,2263,0,300
5 Jun 209 RELIANCE-I,20090605,0,0,0,2263,0,300
8 Jun 2009 RELIANCE-I,20090608,0,0,0,2263,0,300

Reliance - II
==========
4 May 2009 RELIANCE-II,20090504,0,0,0,1831,0,0
5 May 2009 RELIANCE-II,20090505,0,0,0,1831,0,0
6 May 2009 RELIANCE-II,20090506,0,0,0,1831,0,0
11 May 2009 RELIANCE-II,20090511,0,0,0,1831,0,0

Reliance - III
==========
26 Jun 2009 RELIANCE-III,20090626,0,0,0,1981.75,0,0
29 Jun 2009 RELIANCE-III,20090629,2190.1,2190.1,2190.1,2190.1,1,150


I hope the formatting remains intact while publishing the blog.
Reply Yk
12:46 PM on February 21, 2010 
Dear Hemen

Even upon being an Alpha its working like anything.
It's really a very good downloader!

Further it may be enhanced by incorporating provision of IEOD(cash segment) download which Google provide free.

Congrats man!!
Nothing can be better gift by you to small traders like us on Birthday of yours and GBC.
Reply Hemen
10:09 AM on February 20, 2010 
Hi Anand,

Can you log this in the forums and provide more details. Can you provide an explicit date when you see the discrepancy.
Reply Anand
03:42 AM on February 20, 2010 
Hi Hemen,

We traders could not thank enough for the efforts that you have put in. My heartfelt thank once again.

I downloaded the latest release and also downloaded data for few months. There seems to be some discrepancy in data, especially in months of May/June 2009 for all series. For example, Reliance-I on 3 June 2009 - open, high & low are 0 and close is 2263. I cross checked with the NSE BhavCopy and that has all datasets. Is it a generic issue or I am the only one to get this error ?

Just wanted to share my observation.
Reply JIgar
01:21 PM on February 18, 2010 
Hemen check this link for the alpha version

Hemen says...
Niraj,

On the Getbhavcopy download page the Alpha download link is just below the three mirror links for the current stable versions.

It has a highlighted text "Did you say Alpha ?"

Getbhavcopy runs on

Redesign_234x60

Google Search


Follow me on Twitter