Getbhavcopy: Free NSE and BSE data downloader

Dear Hemen,

Thanks for the latest version of GetBhavCopy, which adderessed some of my concerns.

I have a few feature requests, which you may think of incorporating where feasible.

1) Most of the NSE indexes are included, NIFTYMIDCAP50 also may be added.

2) Presently the indexes which are very important to assess the market are LOST in the croud of around 1200 NSE & 3000 BSE stocks. To help their easy location, user may be given the previlege to prefix the symbol with a special character like '^' or '~', as per his choice.

3) EOD and Intraday price performance go together while deciding on an entry or exit. To make things easy for the user, symbols may be the same in both. To start with, user may be given the facility to rename the indexes, not being too many. For stocks, option to choose Yahoo symbols as tickers may be given. A yahoo symbol is made by the first 9 or less characters of NSE symbol + ".NS".

4) Some users may be interested in NSE stocks only and some BSE stocks only. But both would like to have the indexes of both markets to get the real feel. Even an ONLY NSE trader cannot ignore the BSE sectorial indexes, as similar indexes are NOT available in NSE.

An option to download BSE indexes also along with NSE EOD data into the 'same file' and NSE indexes also along with BSE EOD data into the 'same file' is highly useful.

For any reason, if this is not possible, an option to download into a separate file may be considered. In that case, user will have to import two files into his database each day.

Thanks for your time and for the very stable and simple software, which is very stable.

murthymsr

Dear sir,

Thanks a lot for all your input. I will see which ones I can address in Getbhavcopy. i have a vision for the features I would like to implement in the future. There could be a possibility that my vision may not be in line with the features suggested. Moreover sometimes the architectural design of the software prevents from adding some features.

However, I liked the idea about adding the special character to the start of the index symbol .... hmm good one.

Dear Hemen,

I was downloading today the NSE Bhav data for the last 15 months. I got many errors. Copy of log for a typical day attached for a quick reference.

===================================

Message    *********  Downloading Data for 08-10-2008  *********
Message    Downloading NSE Equity Bhavcopy

Error    Error sending Index Data HTTP POST for NSENIFTY
Error    The remote server returned an error: (500) Internal Server Error.

Message    Downloading index data for NIFTYJUNIOR

Error    Error sending Index Data HTTP POST for BANKNIFTY
Error    The remote server returned an error: (500) Internal Server Error.

Message    Downloading index data for NSE100
Error    Error downloading index data for NSE100
Error    The remote server returned an error: (404) Not Found.

Message    Downloading index data for NSEMIDCAP
Error    Error downloading index data for NSEMIDCAP
Error    The remote server returned an error: (404) Not Found.

Error    Error sending Index Data HTTP POST for NSEIT
Error    The remote server returned an error: (500) Internal Server Error.

Message    Downloading index data for NSE500
Error    Error downloading index data for NSE500
Error    The remote server returned an error: (404) Not Found.

Error    Error sending Index Data HTTP POST for NSEDEFTY
Error    The remote server returned an error: (500) Internal Server Error.

Message    Downloading Deliverable Quantity(Open Interest) data
Message    Processing downloaded data

===================================

As can be seen, there were too many errors for the entire period mostly either (404) Not Found or (500) Internal Server Error and were relating to index data.

The EOD files were generated with all the stocks including OpenInterest.

In all the failure cases of indexes, the corresponding data is not found in the bhav copy.  It was a mystery and I am not sure if I have to download all the bhav copies again and I am not be sure if I will get all the data right this time.

I request you to suggest if I have missed out some thing. My OS is Vista and browser FireFox 3.0.7

These errors may be more to do with the NSE site, but this can happen again and anytime.

From my side, I feel that:

1) From within the program, all failed downloads may be retried a second time before declaring a failure.

2) If download of stock data and Index data can be selected separately for each exchange, the download of indexes can be repeated till success without much hastle.

3) It is very difficult to read the progress log. If each section log of a day's is presented in a single line with the failed ones shown in red will be of a great help for a quick glance.

 
I should add here that the program was running very smoothly and stably while downloadingthe data for about 15 months continuously. Thanks for making available such a nice program.

murthymsr

Dear Sir,

I know that you are pretty exeprienced in this field of Technical analysis so I am a bit confused as to why you had the need to download data for the past 15 months. That way you will have to adjust data manually for splits and bonus etc after importing it in to your TA software. If it was just because you wanted historical data in ASCII format then it is good news for you.

Now I have NSE and BSE historical data in both Metastock and ASCII format (links are in my signature below). That will save you some effort of download and adjusting the data.

Coming to the errors, the 404 Not found error will occur on the days when the markets were closed due to a holiday. For the 500 Internal server error, some error occured on the NSE server while processing the request. They are hard to debug as the issue happened on NSE side and I cant do much about it.

Hemen at 04:21PM on Mar 18, 2009

Dear sir,

Thanks a lot for all your input. I will see which ones I can address in Getbhavcopy. i have a vision for the features I would like to implement in the future. There could be a possibility that my vision may not be in line with the features suggested. Moreover sometimes the architectural design of the software prevents from adding some features.

However, I liked the idea about adding the special character to the start of the index symbol .... hmm good one.

Change of Name of Chart data file by adding " * " before the name in MetaStock or Downloader may serve the purpose of having it at the first  - instead of changing ticker.

Sunil