Getbhavcopy: Free NSE and BSE data downloader

First of all I would like to apologise all the members of Getbhavcopy community for the delays caused in addressing your issues. I have been really very busy these days with my office work that I am unable to dedicate any time to address your woes.

Saying that, I am really impressed with the way community members are coming together to help each other out. I never expected Getbhavcopy to become so popular.

Mr. MurthyMSR (who has been a long time supporter) has made a very good post consolidating the issues faced by users and the some ideas how he got it to work. I am converting that post into a blog for all users.

The download problems refrerred to occur quite often, and can be minimized if not totally avaoided by following just ONE simple rule.

The errors reported could be because of one or more reasons like the ones given below. I too faced these problems as reflected in the various logs posted. Now-a-days, such occurances are very rare for me. But once they occur, the solution lies in just trying again after some time.

Possible reasons could also be one or more of the following.

• Your net connection may be slow or not connected.
• When you press the download button, the program checks if your installed version is the latest by checking with the GetBhavCopy site. If your version is old, you will be prompted to update to the latest version and download will  not be attempted. But if the GBC site is down, this can produce an error.
• One of the varous links by which you are connected to the resource may be down.
• NSE & BSE sites may be down or the destination uRL's may not be updated or too many people arew requesting for that information beyond the capacity limits set within the servers.
• And may be some more, I am not able to visualize.

All these reasons are external to the GBC program. Of course GBC has some issues to be sorted out but none of these.

Please note:

• GBC fetches data from NOT ONE but, MANY sources (addresses) within NSE & BSE web sites.
• All these souces are updated at the same time.
• The first source (Bhav Copy) may be ready by 6:30 PM but all other sources take a few hours more.
• After observong this phenomenon of failure for many weeks/months. Now-a-days, I download only after my dinner before going to bed, i.e., after 10 PM.
• I consider a download successful when ALL repeat ALL the data is downloaded completely. This includes:

• NSE stock Bhav copy, stock open interest, each of the NSE indices, their volumes,
• NSE futures bhav copy
• BSE stocks, each of the BSE indices

• I checked the completeness by veryfying data in each of the above categories manually initially and later by AB.

• This completeness of data can be checked with AB as below after importing the downloaded data into AB.

• Run AB >> Tools >> Database purity ...
• Select a very actively traded NSE stock like Reliance.as reference symbol.
• Deselect all check boxes on the left side EXCEPT 'Report missing quotes'
• On the right side, within the  'Apply to' box, select "All symbols" and quotes Last n= , by this you are checking if any quotes are missing in todays bhav copies of NSE & BSE by comparing it with the NSE stock 'RELIANCE'
• If the list of missing quotes you find only some very thinly traded stocks and do NOT find any Index, you may consider the download complete.
• Repeat this excesize this time by taking an actively traded BSE stock like reliance by it's  numerical code.
• Again if the list of missing quotes you find only some very thinly traded stocks and do NOT find any Index, you may confirm that the download complete.

• I have done this excercize many times and found that the download is complete.

You also may do this excercize to get that confidence about the data completion.

FOR AN ERROR FREE AND COMPLETE DOWNLOAD, DO IT AFTER 10 PM . 90% CHANCE THAT THE DOWNLOAD IS ERROR FREE. OTHERWISE, REPEAT AFTER 5 MINUTES.

YOU WILL BE THROUGH WITH THE DOWNLOAD ERROR FREE AND COMPLETE.

( sorry for caps)

If you are further keen, do the AB database purity check as outlined above to get confidence in what all I said. If you still get errors, then report at this forum for help by the developer.

Hope my observations will be helpful at least some people.

I am also a user like you, not connected with GBC program in any way. I too faced many problems & irritations like the ones mentioned by you  and found that this is the way to get the best of GBC.

I request hemen to go through this post offer his comments on the contents. I feel that the error log may contain messages in plain English that point out the problem in a way a normal investor/trader ( not familiar with the technical jargaon like '404 not found,.)  can easily understand.

I am using GBC without errors and hope that everybody too gets it that way.

Thanks to hemen for this program.

murthymsr

Regards.

Thanks a lot sir.

I will provide my consolidated analysis in the Part 2 of this post over this weekend.

Once again sorry for the inconvenience and thanks for sticking by.