Getbhavcopy: Free NSE and BSE data downloader

Since there have been quite a few queries regarding RT intra-day data in these forums, I have decided to address the issue in a full length posting. Am no expert in this field by any means, yet I have done some research about this over a period of time for my own purposes which am going to present in this forum. Let me begin with the basics so that one can get a full understanding of this issue. Stock exchange servers including NSE upload data mostly in .csv format, while most TA software tools do not recognize this format. Thus many data service providers thrive in such a mutually beneficial ecosystem by filling in these gaps. When one has presumably invested around 40 or 50 k to get a tool like Metastock, ideally one can use such RT data providers as;

• e-signal
• Quote centre
• Viratech India
• Express India... etc etc

But since most of us small time traders are not as resourceful & mostly use free (or hacked) versions of these expensive TA tools, we cannot afford the services of these afore mentioned RT data providers who charge anywhere between 2000 to 5000 Rs per month for their services! NSE data on its server is (mostly) available for anybody to download at free of cost & yet these data service providers expect us to shell out a fortune for their services because they provide an interface between NSE server & TA software tools. GBC provides the same service for EOD data free of cost. But when it comes to RT data, there are a whole host of other issues, like continuous conversion of .csv data to Metastock format.

First things first, absolute real time data on NSE servers is not available for free but slightly delayed (a few seconds to 1 or 2 minutes) intra-day data is available on NSE servers for free and one can avail this data using sources such as Yahoo finance etc. At the very outset am making it clear that if you want absolute real time NSE data with no time lag what so ever then you have no option but to subscribe to one of those expensive data providers that I have already mentioned. In my experience (which is not much to boast about), slightly delayed data is good enough for taking intra-day trading decisions and this so called "delay" or "lag" hardly makes any difference at all because anyways one is using minute chart rather than tick chart if one is employing candlestick patterns for understanding price movements. So, if you are game for a slightly delayed RT data feed for your TA software, then read on...

Some of the free RT data providers;

• Quotetracker (about 1 to 2 minutes delay)
• QOD (about 2-3 minute delay... but not very user-friendly)
• RTQ downloader (about 3-5 minutes delay... uses Yahoo finance server so not 100% reliable)
• MyQuotes
• NSE downloader (hangs a bit every now & then)
• RTdata

etc etc (there are at least a dozen such products which you can find on the worldwide web)

Most of these tools come with an option of exporting the downloaded data continously to metastock (or Amibroker) format but again this whole process would add another bit of delay to your real time data. To sum it up, if a slight delay of about 2-4 minutes (on the whole) is ok then this solution is ideal for your RT data requirements. Please do remember that internet connection speeds (for downloading data), processor & cpu power of your comp (for converting data etc) also have significant effect on the delay of RT data feed.

If you want RT data without any delay & any hassles but at slightly cheaper rates then one can always contact any brokerage house (there are n number of small & medium brokers in the market) who are willing to provide NSE tick data for a monthly subscription ranging from 1200 to 3000 rs which also includes Metastock configuration for these RT feeds.

If you want to reduce all this delay and also get 100% reliable data at almost free of cost, then the best solution for you is to use your trading terminal tick data to feed your TA tools. Most desktop java based trading terminals like PIB, ODIN, TTA etc etc are fed with RT data from the NSE servers in almost absolute real time. The problem is that this data is encrypted so one cannot simply download and use it for purposes other than the applications provided by these online trading firms. You can simply ask your resource manager to configure metastock to their data feeds & they will usually oblige because anyways you are giving them good business in terms of brokerage every month, for instance the RM attached to me at IBULLS simply provided me with an interface to MS from their data feed at no extra subscription fee (it is another matter that now the whole RT data feed has gone haywire because I upgraded to MS 11). If for some reason this doesn't work out then one can just do the next best thing & that is... fetching the data from folders that PIB uses to store this RT data and seamlessly converting it to metastock format and storing it in another folder. For doing this there are again many tools available on the internet (if anybody is using PIB and needs them I can mail you) but I don't think it would be proper to post the urls in these forums. If you are comfortable with VB & .net then you can create your own tools too for these purposes.

Disclosure: I use PIB & I have paid a 1 time fee of 700 Rs for the same.

Yawwwwwnnnnnnn ... Am very sleepy now, but will continue this post again; sooner than later; with more information that I have to share with you all.

Please do post your comments, queries & suggestions

Good night for now & happy trading

I use PIB and I need PIB conveter to MS. But I have some quary.

 Is this converter fetching the data from folders with out any time delay?

 please mail me the URL ..It will be very help full.

THnanks in advance.

...Contd

NSE charges about 600 Rs/month for Real Time Level 1 data (capital markets + FnO). But the catch is that one has to pay roughly 30 Lakh Rs per annum as a fixed fee to avail such a service! If retail investor participation is to be improved then first thing that NSE should do is liberate this data from the clutches of deep pocketed brokers & service providers. NSE however does provide 2-5 minute snapshot (lag) data free of cost on its servers, the trick is to get it from third party (vendors) service providers to feed our TA tools. Most of those free data providers have already been discussed in the previous post so I won’t mention them again.

Another great method would be to hack esignal itself in order to get absolute RT data from the servers... I have not yet been able to achieve this, but for starters here is the direction that one has to take in order to achieve their ends

Application E-signal has two associated processes:

1. Winsig.exe is the application the user sees and initiates a connection to Winros.exe
2. Winros.exe provides the data from the backend Datalink Manager. This application is hard coded to listen on the local loopback.

The problem is two-fold:

The connection to the backend server from Winros.exe needs to provide a unique IP address.

Winros.exe listens on 0.0.0.0:2189 (binding to the NIC). This is hardcoded into the application.

Applications that bind to the NIC use the Virtual IP when configured.

(P.S: When Virtual IP and Virtual Loopback are configured together, the application listens on Virtual IP and not Virtual Loopback)

@ Pluto,

The smart thing for you to do is to ask your RM at IBULLS to provide connectivity gateway to Metastock through PIB, which should not be an issue because you do provide them decent enough business in terms of brokerage (if u r using PIB in the 1st place)

The other way of doing it, by fetching data from PIB folders on your HDD would definitely be delayed & the time lag depends on various factors (it could range from 2-5 minutes or even more in some cases)

Dear Praveen

Hats off to u for such an exhaustive texts on RT feeds.

Now i would never ask u for any RT data provider

Really appreciable!

...Continued

Here is the final summary for all of you.

First, the conditions;

1. If you do not want to spend a couple of thousand Rs every month to subscribe to those expensive RT data service providers
2. If you want RT data that is not compromised & of high integrity
3. If you use Trading terminals like TTA, ODIN or PIB, but for some reason your RM has refused to provide a connecting tool to Metastock or Amibroker
4. If you cannot tinker with your tools by doing some reverse engeneering & connecting the trading terminal data feed to MS yourself
5. If you do not mind paying a small amount of about 500 Rs every month
6. If you do not have issues with slightly delayed RT data feeds starting from 30 seconds to 180 seconds
7. If the answer to all the above conditions is "yes"...

... Then below are the 2 RT datafeed products that you can try (both can be evaluated for a trial period of 15 days)

RealTimeDataExpress (RDE) >>> Has a very good user interface, is very stable & does the job almost flawlessly... I have used it myself

TrueDataIndia (TDI) >>> Also very stable with good user interface Iam told... I haven't used it myself.

(You can simply search them on google & download them, they are very easy to install)

Concluded

An excellent post.

Thanks a ton for guiding us newbies in the right direction.

Thank You Once Again    ;-)

great post man!

very informative nd comprehensive !

good job, keep it up

Great post. very informative. Deserves a sticky.

Praveen patil at 03:30PM on Oct 28, 2009

Since there have been quite a few queries regarding RT intra-day data in these forums, I have decided to address the issue in a full length posting. Am no expert in this field by any means, yet I have done some research about this over a period of time for my own purposes which am going to present in this forum. Let me begin with the basics so that one can get a full understanding of this issue. Stock exchange servers including NSE upload data mostly in .csv format, while most TA software tools do not recognize this format. Thus many data service providers thrive in such a mutually beneficial ecosystem by filling in these gaps. When one has presumably invested around 40 or 50 k to get a tool like Metastock, ideally one can use such RT data providers as;

 

• e-signal
• Quote centre
• Viratech India
• Express India... etc etc

But since most of us small time traders are not as resourceful & mostly use free (or hacked) versions of these expensive TA tools, we cannot afford the services of these afore mentioned RT data providers who charge anywhere between 2000 to 5000 Rs per month for their services! NSE data on its server is (mostly) available for anybody to download at free of cost & yet these data service providers expect us to shell out a fortune for their services because they provide an interface between NSE server & TA software tools. GBC provides the same service for EOD data free of cost. But when it comes to RT data, there are a whole host of other issues, like continuous conversion of .csv data to Metastock format.

 

First things first, absolute real time data on NSE servers is not available for free but slightly delayed (a few seconds to 1 or 2 minutes) intra-day data is available on NSE servers for free and one can avail this data using sources such as Yahoo finance etc. At the very outset am making it clear that if you want absolute real time NSE data with no time lag what so ever then you have no option but to subscribe to one of those expensive data providers that I have already mentioned. In my experience (which is not much to boast about), slightly delayed data is good enough for taking intra-day trading decisions and this so called "delay" or "lag" hardly makes any difference at all because anyways one is using minute chart rather than tick chart if one is employing candlestick patterns for understanding price movements. So, if you are game for a slightly delayed RT data feed for your TA software, then read on...

 

Some of the free RT data providers;

 

• Quotetracker (about 1 to 2 minutes delay)
• QOD (about 2-3 minute delay... but not very user-friendly)
• RTQ downloader (about 3-5 minutes delay... uses Yahoo finance server so not 100% reliable)
• MyQuotes
• NSE downloader (hangs a bit every now & then)
• RTdata

etc etc (there are at least a dozen such products which you can find on the worldwide web)

 

Most of these tools come with an option of exporting the downloaded data continously to metastock (or Amibroker) format but again this whole process would add another bit of delay to your real time data. To sum it up, if a slight delay of about 2-4 minutes (on the whole) is ok then this solution is ideal for your RT data requirements. Please do remember that internet connection speeds (for downloading data), processor & cpu power of your comp (for converting data etc) also have significant effect on the delay of RT data feed.

 

If you want RT data without any delay & any hassles but at slightly cheaper rates then one can always contact any brokerage house (there are n number of small & medium brokers in the market) who are willing to provide NSE tick data for a monthly subscription ranging from 1200 to 3000 rs which also includes Metastock configuration for these RT feeds.

 

If you want to reduce all this delay and also get 100% reliable data at almost free of cost, then the best solution for you is to use your trading terminal tick data to feed your TA tools. Most desktop java based trading terminals like PIB, ODIN, TTA etc etc are fed with RT data from the NSE servers in almost absolute real time. The problem is that this data is encrypted so one cannot simply download and use it for purposes other than the applications provided by these online trading firms. You can simply ask your resource manager to configure metastock to their data feeds & they will usually oblige because anyways you are giving them good business in terms of brokerage every month, for instance the RM attached to me at IBULLS simply provided me with an interface to MS from their data feed at no extra subscription fee (it is another matter that now the whole RT data feed has gone haywire because I upgraded to MS 11). If for some reason this doesn't work out then one can just do the next best thing & that is... fetching the data from folders that PIB uses to store this RT data and seamlessly converting it to metastock format and storing it in another folder. For doing this there are again many tools available on the internet (if anybody is using PIB and needs them I can mail you) but I don't think it would be proper to post the urls in these forums. If you are comfortable with VB & .net then you can create your own tools too for these purposes.

 

Disclosure: I use PIB & I have paid a 1 time fee of 700 Rs for the same.

 

Yawwwwwnnnnnnn ... Am very sleepy now, but will continue this post again; sooner than later; with more information that I have to share with you all.

 

Please do post your comments, queries & suggestions

 

Good night for now & happy trading

great work sir it gives full details about real time data for us new to this feild of trading.iam also using pib can u plz mail me the free tools to download pib to amibroker. plz do the needful thanku

Hello there

Let me add some more about RT data feed.

While surfing i just came across this site  http://www.investbulls.com/e107_commercial/products.php

Their products look good but pricing is the concern. However, upon trial their products are working well and  doing good service.

Clue is -  some reverse engineering to obtain  License Key  ->> certainly not encouraged.

Cheers!

Yes YK, I have checked those tools @ investbulls ... But I must say they are not as stable as say RDE or even TDI ... My experience was that RDE had better speeds than any of them. Plus the fact that it also comes with Metastock refresher also made it attractive

@Hgprasad, yaar kamaal ki baat karte ho, how am I supposed to dream about your mail id and mail you?

Hi Praveen

This RealtimeDataExpress Looks lucrative. It's working smoothly too.

Does it provide F&O data from Yahoo source (obviously for Nifty Futures) ?

As i use TTAdv to trade. This RDE is not smooth in importing data from TTAdv.

Please clarify my doubt.

I want cracks this software

Sir I would like to congratulate you on a excellent post. My query is can we use a third party software to download data from indiabulls in order to use in metastock?

will wee not be violating any copyright rules?

Yk at 10:06AM on Nov 04, 2009

Hello there

Let me add some more about RT data feed.

While surfing i just came across this site  http://www.investbulls.com/e107_commercial/products.php

Their products look good but pricing is the concern. However, upon trial their products are working well and  doing good service.

Clue is -  some reverse engineering to obtain  License Key  ->> certainly not encouraged.

Cheers!

Yet another one http://www.shareguru.in @ Rs.395/pm. Now, i don't know anything more than that abt it.

Have used Investbulls, truedata and RealTimeDataExpress and heres what i noticed

investbulls - good speed but unstable at times and EXPENSIVE

truedata - very good speed, stable, fairly cheap  but on somedays (fairly rare) has problem with updates and startup

RealTimeDataExpress - excellent speed, stable and extremely cheap. even has separate option for PIB can handle large no of scrips very easily

besides getbhavcopy, i also use Chartnexus which is an excellent and very simple TA software which automatically updates NSE and BSE EOD data on its own and a very friendly user interface for the newbies.

ciao!

Dear YK,

Yes RTDE (real time data express) does also get rt data from Yahoo finance, but as always that is 5 odd minutes delayed & also not very reliable most of the time. As for it not being smooth in feeding data from TTA, I wonder why should that be the case because it does a perfect job with PIB (once u feed the proper folder)

Mr RR Desai, you are spot on about all the tools //check ... Although I have not used chartnexus because I never felt the need for another EOD data downloader ever since I discovered GBC

Kamal Shstry ji, why worry about copyright etc when concerned with software? Just be cool as long as you are an individual user & not an organisation (or a corporate) because Indian cyberlaws still dont consider it a crime to use cracked versions of propriety softwares as long as you are using them in your home

MANI, what cracks are you looking for?

Praveen can you post any software full version (i.e. cracked or freeware) to download from odin diet to metastock or amibroker