9 Messages
Digest #3703
1b
Re: Weird problem encountered, the RCHgettablecell stopped working o by "Randy Harmelink" rharmelink
1e
Re: Weird problem encountered, the RCHgettablecell stopped working o by "Randy Harmelink" rharmelink
Messages
Thu May 19, 2016 8:09 am (PDT) . Posted by:
perseuslim11
Hi Randy, I've gotten the errors for smfupdatedownloadtable after some amount of cells that work ok, can you help me look into it? Thanks ^_^
(I've put the xls file into the attachment below)
(I've put the xls file into the attachment below)
Attachment(s) from
1 of 1 File(s)
Thu May 19, 2016 11:10 am (PDT) . Posted by:
"Randy Harmelink" rharmelink
Well, the 1000-web page limit still applies. But the smfUpdateDownloadTable
allows you to do it piecemeal. Now, you just either run the
smfForceRecalculation macro, or exit and restart EXCEL, to clear out the
1000 web page slots and continue. But, this time, you update the rows that
aren't already updated, by selecting those rows before running the
smfUpdateDownloadTable macro.
After purging the filled slots, DO NOT just run the smfUpdateDownloadTable
macro without selecting a range, or it will start all over again from the
beginning.
On Thu, May 19, 2016 at 8:09 AM, perseuslim11@yahoo.com [smf_addin] <
smf_addin@yahoogroups.com> wrote:
>
> Hi Randy, I've gotten the errors for smfupdatedownloadtable after some
> amount of cells that work ok, can you help me look into it? Thanks ^_^
>
> (I've put the xls file into the attachment below)
>
>
allows you to do it piecemeal. Now, you just either run the
smfForceRecalculation macro, or exit and restart EXCEL, to clear out the
1000 web page slots and continue. But, this time, you update the rows that
aren't already updated, by selecting those rows before running the
smfUpdateDownloadTable macro.
After purging the filled slots, DO NOT just run the smfUpdateDownloadTable
macro without selecting a range, or it will start all over again from the
beginning.
On Thu, May 19, 2016 at 8:09 AM, perseuslim11@yahoo.com [smf_addin] <
smf_addin@yahoogroups.com> wrote:
>
> Hi Randy, I've gotten the errors for smfupdatedownloadta
> amount of cells that work ok, can you help me look into it? Thanks ^_^
>
> (I've put the xls file into the attachment below)
>
>
Thu May 19, 2016 7:31 pm (PDT) . Posted by:
perseuslim11
I see, will try it and see if it works Thanks again Randy ^_^
Thu May 19, 2016 10:02 pm (PDT) . Posted by:
perseuslim11
btw, I've tried it and it works, however, I had to keep standing by the excel to do it part by part..
May I know how much is considered 1000 webpage? does it mean that each cell in the smfupdatedownloadtable table is considered as 1 webpage? meaning, only 1000 cells of the table can be updated at one time?
As Im doing it for 919 companies, it is hard to keep waiting for it, since my computer is not fast, the processing takes long time, and it's not quite possible for me to keep sitting beside the comp as I'm a student, had to go to university haha..
So I'm thinking whether there's any way I could automate the process, say I press smfupdate once, then it automatically update 1000 cells, then automatically press the smfforcerecalculation, then smfupdate the next group of 1000 cells by itself, is it achievable ? If so, I hope you can point out the resource/ documentation for doing so, thanks :)
May I know how much is considered 1000 webpage? does it mean that each cell in the smfupdatedownloadta
As Im doing it for 919 companies, it is hard to keep waiting for it, since my computer is not fast, the processing takes long time, and it's not quite possible for me to keep sitting beside the comp as I'm a student, had to go to university haha..
So I'm thinking whether there's any way I could automate the process, say I press smfupdate once, then it automatically update 1000 cells, then automatically press the smfforcerecalculati
Thu May 19, 2016 11:25 pm (PDT) . Posted by:
"Randy Harmelink" rharmelink
I'm NOT going to document a process to automate it, because it's something
I DON"T want people to be doing routinely. As I said, I think it's an
unfair burden for the free data sources. If you really need that much data
and plan to actually use it, you should be going to a paid source and get
your data directly from them.
*My fear of people creating databases and abusing the free data sources
with the add-in was one reason I nearly decided not to even share it.*
The 1000 web page limit is exactly that. You can retrieve data from 1000
different URLs.
The reason the add-in extracts from a saved copy of a web page is so that
it can retrieve multiple data items from that web page. For example, the
GuruFocus template pulls nearly 4000 data items from a single web page.
However, because it's such a large web page and such a large number of
extractions, it takes over 2 minutes to do all the extractions. But
extracting one data item for each of 1000 companies from GuruFocus would
take nearly 30 minutes. So the number of web pages, size of web pages, and
number of extractions all lend something to the time issues. Typically, the
web page retrievals are the real bottleneck in the process. Especially if
you use a site that doesn't have good response times. A few time-outs here
and there can devastate the process as well, because it can take over 3
minutes to get the time-out, instead of a typical response time of a second
or less.
Part of not burdening the free data sources is it's up to YOU to find the
best way to get the data you really NEED. Not just grab anything you want
because it's "free". For example, if you're creating a ranking system, you
should be able to use some kind of screener to get rid of stocks you KNOW
will have a bad ranking.
As is, if you were extracting data from a single web page, you should be
able to do it all at once. But if each company requires extracting data
from 15 different web pages, you can only do about 66 companies before
hitting the limit.
And, BTW, some people using the add-in have been blocked from a web site,
if only temporarily, because they had generated so many requests from a
single IP address. To some web sites, it could look like a DoS attack. Some
web sites might start putting up captchas after a certain number of
requests. And some sites limit the number of requests from a given IP
address in a given 24-hour period.
I do extraction runs on Amazon about twice a week to create lists of newly
free Kindle books. I start getting the captchas after about 500 web page
retrievals. My typical run retrieves about 300 web pages, so it's not
usually an issue.
Ranting done. Sorry. Hope some of that was helpful.
On Thu, May 19, 2016 at 10:02 PM, perseuslim11@yahoo.com [smf_addin] <
smf_addin@yahoogroups.com> wrote:
>
> btw, I've tried it and it works, however, I had to keep standing by the
> excel to do it part by part..
>
> May I know how much is considered 1000 webpage? does it mean that each
> cell in the smfupdatedownloadtable table is considered as 1 webpage?
> meaning, only 1000 cells of the table can be updated at one time?
>
> As Im doing it for 919 companies, it is hard to keep waiting for it, since
> my computer is not fast, the processing takes long time, and it's not quite
> possible for me to keep sitting beside the comp as I'm a student, had to go
> to university haha..
>
> So I'm thinking whether there's any way I could automate the process, say
> I press smfupdate once, then it automatically update 1000 cells, then
> automatically press the smfforcerecalculation, then smfupdate the next
> group of 1000 cells by itself, is it achievable ? If so, I hope you can
> point out the resource/ documentation for doing so, thanks :)
>
>
I DON"T want people to be doing routinely. As I said, I think it's an
unfair burden for the free data sources. If you really need that much data
and plan to actually use it, you should be going to a paid source and get
your data directly from them.
*My fear of people creating databases and abusing the free data sources
with the add-in was one reason I nearly decided not to even share it.*
The 1000 web page limit is exactly that. You can retrieve data from 1000
different URLs.
The reason the add-in extracts from a saved copy of a web page is so that
it can retrieve multiple data items from that web page. For example, the
GuruFocus template pulls nearly 4000 data items from a single web page.
However, because it's such a large web page and such a large number of
extractions, it takes over 2 minutes to do all the extractions. But
extracting one data item for each of 1000 companies from GuruFocus would
take nearly 30 minutes. So the number of web pages, size of web pages, and
number of extractions all lend something to the time issues. Typically, the
web page retrievals are the real bottleneck in the process. Especially if
you use a site that doesn't have good response times. A few time-outs here
and there can devastate the process as well, because it can take over 3
minutes to get the time-out, instead of a typical response time of a second
or less.
Part of not burdening the free data sources is it's up to YOU to find the
best way to get the data you really NEED. Not just grab anything you want
because it's "free". For example, if you're creating a ranking system, you
should be able to use some kind of screener to get rid of stocks you KNOW
will have a bad ranking.
As is, if you were extracting data from a single web page, you should be
able to do it all at once. But if each company requires extracting data
from 15 different web pages, you can only do about 66 companies before
hitting the limit.
And, BTW, some people using the add-in have been blocked from a web site,
if only temporarily, because they had generated so many requests from a
single IP address. To some web sites, it could look like a DoS attack. Some
web sites might start putting up captchas after a certain number of
requests. And some sites limit the number of requests from a given IP
address in a given 24-hour period.
I do extraction runs on Amazon about twice a week to create lists of newly
free Kindle books. I start getting the captchas after about 500 web page
retrievals. My typical run retrieves about 300 web pages, so it's not
usually an issue.
Ranting done. Sorry. Hope some of that was helpful.
On Thu, May 19, 2016 at 10:02 PM, perseuslim11@yahoo.com [smf_addin] <
smf_addin@yahoogroups.com> wrote:
>
> btw, I've tried it and it works, however, I had to keep standing by the
> excel to do it part by part..
>
> May I know how much is considered 1000 webpage? does it mean that each
> cell in the smfupdatedownloadta
> meaning, only 1000 cells of the table can be updated at one time?
>
> As Im doing it for 919 companies, it is hard to keep waiting for it, since
> my computer is not fast, the processing takes long time, and it's not quite
> possible for me to keep sitting beside the comp as I'm a student, had to go
> to university haha..
>
> So I'm thinking whether there's any way I could automate the process, say
> I press smfupdate once, then it automatically update 1000 cells, then
> automatically press the smfforcerecalculati
> group of 1000 cells by itself, is it achievable ? If so, I hope you can
> point out the resource/ documentation for doing so, thanks :)
>
>
Thu May 19, 2016 10:55 am (PDT) . Posted by:
"Chuck Grablewski" cgrablew
Guys
If you are interested there is a stock screener at zacks.com where you can get a csv download the will give you the number of zacks analysts recommended buy, sell, or hold.
Chuck Grablewski
908-705-1532
> On May 18, 2016, at 11:27 AM, ghart23@earthlink.net [smf_addin] <smf_addin@yahoogroups.com> wrote:
>
> Thanks Randy
>
>
>
> -----Original Message-----
> From: "Randy Harmelink rharmelink@gmail.com [smf_addin]"
> Sent: May 18, 2016 1:21 PM
> To: smf_addin@yahoogroups.com
> Subject: Re: [smf_addin] Zacks Rank No Longer Available?
>
>
> It is now obsolete...
>
> On Wed, May 18, 2016 at 10:01 AM, ghart23@
> ...
> wrote:
>> I think there were messages some time ago that Zack's rank for individual stocks is no longer available from SMF. Used to be Element #848. Is that correct?
>>
>
>
If you are interested there is a stock screener at zacks.com where you can get a csv download the will give you the number of zacks analysts recommended buy, sell, or hold.
Chuck Grablewski
908-705-1532
> On May 18, 2016, at 11:27 AM, ghart23@earthlink.net [smf_addin] <smf_addin@yahoogroups.com> wrote:
>
> Thanks Randy
>
>
>
> -----Original Message-----
> From: "Randy Harmelink rharmelink@gmail.com [smf_addin]"
> Sent: May 18, 2016 1:21 PM
> To: smf_addin@yahoogroups.com
> Subject: Re: [smf_addin] Zacks Rank No Longer Available?
>
>
> It is now obsolete...
>
> On Wed, May 18, 2016 at 10:01 AM, ghart23@
> ...
> wrote:
>> I think there were messages some time ago that Zack's rank for individual stocks is no longer available from SMF. Used to be Element #848. Is that correct?
>>
>
>
Thu May 19, 2016 12:54 pm (PDT) . Posted by:
trendfirst
Hi sirons1962
I have been looking for a source of exchange info, and only found IDB listed as a source in the definitions file. I want to add the exchange to the list of S&P500 stocks. Can you tell us what data source you used?
Thanks
I have been looking for a source of exchange info, and only found IDB listed as a source in the definitions file. I want to add the exchange to the list of S&P500 stocks. Can you tell us what data source you used?
Thanks
Thu May 19, 2016 7:45 pm (PDT) . Posted by:
"Randy Harmelink" rharmelink
Easiest is to use is the RCHGetYahooQuotes() function, because you can get
the exchange on up to 200 stocks with one function invocation.
On Thu, May 19, 2016 at 12:54 PM, trendfirst@
...wrote:
>
> I have been looking for a source of exchange info, and only found IDB
> listed as a source in the definitions file. I want to add the exchange to
> the list of S&P500 stocks. Can you tell us what data source you used?
>
>
>
the exchange on up to 200 stocks with one function invocation.
On Thu, May 19, 2016 at 12:54 PM, trendfirst@
...wrote:
>
> I have been looking for a source of exchange info, and only found IDB
> listed as a source in the definitions file. I want to add the exchange to
> the list of S&P500 stocks. Can you tell us what data source you used?
>
>
>
Thu May 19, 2016 8:18 pm (PDT) . Posted by:
trendfirst
Thanks! I completely missed "Exchange"; on the datacodelist.
For the Add-in, Documentation, Templates, Tips and FAQs, visit http://ogres-crypt.com/SMF
Tidak ada komentar:
Posting Komentar