14 New Messages
Digest #2692
Messages
Sat Jul 13, 2013 3:21 am (PDT) . Posted by:
"acetylator" acetylator
Dear Randy,
as was noticed in recent discussions, Morningstar has switched to dynamically generated web pages. This makes a lot of elements from smf-elements-4.txt non-functional. There are also some data which are not present in the current element list at all (for example, Morningstar credit rating, etc.).
My question is - are you planning in the near future an update on Morningstar elements? If not, I was thinking of doing it myself. There is a lot of interesting data out there that I would like to use. It is going to be quite a big task, but, probably, it can be done collectively - you + other SMF users + me?
If you plan anything like this and if you need help, I would like to participate.
Thank you again (and again) for your add-in!
Ace.
as was noticed in recent discussions, Morningstar has switched to dynamically generated web pages. This makes a lot of elements from smf-elements-
My question is - are you planning in the near future an update on Morningstar elements? If not, I was thinking of doing it myself. There is a lot of interesting data out there that I would like to use. It is going to be quite a big task, but, probably, it can be done collectively - you + other SMF users + me?
If you plan anything like this and if you need help, I would like to participate.
Thank you again (and again) for your add-in!
Ace.
Sat Jul 13, 2013 8:45 am (PDT) . Posted by:
"Randy Harmelink" rharmelink
One concern I have is how reliable the new "source" pages will be, the ones
they are using to load the dynamic web pages from.
Otherwise, I think it's just a matter of going through the dynamic web
page, finding each "source" page, and figuring out how to extract them.
As far as element definitions, there may no longer be one-to-one
correspondence with the old element numbers, so mapping them may be a
chore.
I was thinking of starting from just the extraction of each, and seeing
where it might go from there.
Also, there is the consideration of ETF, Mutual Fund, or Stock...
One other issue is that it will now take up multiple "saved pages" slots
for a single equity, since the data is spread over 5-10 "source" pages. It
will make it easier to hit the 1000 web page limit. That was one advantage
to picking up everything from a single print page -- one Internet access
made all of the data available.
On Sat, Jul 13, 2013 at 3:21 AM, acetylator <acetylator@nanoweb.info > wrote:
> Dear Randy,
> as was noticed in recent discussions, Morningstar has switched to
> dynamically generated web pages. This makes a lot of elements from
> smf-elements-4.txt non-functional. There are also some data which are not
> present in the current element list at all (for example, Morningstar credit
> rating, etc.).
> My question is - are you planning in the near future an update on
> Morningstar elements? If not, I was thinking of doing it myself. There is a
> lot of interesting data out there that I would like to use. It is going to
> be quite a big task, but, probably, it can be done collectively - you +
> other SMF users + me?
> If you plan anything like this and if you need help, I would like to
> participate.
>
> Thank you again (and again) for your add-in!
> Ace.
>
they are using to load the dynamic web pages from.
Otherwise, I think it's just a matter of going through the dynamic web
page, finding each "source" page, and figuring out how to extract them.
As far as element definitions, there may no longer be one-to-one
correspondence with the old element numbers, so mapping them may be a
chore.
I was thinking of starting from just the extraction of each, and seeing
where it might go from there.
Also, there is the consideration of ETF, Mutual Fund, or Stock...
One other issue is that it will now take up multiple "saved pages" slots
for a single equity, since the data is spread over 5-10 "source" pages. It
will make it easier to hit the 1000 web page limit. That was one advantage
to picking up everything from a single print page -- one Internet access
made all of the data available.
On Sat, Jul 13, 2013 at 3:21 AM, acetylator <acetylator@nanoweb.
> Dear Randy,
> as was noticed in recent discussions, Morningstar has switched to
> dynamically generated web pages. This makes a lot of elements from
> smf-elements-
> present in the current element list at all (for example, Morningstar credit
> rating, etc.).
> My question is - are you planning in the near future an update on
> Morningstar elements? If not, I was thinking of doing it myself. There is a
> lot of interesting data out there that I would like to use. It is going to
> be quite a big task, but, probably, it can be done collectively - you +
> other SMF users + me?
> If you plan anything like this and if you need help, I would like to
> participate.
>
> Thank you again (and again) for your add-in!
> Ace.
>
Sat Jul 13, 2013 9:54 am (PDT) . Posted by:
"acetylator" acetylator
Hi Randy,
thanks for the reply. Actually, my concern was only element definitions, because a lot of them are useless now...
Well, it seems that I will have to do as you suggest - go through dynamic web pages, find the source, analyze, write my own element definitions...
Anyway, thank you!
--- In smf_addin@yahoogroups.com , Randy Harmelink <rharmelink@...> wrote:
>
> One concern I have is how reliable the new "source" pages will be, the ones
> they are using to load the dynamic web pages from.
>
> Otherwise, I think it's just a matter of going through the dynamic web
> page, finding each "source" page, and figuring out how to extract them.
>
> As far as element definitions, there may no longer be one-to-one
> correspondence with the old element numbers, so mapping them may be a
> chore.
>
> I was thinking of starting from just the extraction of each, and seeing
> where it might go from there.
>
> Also, there is the consideration of ETF, Mutual Fund, or Stock...
>
> One other issue is that it will now take up multiple "saved pages" slots
> for a single equity, since the data is spread over 5-10 "source" pages. It
> will make it easier to hit the 1000 web page limit. That was one advantage
> to picking up everything from a single print page -- one Internet access
> made all of the data available.
>
> On Sat, Jul 13, 2013 at 3:21 AM, acetylator <acetylator@...> wrote:
>
> > Dear Randy,
> > as was noticed in recent discussions, Morningstar has switched to
> > dynamically generated web pages. This makes a lot of elements from
> > smf-elements-4.txt non-functional. There are also some data which are not
> > present in the current element list at all (for example, Morningstar credit
> > rating, etc.).
> > My question is - are you planning in the near future an update on
> > Morningstar elements? If not, I was thinking of doing it myself. There is a
> > lot of interesting data out there that I would like to use. It is going to
> > be quite a big task, but, probably, it can be done collectively - you +
> > other SMF users + me?
> > If you plan anything like this and if you need help, I would like to
> > participate.
> >
> > Thank you again (and again) for your add-in!
> > Ace.
> >
>
thanks for the reply. Actually, my concern was only element definitions, because a lot of them are useless now...
Well, it seems that I will have to do as you suggest - go through dynamic web pages, find the source, analyze, write my own element definitions.
Anyway, thank you!
--- In smf_addin@yahoogrou
>
> One concern I have is how reliable the new "source" pages will be, the ones
> they are using to load the dynamic web pages from.
>
> Otherwise, I think it's just a matter of going through the dynamic web
> page, finding each "source" page, and figuring out how to extract them.
>
> As far as element definitions, there may no longer be one-to-one
> correspondence with the old element numbers, so mapping them may be a
> chore.
>
> I was thinking of starting from just the extraction of each, and seeing
> where it might go from there.
>
> Also, there is the consideration of ETF, Mutual Fund, or Stock...
>
> One other issue is that it will now take up multiple "saved pages" slots
> for a single equity, since the data is spread over 5-10 "source" pages. It
> will make it easier to hit the 1000 web page limit. That was one advantage
> to picking up everything from a single print page -- one Internet access
> made all of the data available.
>
> On Sat, Jul 13, 2013 at 3:21 AM, acetylator <acetylator@
>
> > Dear Randy,
> > as was noticed in recent discussions, Morningstar has switched to
> > dynamically generated web pages. This makes a lot of elements from
> > smf-elements-
> > present in the current element list at all (for example, Morningstar credit
> > rating, etc.).
> > My question is - are you planning in the near future an update on
> > Morningstar elements? If not, I was thinking of doing it myself. There is a
> > lot of interesting data out there that I would like to use. It is going to
> > be quite a big task, but, probably, it can be done collectively - you +
> > other SMF users + me?
> > If you plan anything like this and if you need help, I would like to
> > participate.
> >
> > Thank you again (and again) for your add-in!
> > Ace.
> >
>
Sat Jul 13, 2013 12:45 pm (PDT) . Posted by:
"Randy H" rharmelink
Just to give you some idea of the scope -- I've only spent about an hour
looking at it, and for stocks have found:
Data Type Sourced web page Quotes:
http://quotes.morningstar.com/stock/c-header?&t=MMM Profile:
http://quotes.morningstar.com/stock/c-company-profile?&t=MMM
Financials: http://quotes.morningstar.com/stock/c-financials?&t=MMM
Competitors: http://quotes.morningstar.com/stock/c-competitors?&t=MMM
Competitors 2:
http://financials.morningstar.com/competitors/industry-peer-data.action?\
t=MMM Dividends:
http://quotes.morningstar.com/stock/c-dividends?&t=MMM
Recommendation:
http://quotes.morningstar.com/stock/c-recommencation?&t=MMM Take:
http://quotes.morningstar.com/stock/c-morningstar-take?&t=MMM
Market Data: http://quotes.morningstar.com/stock/c-marketData?&t=MMM
Short Interest:
http://quotes.morningstar.com/stock/c-shortInterest?&t=MMM
Ownership: http://quotes.morningstar.com/stock/c-fundowners?&t=MMM
Insiders: http://quotes.morningstar.com/stock/c-insiders?&t=MMM
Key Stats: http://quotes.morningstar.com/stock/c-keystats?&t=MMM
Performance:
http://performance.morningstar.com/Performance/stock/trailing-total-retu\
rns.action?t=MMM Operation Details:
http://financials.morningstar.com/company-profile/component.action?compo\
nent=OperationDetails&t=MMM Raw Data:
http://financials.morningstar.com/financials/getFinancePart.html?&callba\
ck=?&t=MMM More Raw Data:
http://financials.morningstar.com/financials/getKeyStatPart.html?&callba\
ck=?&t=MMM
On Sat, Jul 13, 2013 at 9:54 AM, acetylator <acetylator@nanoweb.info
<mailto:acetylator@nanoweb.info > > wrote:
Hi Randy,
thanks for the reply. Actually, my concern was only element definitions,
because a lot of them are useless now...
Well, it seems that I will have to do as you suggest - go through
dynamic web pages, find the source, analyze, write my own element
definitions...
Anyway, thank you!
looking at it, and for stocks have found:
Data Type Sourced web page Quotes:
http://quotes.
http://quotes.
Financials: http://quotes.
Competitors: http://quotes.
Competitors 2:
http://financials.
t=MMM
http://quotes.
Recommendation:
http://quotes.
http://quotes.
Market Data: http://quotes.
Short Interest:
http://quotes.
Ownership: http://quotes.
Insiders: http://quotes.
Key Stats: http://quotes.
Performance:
http://performance.
rns.action?t=
http://financials.
nent=OperationDetai
http://financials.
ck=?&t=MMM
http://financials.
ck=?&t=MMM
On Sat, Jul 13, 2013 at 9:54 AM, acetylator <acetylator@nanoweb.
<mailto:acetylator@nanoweb.
Hi Randy,
thanks for the reply. Actually, my concern was only element definitions,
because a lot of them are useless now...
Well, it seems that I will have to do as you suggest - go through
dynamic web pages, find the source, analyze, write my own element
definitions.
Anyway, thank you!
Sat Jul 13, 2013 3:28 pm (PDT) . Posted by:
"Randy H" rharmelink
Additional web pages with extractable data:
http://investors.
http://investors.
http://investors.
http://financials.
http://financials.
http://financials.
http://etfs.
http://etfs.
http://etfs.
http://etfs.
http://etfs.
http://etfs.
http://performance.
http://performance.
http://performance.
http://performance.
http://performance.
http://performance.
http://performance.
http://performance.
http://performance.
http://performance.
http://performance.
http://portfolios.
http://performance.
http://performance.
http://performance.
http://performance.
http://performance.
http://portfolios.
http://portfolios.
http://portfolios.
http://investors.
http://investors.
http://investors.
http://investors.
http://investors.
http://investors.
http://investors.
Sat Jul 13, 2013 7:50 am (PDT) . Posted by:
"acetylator" acetylator
Hi Randy,
I beleive I found a bug in the element 990. It should return Forward Annual Dividend Yield, instead of it it returns Trailing Annual Dividend Yield.
Correct line for this is (smf-elements-2.txt):
990;YahooKS;Dividend Yield;http://finance.yahoo.com/q/ks?s=~~~~~;2;FINANCIAL HIGHLIGHTS;FORWARD ANNUAL DIVIDEND YIELD; ; ;-1;</table;0;0
I have changed last number from 2 to -1
Please let me know if I have done it wrong.
Regards, Ace.
I beleive I found a bug in the element 990. It should return Forward Annual Dividend Yield, instead of it it returns Trailing Annual Dividend Yield.
Correct line for this is (smf-elements-
990;YahooKS;
I have changed last number from 2 to -1
Please let me know if I have done it wrong.
Regards, Ace.
Sat Jul 13, 2013 8:48 am (PDT) . Posted by:
"Randy Harmelink" rharmelink
No. Elements 989 and 990 SHOULD BE trailing values, because that's how they
were originally defined. When I first defined the element, all they had on
that Key Statistics web page were the trailing values.
So I redefined those elements to pick up the same thing they use to, but
added new elements for the forward values that they added to the web page.
On Sat, Jul 13, 2013 at 7:50 AM, acetylator <acetylator@nanoweb.info > wrote:
>
> I beleive I found a bug in the element 990. It should return Forward
> Annual Dividend Yield, instead of it it returns Trailing Annual Dividend
> Yield.
>
> Correct line for this is (smf-elements-2.txt):
> 990;YahooKS;Dividend Yield;
> http://finance.yahoo.com/q/ks?s=~~~~~;2;FINANCIAL HIGHLIGHTS;FORWARD
> ANNUAL DIVIDEND YIELD; ; ;-1;</table;0;0
>
> I have changed last number from 2 to -1
>
> Please let me know if I have done it wrong.
>
were originally defined. When I first defined the element, all they had on
that Key Statistics web page were the trailing values.
So I redefined those elements to pick up the same thing they use to, but
added new elements for the forward values that they added to the web page.
On Sat, Jul 13, 2013 at 7:50 AM, acetylator <acetylator@nanoweb.
>
> I beleive I found a bug in the element 990. It should return Forward
> Annual Dividend Yield, instead of it it returns Trailing Annual Dividend
> Yield.
>
> Correct line for this is (smf-elements-
> 990;YahooKS;
> http://finance.
> ANNUAL DIVIDEND YIELD; ; ;-1;</table;
>
> I have changed last number from 2 to -1
>
> Please let me know if I have done it wrong.
>
Sat Jul 13, 2013 9:50 am (PDT) . Posted by:
"acetylator" acetylator
Oh, I see. Thank you for the correction, Randy!
Ace.
--- In smf_addin@yahoogroups.com , Randy Harmelink <rharmelink@...> wrote:
>
> No. Elements 989 and 990 SHOULD BE trailing values, because that's how they
> were originally defined. When I first defined the element, all they had on
> that Key Statistics web page were the trailing values.
>
> So I redefined those elements to pick up the same thing they use to, but
> added new elements for the forward values that they added to the web page.
>
> On Sat, Jul 13, 2013 at 7:50 AM, acetylator <acetylator@...> wrote:
>
> >
> > I beleive I found a bug in the element 990. It should return Forward
> > Annual Dividend Yield, instead of it it returns Trailing Annual Dividend
> > Yield.
> >
> > Correct line for this is (smf-elements-2.txt):
> > 990;YahooKS;Dividend Yield;
> > http://finance.yahoo.com/q/ks?s=~~~~~;2;FINANCIAL HIGHLIGHTS;FORWARD
> > ANNUAL DIVIDEND YIELD; ; ;-1;</table;0;0
> >
> > I have changed last number from 2 to -1
> >
> > Please let me know if I have done it wrong.
> >
>
Ace.
--- In smf_addin@yahoogrou
>
> No. Elements 989 and 990 SHOULD BE trailing values, because that's how they
> were originally defined. When I first defined the element, all they had on
> that Key Statistics web page were the trailing values.
>
> So I redefined those elements to pick up the same thing they use to, but
> added new elements for the forward values that they added to the web page.
>
> On Sat, Jul 13, 2013 at 7:50 AM, acetylator <acetylator@
>
> >
> > I beleive I found a bug in the element 990. It should return Forward
> > Annual Dividend Yield, instead of it it returns Trailing Annual Dividend
> > Yield.
> >
> > Correct line for this is (smf-elements-
> > 990;YahooKS;
> > http://finance.
> > ANNUAL DIVIDEND YIELD; ; ;-1;</table;
> >
> > I have changed last number from 2 to -1
> >
> > Please let me know if I have done it wrong.
> >
>
Sat Jul 13, 2013 8:07 am (PDT) . Posted by:
"acetylator" acetylator
Hi,
I have just checked element 989, which seemed strange - the configuration line was identical with the original 990. I have corrected it:
989;YahooKS;Dividend;http://finance.yahoo.com/q/ks?s=~~~~~;2;FINANCIAL HIGHLIGHTS;FORWARD ANNUAL DIVIDEND RATE; ; ;-2;</table;0;0
Changed 2 to -2 so now it returns Forward Annual Dividend Rate as it should.
Regards, Ace.
I have just checked element 989, which seemed strange - the configuration line was identical with the original 990. I have corrected it:
989;YahooKS;
Changed 2 to -2 so now it returns Forward Annual Dividend Rate as it should.
Regards, Ace.
Sat Jul 13, 2013 8:12 am (PDT) . Posted by:
"acetylator" acetylator
Sorry, correct number must be -1, not -2! This is the line for element 989:
989;YahooKS;Dividend;http://finance.yahoo.com/q/ks?s=~~~~~;2;FINANCIAL
HIGHLIGHTS;FORWARD ANNUAL DIVIDEND RATE; ; ;-1;</table;0;0
Regards!
--- In smf_addin@yahoogroups.com , "acetylator" <acetylator@...> wrote:
>
> Hi,
> I have just checked element 989, which seemed strange - the configuration line was identical with the original 990. I have corrected it:
>
> 989;YahooKS;Dividend;http://finance.yahoo.com/q/ks?s=~~~~~;2;FINANCIAL HIGHLIGHTS;FORWARD ANNUAL DIVIDEND RATE; ; ;-2;</table;0;0
>
> Changed 2 to -2 so now it returns Forward Annual Dividend Rate as it should.
>
> Regards, Ace.
>
989;YahooKS;
HIGHLIGHTS;FORWARD ANNUAL DIVIDEND RATE; ; ;-1;</table;
Regards!
--- In smf_addin@yahoogrou
>
> Hi,
> I have just checked element 989, which seemed strange - the configuration line was identical with the original 990. I have corrected it:
>
> 989;YahooKS;
>
> Changed 2 to -2 so now it returns Forward Annual Dividend Rate as it should.
>
> Regards, Ace.
>
Sat Jul 13, 2013 6:45 pm (PDT) . Posted by:
"jtravisano2002" jtravisano2002
Hello,
I was looking through the "Documentation for RCHGetYahooQuotes() function" and there were a few things I'm looking for that I didn't see. How can I get the next 5 year growth estimate from the analysts estimate page on yahoo finance? Is there another more exhaustive list somewhere or is there someway to customize the codes to get items I don't see?
Also I'd like to access the analyst ratings to auto populate how many strong buys, sells, etc. and how they change through time.
Thank you!
I was looking through the "Documentation for RCHGetYahooQuotes(
Also I'd like to access the analyst ratings to auto populate how many strong buys, sells, etc. and how they change through time.
Thank you!
Sat Jul 13, 2013 7:10 pm (PDT) . Posted by:
"jtravisano2002" jtravisano2002
My apologies... It looks like the answer to my questions are in RCHGetElementNumber
Thanks again!
--- In smf_addin@yahoogrou
>
> Hello,
>
> I was looking through the "Documentation for RCHGetYahooQuotes(
>
> Also I'd like to access the analyst ratings to auto populate how many strong buys, sells, etc. and how they change through time.
>
> Thank you!
>
Sat Jul 13, 2013 7:29 pm (PDT) . Posted by:
"Randy Harmelink" rharmelink
It may help to look at this file in the "Templates and Examples" folder in
the FILES area:
SMF-Template-Yahoo-Analyst-Estimates.xls
It uses the Yahoo defined elements for the analyst elements, but shows them
in context.
On Sat, Jul 13, 2013 at 7:10 PM, jtravisano2002
<jacob.travisano@gmail.com >wrote:
>
> My apologies... It looks like the answer to my questions are in
> RCHGetElementNumber-Element-Definitions.xls. At least I found the 5 year
> growth, I'll look through to see if I can find the analyst recommendations.
> If there not in there please let me know....
>
the FILES area:
SMF-Template-
It uses the Yahoo defined elements for the analyst elements, but shows them
in context.
On Sat, Jul 13, 2013 at 7:10 PM, jtravisano2002
<jacob.travisano@
>
> My apologies... It looks like the answer to my questions are in
> RCHGetElementNumber
> growth, I'll look through to see if I can find the analyst recommendations.
> If there not in there please let me know....
>
Sat Jul 13, 2013 7:30 pm (PDT) . Posted by:
"Randy Harmelink" rharmelink
As far as customizing codes, the most common functions to do custom
extractions are the RCHGetTableCell() and smfGetTagContent() functions.
In most cases, the RCHGetElementNumber() function is just a saved version
of the RCHGetTableCell() function.
On Sat, Jul 13, 2013 at 6:45 PM, jtravisano2002
<jacob.travisano@gmail.com >wrote:
>
> I was looking through the "Documentation for RCHGetYahooQuotes()
> function" and there were a few things I'm looking for that I didn't see.
> How can I get the next 5 year growth estimate from the analysts estimate
> page on yahoo finance? Is there another more exhaustive list somewhere or
> is there someway to customize the codes to get items I don't see?
>
> Also I'd like to access the analyst ratings to auto populate how many
> strong buys, sells, etc. and how they change through time.
>
extractions are the RCHGetTableCell(
In most cases, the RCHGetElementNumber
of the RCHGetTableCell(
On Sat, Jul 13, 2013 at 6:45 PM, jtravisano2002
<jacob.travisano@
>
> I was looking through the "Documentation for RCHGetYahooQuotes(
> function" and there were a few things I'm looking for that I didn't see.
> How can I get the next 5 year growth estimate from the analysts estimate
> page on yahoo finance? Is there another more exhaustive list somewhere or
> is there someway to customize the codes to get items I don't see?
>
> Also I'd like to access the analyst ratings to auto populate how many
> strong buys, sells, etc. and how they change through time.
>
Tidak ada komentar:
Posting Komentar