sas, Statistical test for difference between two numbers

comp.soft-sys.sas - The SAS statistics package.


sas >> Statistical test for difference between two numbers

by abhaykaushik » Thu, 29 Nov 2007 22:15:00 GMT

Hi,
I have two series of hedge funds with monthly observations. First series
has 51,300 monthly observations and second has 12,340 monthly
observations. I ran an OLS for both:

model Rs = RMRF SMB HML UMD; and I get average monthly coefficients of
intercept and betas.
Alpha of first series is -0.00288 and for the other one is 0.00054. Now I
want to test whether the difference between these two (-0.00288 -0.00054)
is statistically different? More specifically the annualized alpha
difference, i.e. (aplha1*12-alpha2*12)
Is there any test that can be performed to check this statistical
difference?

Thanks

Top

sas >> Statistical test for difference between two numbers

by sonik son » Fri, 30 Nov 2007 02:03:45 GMT





You may want to look at PROC ANOM (analysis of means.) It allows you
to compare two means to determine if they are statistically different.
There are also some helpful graphical outputs to graphically simplify
this concept for management, should they be less statistically
oriented (i.e. "dullards".)


Top

sas >> Statistical test for difference between two numbers

by peterflomconsulting » Fri, 30 Nov 2007 02:14:56 GMT

>> Hi,
I have two series of hedge funds with monthly observations. First
series has 51,300 monthly observations and second has 12,340 monthly
observations. I ran an OLS for both: model Rs = RMRF SMB HML UMD;
and I get average monthly coefficients of intercept and betas.

Alpha of first series is -0.00288 and for the other one is 0.00054.
Now I want to test whether the difference between these two (-0.00288
-0.00054) is statistically different? More specifically the annualized
alpha difference, i.e. (aplha1*12-alpha2*12)

I suggest a permutation test.

There's a paper by David Cassell called Don't be Loopy that may be of help
Basic idea:
Combine all the intercepts into one variable
Randomly pull out sets of 51,200 and 12,340 intercepts
Do this many times
See how many times the difference is as big as the one you got

But with such huge data sets, even a small difference is likely to be statistically significant, so I suggest first thinking whether this is really what is important to you.

HTH

Peter

Top

Statistical test for difference between two numbers

by HERMANS1 » Fri, 30 Nov 2007 03:47:53 GMT

I wouldn't worry too much about the statistical significance of the
difference between estimates of a model that almost certainly have both
substantial bias and underestimated confidence bounds. OLS estimates of
time series do not take into account seasonal variation, trends, or
cycles in time series. Because assumptions about the independence of
error terms almost never hold, time series require special estimation
and forecasting methods. For that reason SAS has a separate product that
includes statistical procedures tailored to time series analysis
(SAS/ETS). If you are looking for differences in trend between two time
series, review the documentation of SAS/ETS first. A clever adaptation
of PROC MIXED or a non-linear equivalent might work as well as some of
the SAS/ETS PROC's, but would take much more time and expertise to
specify.

An OLS estimate of a trend in a time series fits the sample used to
estimate it much better than it fits another sample or a future
projection of the same sample. The difference in two biased and
inefficient estimates won't tell you much. As recent discrepancies
between predictions of credit and other financial models and observed
values show, estimates of parameters of time series models tend to be
inaccurate at best. Using inappropriate estimation methods adds
confusion to weak information. Sorry to be so negative, but don't go
there.
S

-----Original Message-----
From: XXXX@XXXXX.COM [mailto: XXXX@XXXXX.COM ]
On Behalf Of Abhay Kaushik
Sent: Thursday, November 29, 2007 9:15 AM
To: XXXX@XXXXX.COM
Cc: Abhay Kaushik
Subject: Statistical test for difference between two numbers


Hi,
I have two series of hedge funds with monthly observations. First
series has 51,300 monthly observations and second has 12,340 monthly
observations. I ran an OLS for both:

model Rs = RMRF SMB HML UMD; and I get average monthly coefficients of
intercept and betas. Alpha of first series is -0.00288 and for the other
one is 0.00054. Now I want to test whether the difference between these
two (-0.00288 -0.00054) is statistically different? More specifically
the annualized alpha difference, i.e. (aplha1*12-alpha2*12) Is there any
test that can be performed to check this statistical difference?

Thanks

Top

Statistical test for difference between two numbers

by abhaykaushik » Fri, 30 Nov 2007 04:06:45 GMT

Hi All,
Thanks for your suggestions. There is another method that I tried and it
works. Since my two data sets are identical but types. So I added them
together as a one big file and created dummy based on type. Then I run OLS
and also added another line in my OLS regression:

test intercept = intercept+d;
F value of this tells whether the two intercepts are ststistically
different.

Top

Statistical test for difference between two numbers

by HERMANS1 » Fri, 30 Nov 2007 04:58:37 GMT

The test you are proposing should, it seems to me, compare F values (or
better indicators of model fit) of the model that includes the variable
d and the model that doesn't. If omitting d does not reduce model fit,
then pooling data will not reduce the explanatory or predictive power of
the model.

Rejecting or failing to reject the null hypothesis of that test won't
make estimates or predictions of the model any less biased or estimate
the variance or prediction of the model any more accurately. No matter
how many sightings you take from a single point, or whether sighted to
one side or another, a telescope won't let you see what's behind a barn.
S
-----Original Message-----
From: XXXX@XXXXX.COM [mailto: XXXX@XXXXX.COM ]
On Behalf Of Abhay Kaushik
Sent: Thursday, November 29, 2007 3:07 PM
To: XXXX@XXXXX.COM
Cc: Abhay Kaushik
Subject: Re: Statistical test for difference between two numbers


Hi All,
Thanks for your suggestions. There is another method that I tried and it
works. Since my two data sets are identical but types. So I added them
together as a one big file and created dummy based on type. Then I run
OLS and also added another line in my OLS regression:

test intercept = intercept+d;
F value of this tells whether the two intercepts are ststistically
different.

Top
Similar Threads

1. Statistical question -- compare two columns for statistical difference

2. Difference between two numbers

3. estimation of the expected number of events in the two groups using log rank test 

I'm conducting a study and would like to estimate the number of events
that will occur i a 7 year period to give a significant difference if
one is there.  I know you have to use a log rank test but i'm not sure
what equation to use or if there is a free program or calcuation out
there? any help will be greatly appreciated

4. difference between coefficients from two regressions when using Heckman Two-Step Selection Correction

5. how to test difference in difference? 

Hi all,

I have the following dataset, where y is the dependent var, X1 is indepent var (continuous), X2 is dummy for group A (=1) and group B (=0)

Y       X1        X2

I would like to conduct the following test with standard error reported:

{(aveage y of group A if X1 increases by 0.1 - average y of group A if X1 increases by 0.5) - (average y of group B if X1 increases by 0.1 - average y of group B if X1 increases by 0.5)},

How should I do this?

Thanks in advance.

Chunling



---------------------------------
Do you Yahoo!?
Yahoo! Hotjobs: Enter the "Signing Bonus" Sweepstakes

6. Difference of t-test and T-test

7. Two Senior level SAS Developer/Statistical Analyst opportunities in Columbus, Ohio 

I have two full-time Senior SAS/Statistcal Analyst opportunties at a VP
level in Columbus, Ohio for JPMorgan Chase in Direct Marketing.  We have
excellent benefits and will pay relocation.  If anyone wants more
information, please call me at the below number or send me your resume.

Sincerely,
Lori

Lori Pirooz
National Staffing Network
JPMorgan Chase
3415 Vision Drive, Columbus, Ohio  43219
phone:  614-422-5023
fax:  614-422-6770




                    Philip Mason
                    <phil@WOODSTRE       To:      XXXX@XXXXX.COM 
                    ET.ORG.UK>           cc:
                    Sent by:             Subject:     UK based junior permanent SAS role
                    "SAS(r)
                    Discussion"
                    <SAS-L@LISTSER
                    V.UGA.EDU>


                    07/30/2004
                    03:54 AM
                    Please respond
                    to Philip
                    Mason






A very interesting role converting an analytical model from EXCEL to SAS
for
a friend of mine, and then using it to consult with clients whilst
developing it more - eventually into a web based application. The job is in
the theme park sector and involves travel to theme parks around the world -
plus lots of SAS programming. Ideal for someone with 2-3 years of SAS
experience, due to salary level available. If you want to know more then
please send me a CV or a little about your background no later than 6th
August.

You should be entitled to live & work in England to be able to get this
position.

thanks
Phil Mason

p.s. I don't usually advertise jobs, but it is for a good friend of mine.

8. AW: Difference in days between two different SAS dates: Code results in wrong difefrences