zoukankan      html  css  js  c++  java
  • 加州大学伯克利分校Stat2.3x Inference 统计推断学习笔记: Section 5 Window to a Wider World

    Stat2.3x Inference(统计推断)课程由加州大学伯克利分校(University of California, Berkeley)于2014年在edX平台讲授。

    PDF笔记下载(Academia.edu)

    Summary

    Chi-square test

    • Random sample or not / Good or bad
      • $$H_0: ext{Good model}$$ $$H_A: ext{Not good model}$$
      • Based on the expected proportion to calculate the expected values
      • $chi^2$ statistic is $$chi^2=sum{frac{(o-e)^2}{e}}$$ where $o$ is observed values, $e$ is expected values.
      • The degree of freedom is the number of categories minus one
      • Follows approximately the $chi^2$ distribution, we can calculate its P-value by using R function:
        1-pchisq(chi, df)
    • Independent or not
      • $$H_0: ext{Independent}$$ $$H_A: ext{not Independent}$$
      • Contingency table
      • Under $H_0$, in each cell of the table $$ ext{expected count}=frac{ ext{row total} imes ext{column total}}{ ext{grand total}}$$ That is, $P(Acap B)=P(A)cdot P(B)$ under the independent assumption.
      • $chi^2$ statistic is $$chi^2=sum{frac{(o-e)^2}{e}}$$ where $o$ is observed values, $e$ is expected values.
      • The degree of freedom is $( ext{row}-1) imes( ext{column}-1)$
      • Follows approximately the $chi^2$ distribution, we can calculate its P-value by using R function:
        1-pchisq(chi, df)

    ADDITIONAL PRACTICE PROBLEMS FOR WEEK 5

    The population is all patients at a large system of hospitals; each sampled patient was classified by the type of room he/she was in, and his/her level of satisfaction with the care received. The question is whether type of room is independent of level of satisfaction.

    1. What are the null and alternative hypotheses?

    2. Under the null, what is the estimated expected number of patients in the "shared room, somewhat satisfied" cell?

    3. Degrees of freedom = ( )

    4. The chi-square statistic is about 13.8. Roughly what is the P-value, and what is the conclusion of the test?

    Solution

    1. Null: The two variables are independent; Alternative: The two variables are not independent.

    2. We need to expand the original table:

    Thus the estimated expected number of patients in the shared room, somewhat satisfied is $$784 imesfrac{322}{784} imesfrac{255}{784}=104.7321$$

    3. Degree of freedom is $(3-1) imes(3-1)=4$

    4. P-value is 0.007961505 which is smaller than 0.05, so we reject $H_0$. That is, the conclusion is the two variables are not independent. R code:

    1 - pchisq(13.8, 4)
    [1] 0.007961505

    UNGRADED EXERCISE SET A PROBLEM 1

    According to a genetics model, plants of a particular species occur in the categories A, B, C, and D, in the ratio 9:3:3:1. The categories of different plants are mutually independent. At a lab that grows these plants, 218 are in Category A, 69 in Category B, 84 in Category C, and 29 in Category D. Does the model look good? Follow the steps in Problems 1A-1F.

    1A The null hypothesis is:

    a. The model is good.

    b. The model isn't good.

    c. Too many of the plants are in Category C.

    d. The proportion of plants in Category A is expected to be 9/16; the difference in the sample is due to chance.

    1B The alternative hypothesis is:

    a. The model is good.

    b. The model isn't good.

    c. Too many of the plants are in Category C.

    d. The proportion of plants in Category A is expected to be 9/16; the difference in the sample is due to chance.

    1C Under the null, the expected number of plants in Category D is( ).

    1D The chi-square statistic is closest to

    a. 1 b. 1.5 c. 2 d. 2.5 e. 3 f. 3.5 g. 4 h. 4.5

    1E Degrees of freedom = ( ).

    1F Based on this test, does the model look good? Yes No

    Solution

    1A) The null hypothesis is "the model is good". (a) is correct.

    1B) The alternative hypothesis is "the model is not good". (b) is correct.

    1C) The expected number of plants in Category D is $$(218+69+84+29) imesfrac{1}{9+3+3+1}=25$$

    1D) (d) is correct. We can use the following table

    R code:

    o = c(218, 69, 84, 29)
    e = c(225, 75, 75, 25)
    chi = sum((o - e)^2 / e); chi
    [1] 2.417778

    1E) Degree of freedom is $4-1=3$.

    1F) P-value is 0.4903339 which is larger than 0.05, so we reject $H_A$. The conclusion is "the model is good". R code:

    1 - pchisq(chi, 3)
    [1] 0.4903339

    PROBLEM 2

    A simple random sample of cars in a city was categorized according to fuel type and place of manufacture.

    Are place of manufacture and fuel type independent? Follow the steps in Problems 2A-2D.

    2A If the two variables were independent, the chance that a sampled car is a domestic gasoline fueled car would be estimated to be about

    0.0362 0.0499 0.2775 0.3820 0.5

    2B If the two variables were independent, the expected number of foreign gas/electric hybrids would be estimated to be ( ). (Please keep at least two decimal places; by now you should understand why you should not round off to an integer.)

    2C Degrees of freedom =( )

    1 2 3 4

    2D The chi-square statistic is 0.6716. The test therefore concludes that the two variables are independent not independent

    Solution

    2A) Expand the table:

    If the two variables were independent, then $$P( ext{domestic gasoline})=P( ext{domestic})cdot P( ext{gasoline})=frac{215}{511} imesfrac{337}{511}=0.2774767doteq 0.2775$$

    2B) If the two variables were independent, then $$511 imes P( ext{foreign gasoline/electricity})=511 imesfrac{296}{511} imesfrac{130}{511}=75.30333$$

    2C) Degree of freedom is $(2-1) imes(3-1)=2$.

    2D) The P-value is 0.714766 which is larger than 0.05, so we reject $H_A$. That is, the conclusion is independent. R code:

    1 - pchisq(0.6716, 2)
    [1] 0.714766

    We can calculate $chi^2$ statistic by using R built-in function

    chisq.test()
    data = matrix(c(146, 18, 51, 191, 26, 79), ncol = 2)
      chisq.test(data)
    
     Pearson's Chi-squared test
    
    data:  data
    X-squared = 0.6716, df = 2, p-value = 0.7148


    作者:赵胤
    出处:http://www.cnblogs.com/zhaoyin/
    本文版权归作者和博客园共有,欢迎转载,但未经作者同意必须保留此段声明,且在文章页面明显位置给出原文连接,否则保留追究法律责任的权利。

  • 相关阅读:
    golang中的值传递和引用传递
    链表

    hashtable(哈希表)
    TAO: Facebook’s Distributed Data Store for the Social Graph. 论文阅读笔记(上)
    Skip Lists: A Probabilistic Alternative to Balanced Trees 跳表论文阅读笔记
    【译】如何实现一个现代化电子商城搜索?(一)
    Elasticsearch搜索资料汇总
    Python 按比例获取样本数据或执行任务
    Python 按分类样本数占比生成并随机获取样本数据
  • 原文地址:https://www.cnblogs.com/zhaoyin/p/4179331.html
Copyright © 2011-2022 走看看