ECE 510 Lecture 6 Confidence Limits. Scott Johnson Glenn Shirley

Similar documents
Classification and Regression Approaches to Predicting United States Senate Elections. Rohan Sampath, Yue Teng

The Economic and Scientific Context of Quality Improvement and Six Sigma

Bounds on Welfare-Consistent Global Poverty Measures

Welfare-Consistent Global Poverty Measures

Charles H. Dyson School of Applied Economics and Management Cornell University, Ithaca, New York USA

Ethnic Disparities in the Graduate Labour Market

DeGolyer and MacNaughton 5001 Spring Valley Road Suite 800 East Dallas, Texas 75244

Chapter. Estimating the Value of a Parameter Using Confidence Intervals Pearson Prentice Hall. All rights reserved

ESTIMATION OF GENDER WAGE DIFFERENTIALS IN EGYPT USING OAXACA DECOMPOSITION TECHNIQUE *

11. Labour Market Discrimination

Subset Selection Via Implicit Utilitarian Voting

Estimation of Gender Wage Differentials using Oaxaca Decomposition Technique

Analysis of Gender Wage Differential in China s Urban Labor Market

SIMPLE LINEAR REGRESSION OF CPS DATA

P and V(p w,y) V(p,y) for at least one-half the measure of

PASW & Hand Calculations for ANOVA

Immigration and Social Justice

Immigration Policy and Counterterrorism

Sabrina Oliver Chapel Hill Town Clerk Town of Chapel Hill, N.C. Sabrina:

2 Gender, Poverty, and Wealth

Global Production Sharing and Rising Inequality: A Survey of Trade and Wages*

Self-Selection and the Earnings of Immigrants

Geographical Indications and The Trade Related Intellectual Property Rights Agreement (TRIPS): A Case Study of Basmati Rice Exports

Who Would Have Won Florida If the Recount Had Finished? 1

NBER WORKING PAPER SERIES ENTRY AND ASYMMETRIC LOBBYING: WHY GOVERNMENTS PICK LOSERS. Richard E. Baldwin Frédéric Robert-Nicoud

1%(5:25.,1*3$3(56(5,(6 */2%$/352'8&7,216+$5,1*$1'5,6,1*,1(48$/,7< $6859(<2)75$'($1':$*(6 5REHUW&)HHQVWUD *RUGRQ++DQVRQ

HQPE and the journal literature in the history of economic thought

Analysis of Categorical Data from the California Department of Corrections

Combining national and constituency polling for forecasting

Hoboken Public Schools. AP Statistics Curriculum

Assessing the impact of the Sentencing Council s Allocation Guideline

FINAL PROJECT REPORT. University of Delaware Disaster Research Center. # 10 ENVIRONMENTAL CRISES Russell R. Dynes and Dennis E.

Biogeography-Based Optimization Combined with Evolutionary Strategy and Immigration Refusal

Welfarism and the assessment of social decision rules

Pork Barrel as a Signaling Tool: The Case of US Environmental Policy

STAATSKOERANT, 3 APRIL 2012 GOVERNMENT NOTICE DEPARTMENT OF POLICE SECOND-HAND GOODS ACT, 2009 REGULATIONS FOR DEALERS AND RECYCLERS

SCATTERGRAMS: ANSWERS AND DISCUSSION

Corruption and Economic Growth in Nigeria ( )

Factor Content of Intra-European Trade Flows

Political Economics II Spring Lectures 4-5 Part II Partisan Politics and Political Agency. Torsten Persson, IIES

On the Dynamics of Growth and Poverty in Cities

The migration model in EUROPOP2004

European Foundation for the Improvement of Living and Working Conditions

IV. Labour Market Institutions and Wage Inequality

A Note on Internet Use and the 2016 Election Outcome

DU PhD in Home Science

DOES AUSTRALIAN LAW RECOGNISE PUBLIC LITIGATION?

DISCUSSION PAPER SERIES

Statistical Analysis of Endorsement Experiments: Measuring Support for Militant Groups in Pakistan

Determinants of Unemployment in the Philippines 1

The Formal Independence of Regulators: A Comparison of 17 Countries and 7 Sectors

8 5 Sampling Distributions

Introduction to Path Analysis: Multivariate Regression

The Ruling Party and its Voting Power

Deindustrialization, Professionalization and Racial Inequality in Cape Town,

Predictable and unpredictable changes in party support: A method for long-range daily election forecasting from opinion polls

Supplementary Materials A: Figures for All 7 Surveys Figure S1-A: Distribution of Predicted Probabilities of Voting in Primary Elections

Gender preference and age at arrival among Asian immigrant women to the US

ARTICLE. Correlation Among Tardiness Based Measures for Scheduling using Priority Dispatching Rules

McNees Wallace & Nurick LLC

SEP 3 Q P.S.C. W.VA. M.C. FORMNO. 6 (M.C. Rule 9.1.h.) FILING FEE: $ PHONE: TRUX FAX: (304) (For PSC use only)

Being a Good Samaritan or just a politician? Empirical evidence of disaster assistance. Jeroen Klomp

A Retrospective Study of State Aid Control in the German Broadband Market

A comparative analysis of subreddit recommenders for Reddit

CMS Performance Note

Poverty Reduction and Economic Growth: The Asian Experience Peter Warr

Who Votes Without Identification? Using Affidavits from Michigan to Learn About the Potential Impact of Strict Photo Voter Identification Laws

The probability of the referendum paradox under maximal culture

Are all migrants really worse off in urban labour markets: new empirical evidence from China.

Appendix: Uncovering Patterns Among Latent Variables: Human Rights and De Facto Judicial Independence

Remittances and Poverty. in Guatemala* Richard H. Adams, Jr. Development Research Group (DECRG) MSN MC World Bank.

DATA AT WORK: NEGOTIATING CIVIL WARS

Public Opinions towards Gun Control vs. Gun Ownership. Society today is witnessing a major increase in violent crimes involving guns.

Minnesota. State Register. (Published every Monday (Tuesday when Monday is a holiday.)

ATTITUDES TOWARDS INCOME AND WEALTH INEQUALITY AND SUPPORT FOR SCOTTISH INDEPENDENCE OVER TIME AND THE INTERACTION WITH NATIONAL IDENTITY

Frequency table. Lecture 12: Relationships Between Categorical Variables. Contingency table. Bar plots

Economic Inequality and Class Consciousness

Macroeconomic Transmission Channel of International Remittance Flows Labour Market Adjustments and Dutch Disease Effect

Predictable and unpredictable changes in party support: A method for long-range daily election forecasting from opinion polls

Assessing the Impact of the Sentencing Council s Burglary Definitive Guideline on Sentencing Trends

Chapter. Sampling Distributions Pearson Prentice Hall. All rights reserved

ATUL DAR THE IMPACT OF IMPERFECT INFORMATION ON THE WAGES OF NATIVE-BORN AND IMMIGRANT WORKERS: EVIDENCE FROM THE 2006 CANADIAN CENSUS

The Direct Democracy Deficit in Two-tier Voting

Measuring Bias and Uncertainty in Ideal Point Estimates via the Parametric Bootstrap

A procedure to compute a probabilistic bound for the maximum tardiness using stochastic simulation

Candidate Repositioning. Michael Tomz Stanford University

THE DISTRIBUTION OF DISCRIMINATION IN IMMIGRANT EARNINGS - EVIDENCE FROM BRITAIN *

Condition Monitoring. An Important Element of Overall Mining Equipment Management. Tim Siekmann Caterpillar Global Mining

The Impact of the European Debt Crisis on Trust in Journalism

Vote Compass Methodology

When ego-involved and non ego-involved agents lead to polarization despite a large consensus

Many Voters May Have to Wait 30 Minutes or Longer to Vote on a DRE during Peak Voting Hours

Candidate Citizen Models

Appendix to Sectoral Economies

FOURIER ANALYSIS OF THE NUMBER OF PUBLIC LAWS David L. Farnsworth, Eisenhower College Michael G. Stratton, GTE Sylvania

VIRGINIA SELF-REPRESENTED LITIGANT STUDY:

Working Papers in Economics

Reforming the speed of justice: Evidence from an event study in Senegal

Human Capital and Development Accounting: New Evidence from Immigrant Earnings

Separate When Equal? Racial Inequality and Residential Segregation

Transcription:

ECE 510 Lecture 6 Confidence Liits Scott Johnson Glenn Shirley

Concepts 28 Jan 2013 S.C.Johnson, C.G.Shirley 2

Statistical Inference Population True ( population ) value = paraeter Saple Saple value = statistic Use a saple statistic to estiate a population paraeter 28 Jan 2013 S.C.Johnson, C.G.Shirley 3

Statistical Inference (Continuous) Population Mean=2.98 Stdev=0.50 Saple 1.5 2 2.5 3 3.5 4 4.5 1.5 2 2.5 3 3.5 4 4.5 paraeters Mean=3.00 Stdev=0.48 statistics 2.0W 2.5W 3.0W 3.5W 4.0W Exaple of continuous case: Use saple to estiate population ean and standard deviation 28 Jan 2013 S.C.Johnson, C.G.Shirley 4

Population Statistical Inference (Discrete) Saple 25,000 DPM paraeter 40,000 DPM statistic Good Unit Bad Unit Exaple of discrete case: Use saple to estiate population defect DPM (DPM=Defects Per Million) 28 Jan 2013 S.C.Johnson, C.G.Shirley 5

Note: Saples Must Be Rando! Population Not rando Population = 55,000 DPM Saple = 204,000 DPM Saple Good Unit Bad Unit Saples ust be representative of the entire population! Best to select saples truly randoly Not the first lot available or other partly-rando ethods No statistical analysis can correct for non-rando saples 28 Jan 2013 S.C.Johnson, C.G.Shirley 6

Probability Population Distributions of Statistics True ( population ) value = paraeter Saple Saple value = statistic Distribution of statistic: 0.2 0.15 Probability of Finding V when True Value = 200 Measured statistic is not enough Need to add either Confidence interval or liits Answer to a statistically-well-posed question ( hypothesis test ) Calculated fro distributions of statistics If we looked at any saples fro any identical populations, what values of the statistics ight we get? 0.1 0.05 0 0 200 400 600 Measured Value V 28 Jan 2013 S.C.Johnson, C.G.Shirley 7

Probability Probability Population has one true distribution: Distributions of Statistics (Continuous) Different saples have different distributions: σ (pop stdev) 2.0 3.0 4.0 μ (population ean) S 2.0 3.0 4.0 x S 2.0 3.0 4.0 x S 2.0 3.0 4.0 x Properties of saple distributions are statistics. We can calculate distributions of these statistics: 0.3 0.25 0.2 0.15 0.1 0.05 0 Distribution of Means (Noral) 2 2.5 3 3.5 4 Measured ean Distribution of Standard Deviations 0.2 0.15 0.1 0.05 0 (Chi-square) 0 0.5 1 1.5 Measured standard deviation We get one value for each fro our one saple. 28 Jan 2013 S.C.Johnson, C.G.Shirley 8

Probability Distributions of Statistics (Discrete) Population has one true DPM: 25,000 DPM Different saples have different DPMs: 20,000 DPM (1 fail) 0 DPM (0 fail) 40,000 DPM (2 fail) 60,000 DPM (3 fail) 20,000 DPM (1 fail) 40,000 DPM (2 fail) The easured saple DPM is a statistic. We can calculate the distribution of this statistic: PDF - Probability of Seeing x Fails 0.4 0.3 (Binoial) 0.2 0.1 0 0 1 2 3 4 5 6 7 8 9 10 Nuber of failures in saple We get one value fro our one saple. 28 Jan 2013 S.C.Johnson, C.G.Shirley 9

DPM Siulation 28 Jan 2013 S.C.Johnson, C.G.Shirley 10

Population Window Shows 10,000 units, ost good, a few bad 28 Jan 2013 S.C.Johnson, C.G.Shirley 11

The Saple You can ove the saple box 28 Jan 2013 S.C.Johnson, C.G.Shirley 12

DPM Indicator on DPM Histogra 6000 DPM 2000 DPM 28 Jan 2013 S.C.Johnson, C.G.Shirley 13

Binoial Histogra Gives probability of getting each easureent given the true DPM 28 Jan 2013 S.C.Johnson, C.G.Shirley 14

Binoial Distribution =binodist (6, 1000, 0.005, false) 6 fails 1000 saples 5000 DPM Not cuulative binodist N f N f f, N, p, false p 1 p f 28 Jan 2013 S.C.Johnson, C.G.Shirley 15

True DPM True DPM is adjustable Not in the real world, only the siulation! 28 Jan 2013 S.C.Johnson, C.G.Shirley 16

Low DPM 28 Jan 2013 S.C.Johnson, C.G.Shirley 17

High DPM 28 Jan 2013 S.C.Johnson, C.G.Shirley 18

Please put True DPM back to 5,000 28 Jan 2013 S.C.Johnson, C.G.Shirley 19

Sall Saple Size 28 Jan 2013 S.C.Johnson, C.G.Shirley 20

Large Saple Size 28 Jan 2013 S.C.Johnson, C.G.Shirley 21

Statistical Measureent Uncertainty Sall saple (400) = wide range 0 12,500 Large saple (2000) = narrow range 1500 8500 28 Jan 2013 S.C.Johnson, C.G.Shirley 22

(A) Set saple size = 1000 Exercise 6.1 (B) Set True DPM = 1100 DPM and look for a saple with 3 fails what DPM does that represent? (C) Set True DPM = 6700 DPM and look for a saple with 3 fails what DPM does that represent? 28 Jan 2013 S.C.Johnson, C.G.Shirley 23

Why We Need Confidence Liits Did you get a bad saple fro a good population? or a good saple fro a bad population? 28 Jan 2013 S.C.Johnson, C.G.Shirley 24

Confidence Liits 28 Jan 2013 S.C.Johnson, C.G.Shirley 25

Confidence Interval Meaning True DPM Confidence level = 90% = 0.9 Risk of being wrong = 1 confidence level = α = 10% = 0.1 90% of rando saple eans with this confidence interval include the true population ean 28 Jan 2013 S.C.Johnson, C.G.Shirley 26

1-Sided vs. 2-Sided 2-sided α/2 α/2 Upper α 1-sided Lower α 28 Jan 2013 S.C.Johnson, C.G.Shirley 27

1-Sided UCL Meaning True DPM 90% of rando saple eans with this confidence interval include the true population ean 28 Jan 2013 S.C.Johnson, C.G.Shirley 28

Calculating Confidence Liits 28 Jan 2013 S.C.Johnson, C.G.Shirley 29

Exercise 6.2 Monte Carlo deterination of binoial CL: In each row, siulate 10 pass/fail saples and count the nuber of fails Make a histogra of the count of runs that got each fail% Add the binoial prediction for each fail% Plot both as a bar chart Calculate cuulative values for your MC and calculated distributions Plot those with a line plot Use the cu plots to find the UCL and LCL for 3 fails / 10 units Copare to the analytic expressions (T&T section 11.3): LCL = BETAINV(5%, fails, saples fails+1) UCL = BETAINV(95%, fails+1, saples fails) 28 Jan 2013 S.C.Johnson, C.G.Shirley 30

Monte Carlo Exponential CL λ=0.022 MTTF = 45 hr λ=0.031 MTTF = 32 hr λ=0.042 MTTF = 24 hr 95% 5% 0.022 0.042 28 Jan 2013 S.C.Johnson, C.G.Shirley 31

Exercise 6.3 Monte Carlo deterination of exponential CL: In each row, siulate 50 exponentially distributed saples Deterine the best labda (exponential paraeter) for each row Make a CDF plot of the labda values Find the UCL and LCL for n=50 saples that found a labda of 3 Copare to the analytic expressions (T&T table 3.5): LCL = CHIINV(5%, 2*n) / (2*n) UCL = CHIINV(95%, 2*n+1) / (2*n) 28 Jan 2013 S.C.Johnson, C.G.Shirley 32

Analytic Exponential CL Answer: a gaa or a chi-square distribution Confidence intervals taken fro that 30 Jan 2013 ECE 510 S.C.Johnson, C.G.Shirley 33

The End 28 Jan 2013 S.C.Johnson, C.G.Shirley 34