词条 | Blocking (statistics) | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
释义 |
In the statistical theory of the design of experiments, blocking is the arranging of experimental units in groups (blocks) that are similar to one another. UseBlocking reduces unexplained variability. Its principle lies in the fact that variability which cannot be overcome (e.g. needing two batches of raw material to produce 1 container of a chemical) is confounded or aliased with a(n) (higher/highest order) interaction to eliminate its influence on the end product. High order interactions are usually of the least importance (think of the fact that temperature of a reactor or the batch of raw materials is more important than the combination of the two - this is especially true when more (3, 4, ...) factors are present); thus it is preferable to confound this variability with the higher interaction. Examples
Randomized block designIn the statistical theory of the design of experiments, blocking is the arranging of experimental units in groups (blocks) that are similar to one another. Typically, a blocking factor is a source of variability that is not of primary interest to the experimenter. An example of a blocking factor might be the sex of a patient; by blocking on sex, this source of variability is controlled for, thus leading to greater accuracy. In Probability Theory the blocks method consists of splitting a sample into blocks (groups) separated by smaller subblocks so that the blocks can be considered almost independent. The blocks method helps proving limit theorems in the case of dependent random variables. The blocks method was introduced by S.Bernstein: Bernstein S.N. (1926) Sur l'extension du théorème limite du calcul des probabilités aux sommes de quantités dépendantes. -- Math. Annalen, v. 97, 1-59. The method was successfully applied in the theory of sums of dependent random variables and in Extreme Value Theory: Ibragimov I.A. and Linnik Yu.V. (1971) Independent and stationary sequences of random variables. Wolters-Noordhoff, Groningen. Leadbetter M.R., Lindgren G. and Rootzén H. (1983) Extremes and Related Properties of Random Sequences and Processes. New York: Springer Verlag. Novak S.Y. (2011) Extreme Value Methods with Applications to Finance. Chapman & Hall/CRC Press, London. Blocking used for nuisance factors that can be controlledWhen we can control nuisance factors, an important technique known as blocking can be used to reduce or eliminate the contribution to experimental error contributed by nuisance factors. The basic concept is to create homogeneous blocks in which the nuisance factors are held constant and the factor of interest is allowed to vary. Within blocks, it is possible to assess the effect of different levels of the factor of interest without having to worry about variations due to changes of the block factors, which are accounted for in the analysis. Definition of blocking factorsA nuisance factor is used as a blocking factor if every level of the primary factor occurs the same number of times with each level of the nuisance factor. The analysis of the experiment will focus on the effect of varying levels of the primary factor within each block of the experiment. Block a few of the most important nuisance factorsThe general rule is: “Block what you can; randomize what you cannot.” Blocking is used to remove the effects of a few of the most important nuisance variables. Randomization is then used to reduce the contaminating effects of the remaining nuisance variables. For important nuisance variables, blocking will yield higher significance in the variables of interest than randomizing. Table of randomized block designsOne useful way to look at a randomized block experiment is to consider it as a collection of completely randomized experiments, each run within one of the blocks of the total experiment.
with L1 = number of levels (settings) of factor 1 L2 = number of levels (settings) of factor 2 L3 = number of levels (settings) of factor 3 L4 = number of levels (settings) of factor 4 Lk = number of levels (settings) of factor k Example of a Randomized Block DesignSuppose engineers at a semiconductor manufacturing facility want to test whether different wafer implant material dosages have a significant effect on resistivity measurements after a diffusion process taking place in a furnace. They have four different dosages they want to try and enough experimental wafers from the same lot to run three wafers at each of the dosages. The nuisance factor they are concerned with is "furnace run" since it is known that each furnace run differs from the last and impacts many process parameters. An ideal way to run this experiment would be to run all the 4x3=12 wafers in the same furnace run. That would eliminate the nuisance furnace factor completely. However, regular production wafers have furnace priority, and only a few experimental wafers are allowed into any furnace run at the same time. A non-blocked way to run this experiment would be to run each of the twelve experimental wafers, in random order, one per furnace run. That would increase the experimental error of each resistivity measurement by the run-to-run furnace variability and make it more difficult to study the effects of the different dosages. The blocked way to run this experiment, assuming you can convince manufacturing to let you put four experimental wafers in a furnace run, would be to put four wafers with different dosages in each of three furnace runs. The only randomization would be choosing which of the three wafers with dosage 1 would go into furnace run 1, and similarly for the wafers with dosages 2, 3 and 4. Description of the experimentLet X1 be dosage "level" and X2 be the blocking factor furnace run. Then the experiment can be described as follows: k = 2 factors (1 primary factor X1 and 1 blocking factor X2) L1 = 4 levels of factor X1 L2 = 3 levels of factor X2 n = 1 replication per cell N = L1 * L2 = 4 * 3 = 12 runs Before randomization, the design trials look like:
Matrix RepresentationAn alternate way of summarizing the design trials would be to use a 4x3 matrix whose 4 rows are the levels of the treatment X1 and whose columns are the 3 levels of the blocking variable X2. The cells in the matrix have indices that match the X1, X2 combinations above.
By extension, note that the trials for any K-factor randomized block design are simply the cell indices of a k dimensional matrix. Model for a Randomized Block DesignThe model for a randomized block design with one nuisance variable is where Yij is any observation for which X1 = i and X2 = j X1 is the primary factor X2 is the blocking factor μ is the general location parameter (i.e., the mean) Ti is the effect for being in treatment i (of factor X1) Bj is the effect for being in block j (of factor X2) Estimates for a Randomized Block DesignEstimate for μ : = the average of all the data Estimate for Ti : with = average of all Y for which X1 = i. Estimate for Bj : with = average of all Y for which X2 = j. Generalizations of randomized block designs
Theoretical basisThe theoretical basis of blocking is the following mathematical result. Given random variables, X and Y The difference between the treatment and the control can thus be given minimum variance (i.e. maximum precision) by maximising the covariance (or the correlation) between X and Y. See also{{Portal|Statistics}}
Bibliography
|doi=10.2307/2681737 |title=The Generalized Randomized Block Design |authorlink=Sidney Addelman |first=S. |last=Addelman |journal=The American Statistician |volume=23 |issue=4 |date=1969 |pages=35–36 |jstor=2681737 }}
|doi=10.2307/2284277 |title=Variability of Treatments and Experimental Units in the Design and Analysis of Experiments |first=S. |last=Addelman |journal=Journal of the American Statistical Association |volume=65 |issue=331 |date=1970 |pages=1095–1108 |jstor = 2284277 }}
|author1= Caliński T. |author2=Kageyama S. |lastauthoramp=yes |title=Block designs: A Randomization approach, Volume I: Analysis |series=Lecture Notes in Statistics |volume=150 |publisher=Springer-Verlag |location=New York |year=2000 |isbn=0-387-98578-6 }}
|author1=Caliński T. |author2=Kageyama S. |lastauthoramp=yes |title=Block designs: A Randomization approach, Volume II: Design |series=Lecture Notes in Statistics |volume=170 |publisher=Springer-Verlag |location=New York |year=2003 |isbn=0-387-95470-8|mr=1994124 }}
|doi=10.2307/2684574 |title=What Really Is Experimental Error in Block Designs? |first=C.E. |last=Gates |journal=The American Statistician |volume=49 |issue=4 |date=Nov 1995 |pages = 362–363 |jstor = 2684574 }}
|author=Kempthorne, Oscar |year=1979 |title=The Design and Analysis of Experiments |edition=Corrected reprint of (1952) Wiley |publisher=Robert E. Krieger |isbn=0-88275-105-0 }}
|author=Hinkelmann, Klaus and Kempthorne, Oscar |year=2008 |title=Design and Analysis of Experiments |volume=I and II |edition=Second |publisher=Wiley |isbn=978-0-470-38551-7}}
|author=Hinkelmann, Klaus and Kempthorne, Oscar |year=2008 |title=Design and Analysis of Experiments, Volume I: Introduction to Experimental Design |edition=Second |publisher=Wiley |isbn=978-0-471-72756-9 }}
|author=Hinkelmann, Klaus and Kempthorne, Oscar |year=2005 |title=Design and Analysis of Experiments, Volume 2: Advanced Experimental Design |edition=First |publisher=Wiley |isbn=978-0-471-55177-5 }}
|first=Marvin |last=Lentner |author2=Thomas Bishop |chapter=The Generalized RCB Design (Chapter 6.13) |pages=225–226 |title=Experimental design and analysis |edition=Second |publisher=Valley Book Company |location=P.O. Box 884, Blacksburg, VA 24063 |year=1993 |isbn=0-9616255-2-X }}
|title=Constructions and Combinatorial Problems in Design of Experiments |author=Raghavarao, Damaraju |location=New York |year=1988 |edition=corrected reprint of the 1971 Wiley |publisher=Dover |isbn=0-486-65685-3 }}
|title=Block Designs: Analysis, Combinatorics and Applications |author=Raghavarao, Damaraju and Padgett, L.V. |year=2005 |edition= |publisher=World Scientific |isbn=981-256-360-1 }}
|author1=Street, Anne Penfold|author1-link=Anne Penfold Street |author2=Street, Deborah J. |lastauthoramp=yes |title=Combinatorics of Experimental Design |publisher=Oxford U. P. [Clarendon] |year=1987 |pages=400+xiv |isbn=0-19-853256-3 }}
|title=The Randomization Analysis of a Generalized Randomized Block Design |first=M. B. |last=Wilk |journal=Biometrika |volume=42 |issue=1–2 |date=1955 |pages=70–79 | jstor = 2333423 |doi=10.2307/2333423 }}
|title=Some Consequences of randomization in a Generalization of the Balanced Incomplete Block Design |first=George |last=Zyskind |journal=The Annals of Mathematical Statistics |volume=34 |issue=4 |date=1963 |pages=1569–1581 |jstor = 2238364 |doi = 10.1214/aoms/1177703889 }} External links
1 : Design of experiments |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
随便看 |
|
开放百科全书收录14589846条英语、德语、日语等多语种百科知识,基本涵盖了大多数领域的百科知识,是一部内容自由、开放的电子版国际百科全书。