Keough and Raimondi (1995) set up an experiment to examine the response of serpulid (polychaete worms) larvae to four types of biofilms on hard substrata in shallow marine waters. The four treatments were: sterile substrata, biofilms developed in the field with a net (to keep invertebrates), biofilms developed in the lab, and lab biofilms with a covering net (as a control for the presence of a net). The substrata were left for one week, and then the newly settled worms identified and counted. To control for small numbers of larvae passing through the netting during the conditioning period, they used an additional treatment, which was netted, and returned to the laboratory after one week and censused. The values of this treatment were used to adjust the numbers in the treatment that started in the field.

Serpulid polychaete worm. Photo M. Keough
Serpulid polychaete worm. Photo M. Keough

The paper is here and the data file (also used in first edition) is here

Keough, M. J. & Raimondi, P. T. (1995). Responses of settling invertebrate larvae to bioorganic films: effects of different types of films. Journal of Experimental Marine Biology and Ecology, 185, 235-53.

Preliminaries

First, load the required packages (pwr)

Import serpulid data file (serpulid.csv)

serpulid <- read.csv("../data/serpulid.csv")
head(serpulid,10)

Make film a factor

serpulid$film <- factor(serpulid$film)

Fit model for log(serpulids)

serpulid.aov <- aov(lserp~film, data=serpulid)

Check diagnostics

plot(serpulid.aov)

Generate overall anova table

summary(serpulid.aov)
            Df Sum Sq Mean Sq F value  Pr(>F)   
film         3 0.2458 0.08192   6.015 0.00331 **
Residuals   24 0.3269 0.01362                   
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

For information, get treatment means

aggregate(serpulid$lserp, list(serpulid$film), FUN=mean)

Generate planned comparisons

We’re doing this by defining contrasts and refitting the model using this contrast. The planned comparison then appears as the first effect when we look at the model fitting (i.e., film1).

UL vs NL

contrasts(serpulid$film) <- c(0,1,0,-1)
contrasts(serpulid$film)
   [,1]       [,2]       [,3]
F     0 -0.5000000 -0.7071068
NL    1 -0.1666667  0.4714045
SL    0  0.8333333 -0.2357023
UL   -1 -0.1666667  0.4714045
# Refit the model with new contrasts

serpulid.aov <- aov(lserp~film, data=serpulid)
summary.lm(serpulid.aov) 

Call:
aov(formula = lserp ~ film, data = serpulid)

Residuals:
     Min       1Q   Median       3Q      Max 
-0.22929 -0.06500  0.01843  0.07054  0.19557 

Coefficients:
            Estimate Std. Error t value Pr(>|t|)    
(Intercept)  2.09039    0.02206  94.780  < 2e-16 ***
film1        0.02479    0.03119   0.795  0.43461    
film2       -0.16407    0.04411  -3.720  0.00107 ** 
film3        0.08344    0.04411   1.892  0.07067 .  
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Residual standard error: 0.1167 on 24 degrees of freedom
Multiple R-squared:  0.4292,    Adjusted R-squared:  0.3578 
F-statistic: 6.015 on 3 and 24 DF,  p-value: 0.003314

F vs average (NL & UL)

contrasts(serpulid$film) <- c(2,-1,0,-1)
contrasts(serpulid$film)
   [,1]       [,2]        [,3]
F     2 -0.2867757  0.03306064
NL   -1 -0.3677574 -0.66939360
SL    0  0.8603272 -0.09918192
UL   -1 -0.2057940  0.73551488
# Refit the model with new contrasts

serpulid.aov <- aov(lserp~film, data=serpulid)
summary.lm(serpulid.aov) 

Call:
aov(formula = lserp ~ film, data = serpulid)

Residuals:
     Min       1Q   Median       3Q      Max 
-0.22929 -0.06500  0.01843  0.07054  0.19557 

Coefficients:
            Estimate Std. Error t value Pr(>|t|)    
(Intercept)  2.09039    0.02206  94.780  < 2e-16 ***
film1       -0.01455    0.01801  -0.808 0.427118    
film2       -0.18341    0.04411  -4.158 0.000353 ***
film3       -0.01414    0.04411  -0.321 0.751322    
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Residual standard error: 0.1167 on 24 degrees of freedom
Multiple R-squared:  0.4292,    Adjusted R-squared:  0.3578 
F-statistic: 6.015 on 3 and 24 DF,  p-value: 0.003314

SL vs average (F & NL & UL)

contrasts(serpulid$film) <- c(-1,-1,3,-1)
contrasts(serpulid$film)
   [,1]        [,2]       [,3]
F    -1 -0.67052910 -0.4658942
NL   -1  0.73874075 -0.3477481
SL    3  0.00000000  0.0000000
UL   -1 -0.06821164  0.8136423
# Refit the model with new contrasts
serpulid.aov <- aov(lserp~film, data=serpulid)
summary.lm(serpulid.aov) 

Call:
aov(formula = lserp ~ film, data = serpulid)

Residuals:
     Min       1Q   Median       3Q      Max 
-0.22929 -0.06500  0.01843  0.07054  0.19557 

Coefficients:
             Estimate Std. Error t value Pr(>|t|)    
(Intercept)  2.090393   0.022055  94.780  < 2e-16 ***
film1       -0.052131   0.012734  -4.094 0.000415 ***
film2        0.049265   0.044111   1.117 0.275117    
film3       -0.008453   0.044111  -0.192 0.849643    
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Residual standard error: 0.1167 on 24 degrees of freedom
Multiple R-squared:  0.4292,    Adjusted R-squared:  0.3578 
F-statistic: 6.015 on 3 and 24 DF,  p-value: 0.003314

Diagnostics for untransformed data

We used log-transformed data to match the original paper, but if analysing these data from first principles, we’d look at the raw data first to decide which form of model or transformation to use.

serpraw.aov <- aov(serp~film, data=serpulid)
plot(serpraw.aov)

Information for power analysis using spirorbids, Bugula

These calculations are used for Box 6.11, where we consider data for two other invertebrate groups, spirorbid polychaetes and bryozoans in the genus Bugula, mainly B. neritina.

Spirorbid polychaete worm, c. 2mm diameter. Mick Keough
Spirorbid polychaete worm, c. 2mm diameter. Mick Keough

Recently metamorphosed bryozoan, Bugula. Approximately 1.5 mm high. Mick Keough

Required information

We need to run the analysis on each of these groups, to get two important pieces of information. We need estimates of the variance, and we generally use the residual mean square. We also want an estimate of a baseline for calculating a hypothetical Effect Size. In the context of this question, we’ll use the means for unfilmed surfaces, as we are thinking about the potential for our treatments to increase recruitment.

boxplot(spir~film, data=serpulid)

boxplot(bugula~film, data=serpulid)

spir.aov<-aov(spir~film, data=serpulid)
plot(spir.aov)

summary(spir.aov)
            Df Sum Sq Mean Sq F value Pr(>F)
film         3  6.507   2.169   1.678  0.198
Residuals   24 31.022   1.293               
bugula.aov<-aov(bugula~film, data=serpulid)
plot(bugula.aov)

summary(bugula.aov)
            Df Sum Sq Mean Sq F value Pr(>F)
film         3   22.8   7.587   0.338  0.798
Residuals   24  538.3  22.429               
spirmean<-summarySE(data=serpulid,measurevar = "spir", groupvars = "film")
spirmean
bugmean<-summarySE(data=serpulid,measurevar = "bugula", groupvars = "film")
bugmean

Power calculations

There are two scenarios in Box 6.11. Both involve a doubling of settlement from the base treatment SL above. In the first scenario, one treatment is 6.86 and the others are 13.72. In the second scenario, treatment means are spaced evenly between 6.86 and 13.72.

alphasq1<-3*var(c(6.86, 13.72, 13.72,13.72))
alphasq2<-3*var(c(6.86, 9.14, 11.44,13.72))
msres=22.43
n=7
p=4
lambda1<-n*alphasq1/msres
lambda1
[1] 11.01484
lambda2<-n*alphasq2/msres
lambda2
[1] 8.168685
f1<-sqrt(alphasq1/p/msres)
f1
[1] 0.6272059
f2<-sqrt(alphasq2/p/msres)
f2
[1] 0.5401285
#For scenario 1, λ= 11.01 and Cohens *f* = 0.627
#For scenario 2, λ= 8.16 and Cohens *f* = 0.54
# scenario 1: power
pwr.anova.test(k=p,f=f1,sig.level=0.05, n=n)

     Balanced one-way analysis of variance power calculation 

              k = 4
              n = 7
              f = 0.6272059
      sig.level = 0.05
          power = 0.7298327

NOTE: n is number in each group
#scenario 2: power
pwr.anova.test(k=p,f=f2,sig.level=0.05, n=n)

     Balanced one-way analysis of variance power calculation 

              k = 4
              n = 7
              f = 0.5401285
      sig.level = 0.05
          power = 0.5860053

NOTE: n is number in each group
#scenario 1: required sample size
pwr.anova.test(k=p,f=f1,sig.level=0.05, power=0.8)

     Balanced one-way analysis of variance power calculation 

              k = 4
              n = 7.976459
              f = 0.6272059
      sig.level = 0.05
          power = 0.8

NOTE: n is number in each group
#scenario 2: required sample size
pwr.anova.test(k=p,f=f2,sig.level=0.05, power=0.8)

     Balanced one-way analysis of variance power calculation 

              k = 4
              n = 10.37355
              f = 0.5401285
      sig.level = 0.05
          power = 0.8

NOTE: n is number in each group
LS0tCnRpdGxlOiAiUUsgQm94IDYuNyAmIDYuMTEiCm91dHB1dDogCiAgaHRtbF9ub3RlYm9vazoKICAgIHRoZW1lOiBmbGF0bHkKLS0tCgpgYGB7ciBzZXR1cCwgaW5jbHVkZT1GQUxTRX0Ka25pdHI6Om9wdHNfY2h1bmskc2V0KGVjaG8gPSBUUlVFKQpgYGAKCktlb3VnaCBhbmQgUmFpbW9uZGkgKDE5OTUpIHNldCB1cCBhbiBleHBlcmltZW50IHRvIGV4YW1pbmUgdGhlIHJlc3BvbnNlIG9mIHNlcnB1bGlkIChwb2x5Y2hhZXRlIHdvcm1zKSBsYXJ2YWUgdG8gZm91ciB0eXBlcyBvZiBiaW9maWxtcyBvbiBoYXJkIHN1YnN0cmF0YSBpbiBzaGFsbG93IG1hcmluZSB3YXRlcnMuIFRoZSBmb3VyIHRyZWF0bWVudHMgd2VyZTogc3RlcmlsZSBzdWJzdHJhdGEsIGJpb2ZpbG1zIGRldmVsb3BlZCBpbiB0aGUgZmllbGQgd2l0aCBhIG5ldCAodG8ga2VlcCBpbnZlcnRlYnJhdGVzKSwgYmlvZmlsbXMgZGV2ZWxvcGVkIGluIHRoZSBsYWIsIGFuZCBsYWIgYmlvZmlsbXMgd2l0aCBhIGNvdmVyaW5nIG5ldCAoYXMgYSBjb250cm9sIGZvciB0aGUgcHJlc2VuY2Ugb2YgYSBuZXQpLiBUaGUgc3Vic3RyYXRhIHdlcmUgbGVmdCBmb3Igb25lIHdlZWssIGFuZCB0aGVuIHRoZSBuZXdseSBzZXR0bGVkIHdvcm1zIGlkZW50aWZpZWQgYW5kIGNvdW50ZWQuIFRvIGNvbnRyb2wgZm9yIHNtYWxsIG51bWJlcnMgb2YgbGFydmFlIHBhc3NpbmcgdGhyb3VnaCB0aGUgbmV0dGluZyBkdXJpbmcgdGhlIGNvbmRpdGlvbmluZyBwZXJpb2QsIHRoZXkgdXNlZCBhbiBhZGRpdGlvbmFsIHRyZWF0bWVudCwgd2hpY2ggd2FzIG5ldHRlZCwgYW5kIHJldHVybmVkIHRvIHRoZSBsYWJvcmF0b3J5IGFmdGVyIG9uZSB3ZWVrIGFuZCBjZW5zdXNlZC4gVGhlIHZhbHVlcyBvZiB0aGlzIHRyZWF0bWVudCB3ZXJlIHVzZWQgdG8gYWRqdXN0IHRoZSBudW1iZXJzIGluIHRoZSB0cmVhdG1lbnQgdGhhdCBzdGFydGVkIGluIHRoZSBmaWVsZC4KCiFbU2VycHVsaWQgcG9seWNoYWV0ZSB3b3JtLiBQaG90byBNLiBLZW91Z2ggWyFbXShpbWFnZXMvYnktMDMucG5nKXt3aWR0aD0iNTcifV0oIzApXSguLi9tZWRpYS9zZXJwdWxpZDIuanBnKXt3aWR0aD0iODAwIn0KClRoZSBwYXBlciBpcyBoZXJlIGFuZCB0aGUgZGF0YSBmaWxlIChhbHNvIHVzZWQgaW4gZmlyc3QgZWRpdGlvbikgaXMgW2hlcmVdKC4uL2RhdGEvc2VycHVsaWQuY3N2KQoKS2VvdWdoLCBNLiBKLiAmIFJhaW1vbmRpLCBQLiBULiAoMTk5NSkuIFJlc3BvbnNlcyBvZiBzZXR0bGluZyBpbnZlcnRlYnJhdGUgbGFydmFlIHRvIGJpb29yZ2FuaWMgZmlsbXM6IGVmZmVjdHMgb2YgZGlmZmVyZW50IHR5cGVzIG9mIGZpbG1zLiAqSm91cm5hbCBvZiBFeHBlcmltZW50YWwgTWFyaW5lIEJpb2xvZ3kgYW5kIEVjb2xvZ3kqLCAxODUsIDIzNS01My4KCiMjIyBQcmVsaW1pbmFyaWVzCgpGaXJzdCwgbG9hZCB0aGUgcmVxdWlyZWQgcGFja2FnZXMgKHB3cikKCmBgYHtyIGluY2x1ZGU9RkFMU0UsIHJlc3VsdHM9J2hpZGUnfQpzb3VyY2UoIi4uL1IvbGlicmFyaWVzLlIiKSAgICNUaGlzIGlzIHRoZSBjb21tb24gbGlicmFyeQpsaWJyYXJ5KHB3cikKYGBgCgpJbXBvcnQgc2VycHVsaWQgZGF0YSBmaWxlIChzZXJwdWxpZC5jc3YpCgpgYGB7cn0Kc2VycHVsaWQgPC0gcmVhZC5jc3YoIi4uL2RhdGEvc2VycHVsaWQuY3N2IikKaGVhZChzZXJwdWxpZCwxMCkKYGBgCgpNYWtlIGZpbG0gYSBmYWN0b3IKCmBgYHtyIH0Kc2VycHVsaWQkZmlsbSA8LSBmYWN0b3Ioc2VycHVsaWQkZmlsbSkKYGBgCgojIyMgRml0IG1vZGVsIGZvciBsb2coc2VycHVsaWRzKQoKYGBge3IgfQpzZXJwdWxpZC5hb3YgPC0gYW92KGxzZXJwfmZpbG0sIGRhdGE9c2VycHVsaWQpCmBgYAoKQ2hlY2sgZGlhZ25vc3RpY3MKCmBgYHtyIH0KcGxvdChzZXJwdWxpZC5hb3YpCmBgYAoKR2VuZXJhdGUgb3ZlcmFsbCBhbm92YSB0YWJsZQoKYGBge3J9CnN1bW1hcnkoc2VycHVsaWQuYW92KQpgYGAKCkZvciBpbmZvcm1hdGlvbiwgZ2V0IHRyZWF0bWVudCBtZWFucwoKYGBge3J9CmFnZ3JlZ2F0ZShzZXJwdWxpZCRsc2VycCwgbGlzdChzZXJwdWxpZCRmaWxtKSwgRlVOPW1lYW4pCmBgYAoKIyMgR2VuZXJhdGUgcGxhbm5lZCBjb21wYXJpc29ucwoKV2UncmUgZG9pbmcgdGhpcyBieSBkZWZpbmluZyBjb250cmFzdHMgYW5kIHJlZml0dGluZyB0aGUgbW9kZWwgdXNpbmcgdGhpcyBjb250cmFzdC4gVGhlIHBsYW5uZWQgY29tcGFyaXNvbiB0aGVuIGFwcGVhcnMgYXMgdGhlIGZpcnN0IGVmZmVjdCB3aGVuIHdlIGxvb2sgYXQgdGhlIG1vZGVsIGZpdHRpbmcgKGkuZS4sIGZpbG0xKS4KCiMjIyBVTCB2cyBOTAoKYGBge3J9CmNvbnRyYXN0cyhzZXJwdWxpZCRmaWxtKSA8LSBjKDAsMSwwLC0xKQpjb250cmFzdHMoc2VycHVsaWQkZmlsbSkKCiMgUmVmaXQgdGhlIG1vZGVsIHdpdGggbmV3IGNvbnRyYXN0cwoKc2VycHVsaWQuYW92IDwtIGFvdihsc2VycH5maWxtLCBkYXRhPXNlcnB1bGlkKQpzdW1tYXJ5LmxtKHNlcnB1bGlkLmFvdikgCmBgYAoKIyMjIEYgdnMgYXZlcmFnZSAoTkwgJiBVTCkKCmBgYHtyfQpjb250cmFzdHMoc2VycHVsaWQkZmlsbSkgPC0gYygyLC0xLDAsLTEpCmNvbnRyYXN0cyhzZXJwdWxpZCRmaWxtKQoKIyBSZWZpdCB0aGUgbW9kZWwgd2l0aCBuZXcgY29udHJhc3RzCgpzZXJwdWxpZC5hb3YgPC0gYW92KGxzZXJwfmZpbG0sIGRhdGE9c2VycHVsaWQpCnN1bW1hcnkubG0oc2VycHVsaWQuYW92KSAKYGBgCgojIyMgU0wgdnMgYXZlcmFnZSAoRiAmIE5MICYgVUwpCgpgYGB7cn0KY29udHJhc3RzKHNlcnB1bGlkJGZpbG0pIDwtIGMoLTEsLTEsMywtMSkKY29udHJhc3RzKHNlcnB1bGlkJGZpbG0pCgojIFJlZml0IHRoZSBtb2RlbCB3aXRoIG5ldyBjb250cmFzdHMKc2VycHVsaWQuYW92IDwtIGFvdihsc2VycH5maWxtLCBkYXRhPXNlcnB1bGlkKQpzdW1tYXJ5LmxtKHNlcnB1bGlkLmFvdikgCmBgYAoKIyMgRGlhZ25vc3RpY3MgZm9yIHVudHJhbnNmb3JtZWQgZGF0YQoKV2UgdXNlZCBsb2ctdHJhbnNmb3JtZWQgZGF0YSB0byBtYXRjaCB0aGUgb3JpZ2luYWwgcGFwZXIsIGJ1dCBpZiBhbmFseXNpbmcgdGhlc2UgZGF0YSBmcm9tIGZpcnN0IHByaW5jaXBsZXMsIHdlJ2QgbG9vayBhdCB0aGUgcmF3IGRhdGEgZmlyc3QgdG8gZGVjaWRlIHdoaWNoIGZvcm0gb2YgbW9kZWwgb3IgdHJhbnNmb3JtYXRpb24gdG8gdXNlLgoKYGBge3J9CnNlcnByYXcuYW92IDwtIGFvdihzZXJwfmZpbG0sIGRhdGE9c2VycHVsaWQpCnBsb3Qoc2VycHJhdy5hb3YpCmBgYAoKIyMgSW5mb3JtYXRpb24gZm9yIHBvd2VyIGFuYWx5c2lzIHVzaW5nIHNwaXJvcmJpZHMsICpCdWd1bGEqCgpUaGVzZSBjYWxjdWxhdGlvbnMgYXJlIHVzZWQgZm9yIEJveCA2LjExLCB3aGVyZSB3ZSBjb25zaWRlciBkYXRhIGZvciB0d28gb3RoZXIgaW52ZXJ0ZWJyYXRlIGdyb3Vwcywgc3Bpcm9yYmlkIHBvbHljaGFldGVzIGFuZCBicnlvem9hbnMgaW4gdGhlIGdlbnVzICpCdWd1bGEqLCBtYWlubHkgKkIuIG5lcml0aW5hLioKCiFbU3Bpcm9yYmlkIHBvbHljaGFldGUgd29ybSwgYy4gMm1tIGRpYW1ldGVyLiBNaWNrIEtlb3VnaCBbIVtdKGltYWdlcy9ieS0wMy5wbmcpe3dpZHRoPSI1NyJ9XSgjMCldKC4uL21lZGlhL3NwaXJvcmJpZC5qcGcpe3dpZHRoPSI1MjUifQoKIVtdKC4uL21lZGlhL2J1Z3VsYS5qcGcpCgpSZWNlbnRseSBtZXRhbW9ycGhvc2VkIGJyeW96b2FuLCAqQnVndWxhKi4gQXBwcm94aW1hdGVseSAxLjUgbW0gaGlnaC4gTWljayBLZW91Z2ggWyFbXShpbWFnZXMvYnktMDMucG5nKXt3aWR0aD0iNTcifV0oaHR0cHM6Ly9jcmVhdGl2ZWNvbW1vbnMub3JnL2xpY2Vuc2VzL2J5LzQuMC8pCgojIyMgUmVxdWlyZWQgaW5mb3JtYXRpb24KCldlIG5lZWQgdG8gcnVuIHRoZSBhbmFseXNpcyBvbiBlYWNoIG9mIHRoZXNlIGdyb3VwcywgdG8gZ2V0IHR3byBpbXBvcnRhbnQgcGllY2VzIG9mIGluZm9ybWF0aW9uLiBXZSBuZWVkIGVzdGltYXRlcyBvZiB0aGUgdmFyaWFuY2UsIGFuZCB3ZSBnZW5lcmFsbHkgdXNlIHRoZSByZXNpZHVhbCBtZWFuIHNxdWFyZS4gV2UgYWxzbyB3YW50IGFuIGVzdGltYXRlIG9mIGEgYmFzZWxpbmUgZm9yIGNhbGN1bGF0aW5nIGEgaHlwb3RoZXRpY2FsIEVmZmVjdCBTaXplLiBJbiB0aGUgY29udGV4dCBvZiB0aGlzIHF1ZXN0aW9uLCB3ZSdsbCB1c2UgdGhlIG1lYW5zIGZvciB1bmZpbG1lZCBzdXJmYWNlcywgYXMgd2UgYXJlIHRoaW5raW5nIGFib3V0IHRoZSBwb3RlbnRpYWwgZm9yIG91ciB0cmVhdG1lbnRzIHRvIGluY3JlYXNlIHJlY3J1aXRtZW50LgoKYGBge3J9CmJveHBsb3Qoc3Bpcn5maWxtLCBkYXRhPXNlcnB1bGlkKQpib3hwbG90KGJ1Z3VsYX5maWxtLCBkYXRhPXNlcnB1bGlkKQpzcGlyLmFvdjwtYW92KHNwaXJ+ZmlsbSwgZGF0YT1zZXJwdWxpZCkKcGxvdChzcGlyLmFvdikKc3VtbWFyeShzcGlyLmFvdikKYnVndWxhLmFvdjwtYW92KGJ1Z3VsYX5maWxtLCBkYXRhPXNlcnB1bGlkKQpwbG90KGJ1Z3VsYS5hb3YpCnN1bW1hcnkoYnVndWxhLmFvdikKc3Bpcm1lYW48LXN1bW1hcnlTRShkYXRhPXNlcnB1bGlkLG1lYXN1cmV2YXIgPSAic3BpciIsIGdyb3VwdmFycyA9ICJmaWxtIikKc3Bpcm1lYW4KYnVnbWVhbjwtc3VtbWFyeVNFKGRhdGE9c2VycHVsaWQsbWVhc3VyZXZhciA9ICJidWd1bGEiLCBncm91cHZhcnMgPSAiZmlsbSIpCmJ1Z21lYW4KYGBgCgojIyMgUG93ZXIgY2FsY3VsYXRpb25zCgpUaGVyZSBhcmUgdHdvIHNjZW5hcmlvcyBpbiBCb3ggNi4xMS4gQm90aCBpbnZvbHZlIGEgZG91Ymxpbmcgb2Ygc2V0dGxlbWVudCBmcm9tIHRoZSBiYXNlIHRyZWF0bWVudCBTTCBhYm92ZS4gSW4gdGhlIGZpcnN0IHNjZW5hcmlvLCBvbmUgdHJlYXRtZW50IGlzIDYuODYgYW5kIHRoZSBvdGhlcnMgYXJlIDEzLjcyLiBJbiB0aGUgc2Vjb25kIHNjZW5hcmlvLCB0cmVhdG1lbnQgbWVhbnMgYXJlIHNwYWNlZCBldmVubHkgYmV0d2VlbiA2Ljg2IGFuZCAxMy43Mi4KCmBgYHtyfQphbHBoYXNxMTwtMyp2YXIoYyg2Ljg2LCAxMy43MiwgMTMuNzIsMTMuNzIpKQphbHBoYXNxMjwtMyp2YXIoYyg2Ljg2LCA5LjE0LCAxMS40NCwxMy43MikpCm1zcmVzPTIyLjQzCm49NwpwPTQKbGFtYmRhMTwtbiphbHBoYXNxMS9tc3JlcwpsYW1iZGExCmxhbWJkYTI8LW4qYWxwaGFzcTIvbXNyZXMKbGFtYmRhMgpmMTwtc3FydChhbHBoYXNxMS9wL21zcmVzKQpmMQpmMjwtc3FydChhbHBoYXNxMi9wL21zcmVzKQpmMgoKI0ZvciBzY2VuYXJpbyAxLCDOuz0gMTEuMDEgYW5kIENvaGVucyAqZiogPSAwLjYyNwojRm9yIHNjZW5hcmlvIDIsIM67PSA4LjE2IGFuZCBDb2hlbnMgKmYqID0gMC41NAojIHNjZW5hcmlvIDE6IHBvd2VyCnB3ci5hbm92YS50ZXN0KGs9cCxmPWYxLHNpZy5sZXZlbD0wLjA1LCBuPW4pCiNzY2VuYXJpbyAyOiBwb3dlcgpwd3IuYW5vdmEudGVzdChrPXAsZj1mMixzaWcubGV2ZWw9MC4wNSwgbj1uKQojc2NlbmFyaW8gMTogcmVxdWlyZWQgc2FtcGxlIHNpemUKcHdyLmFub3ZhLnRlc3Qoaz1wLGY9ZjEsc2lnLmxldmVsPTAuMDUsIHBvd2VyPTAuOCkKI3NjZW5hcmlvIDI6IHJlcXVpcmVkIHNhbXBsZSBzaXplCnB3ci5hbm92YS50ZXN0KGs9cCxmPWYyLHNpZy5sZXZlbD0wLjA1LCBwb3dlcj0wLjgpCmBgYAo=