Skip to content

← statistics package

MultipleComparisonCorrection

Correct p-values for multiple comparisons (multiple dependent variables).

This should typically be performed on mass-univariate statistics, e.g., the univar_stats output of the MANCOVA node. Each factor (i.e. explanatory-variable) level will be corrected independently, which are assumed to be indexed by a feature axis. Optionally each space axis entry (channel) may be corrected independently, as well. All other axes (indexing dependent variables) will be treated as flattened for the purposes of the correction. More Info... Version 1.1.0

Ports/Properties

data

Packet with stats chunk to process.

verbose name
Data
default value
None
port type
DataPort
value type
Packet (can be None)
data direction
INOUT

method

Method used for testing and adjustment of pvalues. Available methods to control for the family-wise error rate (FWER) are: - bonferroni : The highly conservative Bonferroni correction; best if the tested variables tend to be independent, and only suitable for at most a modest number of variables (least powerful in a statistical sense). - sidak : The Sidak correction; slightly less conservative / more powerful than Bonferroni (not conservative in the presence of negative dependencies between variables) - holm : A "step-down" (sequential testing) variant of Bonferroni, uniformly more powerful than the former, and can thus handle more variables. - holm-sidak : Step-down variant of the Sidak formula; uniformly more powerful and can handle more variables than Sidak, but inherits the caveat about negative dependencies. - simes-hochberg : A "step-up" procedure that is applicable for variables that are not negatively dependent, with different assumptions and caveats compared to holm and holm-sidak. - hommel : A "closed testing" method also based on Simes tests but with somewhat different assumptions and caveats. Not applicable in the presence of negatively-correlated variables. Slow for large arrays. Available methods to control for false discovery rate (FDR) are: - fdr_bh : The classic Benjamini/Hochberg correction for FDR; this method is not applicable if variables can be negatively dependent. - fdr_by : The Benjamini/Yekutieli correction for FDR; this method does handle any kind of dependency, including negative dependency. - fdr_tsbh : A two-stage variant of the Benjamini-Hochberg method that depends on the given alpha level (with higher statistical power than fdr_bh). Not applicable if variables can be negatively dependent. - fdr_tsbky : The Benjamini-Krieger-Yekutieli correction for FDR, also a two-stage variant, but one that can handle any kind of dependency structure (including negative). Corrected p-values depend o the alpha level, which needs to be supplied.

verbose name
Method
default value
fdr_bh
port type
EnumPort
value type
str (can be None)

space_is_independent

Each item in the space axis (i.e . each channel) will be corrected independently of other items in the space axis. Since the correction will not be representative of the total number of comparisons made, this should be noted alongside the results, if used. If set to False, all comparisons present in the data will be accounted for (more conservative).

verbose name
Space Is Independent
default value
True
port type
BoolPort
value type
bool (can be None)

alpha

Desired alpha level for two-stage procedures. This value is only required for the two-stage FDR procedures and represents the false discovery rate that shall be maintained (i.e., the same alpha that shall be used in a subsequent significance test of the corrected p-values).

verbose name
Alpha
default value
0.05
port type
FloatPort
value type
float (can be None)

set_breakpoint

Set a breakpoint on this node. If this is enabled, your debugger (if one is attached) will trigger a breakpoint.

verbose name
Set Breakpoint (Debug Only)
default value
False
port type
BoolPort
value type
bool (can be None)

metadata

User-definable meta-data associated with the node. Usually reserved for technical purposes.

verbose name
Metadata
default value
{}
port type
DictPort
value type
dict (can be None)