Testing of hypothesis: what is hypothesis, basic concept concerning testing of hypothesis , procedure of hypothesis testing

Hypothesis testing is a statistical method used to make decisions about a population based on sample data. You start with a null hypothesis (H₀, the default "no effect" claim) and an alternative hypothesis (H₁, the claim you want to test). Using sample data, you calculate a test statistic and compare it to a critical value (or use a p-value) to decide whether to reject H₀ or not.
Basic concepts include: significance level (α, usually 0.05), Type I error (rejecting a true H₀), Type II error (failing to reject a false H₀), p-value, one-tailed vs two-tailed tests, and critical regions.
Procedure: (1) State H₀ and H₁, (2) Choose significance level, (3) Select appropriate test, (4) Calculate test statistic, (5) Find critical value or p-value, (6) Make a decision, (7) Interpret results.
Searching sources...
Searching the Web

hypothesis testing basic concepts procedure statistics

Finding Sources
Now let me read the most relevant sections from the textbooks to get detailed content:
Reading File
Reading File
Finding Sources
Now let me get the detailed content from the most relevant sources:
Reading File
Reading File
Reading File
I now have excellent content from multiple textbook sources. Let me compile a thorough, well-structured answer.

Testing of Hypothesis: Complete Guide


1. What is a Hypothesis?

A hypothesis is a statement or claim about a property of a population. In research, it is a tentative assumption made to draw out and test its logical or empirical consequences. Hypotheses are the foundation of inferential statistics - they allow us to move from sample data to conclusions about a population.
"In a statistical hypothesis, statements are made about the relationship among parameters of one or more populations."
  • Barash, Cullen, and Stoelting's Clinical Anesthesia, 9e

2. Basic Concepts in Hypothesis Testing

2.1 The Null Hypothesis (H₀)

The null hypothesis is the default statement of "no difference" or "no effect." It is the hypothesis that is actually tested. Think of it like the presumption of innocence in a criminal trial - we begin assuming no difference exists until the data proves otherwise.
  • Example: "There is no difference in blood pressure between the treatment group and the control group."
  • Algebraically: H₀: μ₁ = μ₂
"A comparative study commences with a fundamental presumption of 'no difference,' known as the null hypothesis. The null hypothesis posits that the difference between the two treatments being compared is zero."
  • Rockwood and Green's Fractures in Adults, 10th ed.

2.2 The Alternative Hypothesis (H₁ or Hₐ)

The alternative hypothesis is what you are trying to prove. It is the logical negation of the null hypothesis.
  • Example: "The treatment group has lower blood pressure than the control group."
  • Algebraically: H₁: μ₁ ≠ μ₂ (two-tailed) or H₁: μ₁ < μ₂ (one-tailed)
Two types of alternative hypotheses exist:
  • Two-tailed (non-directional): Tests for any difference, either greater or less (μ₁ ≠ μ₂). More conservative.
  • One-tailed (directional): Tests for a difference in one specific direction only (μ₁ > μ₂ or μ₁ < μ₂).

2.3 Level of Significance (α)

The significance level (α) is the probability of rejecting the null hypothesis when it is actually true (i.e., the maximum acceptable risk of making a wrong rejection). It is chosen before conducting the test.
Significance LevelMeaning
α = 0.10 (10%)Willing to accept 10% risk of false rejection
α = 0.05 (5%)Standard in most research
α = 0.01 (1%)Stricter, used in high-stakes studies
"In the medical literature, this threshold is typically set at a value of less than 5% (i.e., p < .05)."
  • Rockwood and Green's Fractures in Adults, 10th ed.
As α increases → β decreases, and vice versa. As sample size (n) increases → both α and β decrease.

2.4 The P-Value

The p-value is the probability of obtaining the observed results (or more extreme results) assuming the null hypothesis is true. It is not the probability that H₀ is true.
  • If p < α: Reject H₀ - result is "statistically significant"
  • If p ≥ α: Fail to reject H₀ - result is "not statistically significant"
"The level of significance is the probability level considered too low to warrant support of the null hypothesis being tested. If sample values are sufficiently unlikely to have occurred by chance (i.e., the probability of the sample test statistic is less than the chosen level of significance), the null hypothesis is rejected."
  • Barash, Cullen, and Stoelting's Clinical Anesthesia, 9e

2.5 Test Statistic

A test statistic is a numerical value calculated from the sample data. It is used to decide whether to reject H₀. Examples include:
  • Z-statistic (large samples, known σ)
  • t-statistic (small samples, unknown σ)
  • Chi-square (χ²) (categorical data)
  • F-statistic (comparing variances/ANOVA)
  • Fisher's Exact Test (small sample categorical comparisons)

2.6 Type I and Type II Errors

Because hypothesis testing deals with probabilities, not certainties, two types of errors are possible:
H₀ is Actually TRUEH₀ is Actually FALSE
Reject H₀Type I Error (α) - False PositiveCorrect Decision (Power)
Fail to Reject H₀Correct DecisionType II Error (β) - False Negative
  • Type I Error (α): Rejecting a true null hypothesis (false positive). Probability = α (the significance level).
  • Type II Error (β): Failing to reject a false null hypothesis (false negative).
  • Power (1 - β): The probability of correctly rejecting a false H₀. A well-designed study aims for power ≥ 0.80.
"Type I errors are generally considered more serious."

2.7 Critical Region and Critical Value

The critical region is the range of test statistic values that lead to rejection of H₀. The critical value is the boundary of this region. If the test statistic falls in the critical region, H₀ is rejected.

2.8 Confidence Interval (CI)

A 95% confidence interval is directly related to hypothesis testing at α = 0.05. If a CI for a difference does not include zero (for differences) or 1 (for ratios), the result is statistically significant.

3. Procedure of Hypothesis Testing

The step-by-step process is consistent across all types of tests:

Step 1: State the Hypotheses

Clearly formulate both:
  • H₀ (Null): States no effect, no difference, or no relationship
  • H₁ (Alternative): States the expected effect or difference

Step 2: Choose the Level of Significance (α)

Select α before collecting data (usually 0.05). This reflects the tolerance for Type I error.

Step 3: Select the Appropriate Statistical Test

Based on:
  • Type of data (continuous, categorical, ordinal)
  • Number of groups (two groups → t-test; multiple groups → ANOVA)
  • Sample size (large → Z-test; small → t-test)
  • Distribution of data (parametric vs. non-parametric)
Common tests:
Data TypeTest
Comparing 2 means (large sample)Z-test
Comparing 2 means (small sample)Independent t-test
Comparing proportionsChi-square test
Small categorical samplesFisher's Exact test
Comparing 3+ meansANOVA (F-test)
Paired observationsPaired t-test

Step 4: Collect Data and Calculate the Test Statistic

Use the sample data to compute the relevant test statistic (Z, t, χ², F, etc.).

Step 5: Determine the Critical Value or P-value

  • Critical value method: Compare the test statistic against the critical value from standard tables (Z-table, t-table, etc.)
  • P-value method: Calculate the probability of obtaining that test statistic under H₀

Step 6: Make a Decision

  • If test statistic > critical value (or p < α): Reject H₀
  • If test statistic ≤ critical value (or p ≥ α): Fail to reject H₀
Note: We never "accept" H₀ - we only "fail to reject" it, acknowledging that absence of evidence is not evidence of absence.

Step 7: State the Conclusion

Interpret the statistical decision in the context of the original research question.
  • Example: "At the 5% significance level, there is sufficient evidence to conclude that the new drug significantly reduces blood pressure (t = 3.2, p = 0.002)."

4. Worked Example (Coin Toss)

A coin is tossed 10 times and lands heads every time.
  • H₀: The coin is fair (P(heads) = 0.5)
  • H₁: The coin is biased toward heads
  • Test: Probability = 0.5^10 ≈ 0.001 → p < 0.001
  • Decision: Since p < 0.05 (α), reject H₀
  • Conclusion: The coin appears to be biased toward heads (statistically significant at p < 0.001)
This example is directly from Rockwood and Green's Fractures in Adults, 10th ed. to illustrate the intuitive nature of hypothesis testing.

5. Summary Table

ConceptDefinition
H₀ (Null Hypothesis)No difference or no effect
H₁ (Alternative Hypothesis)Proposed effect or difference
α (Significance Level)Acceptable probability of Type I error
p-valueProbability of results under H₀
Type I ErrorRejecting a true H₀ (false positive)
Type II ErrorNot rejecting a false H₀ (false negative)
Power (1-β)Probability of correctly detecting a true effect
Critical ValueThreshold for rejecting H₀
Test StatisticCalculated value from sample (Z, t, χ², F)

Sources: Barash, Cullen, and Stoelting's Clinical Anesthesia, 9e | Rockwood and Green's Fractures in Adults, 10th ed. | Tietz Textbook of Laboratory Medicine, 7th ed. | Scribbr: Hypothesis Testing Guide

Annova

ANOVA (Analysis of Variance) is a statistical technique used to compare the means of three or more groups simultaneously. Instead of running multiple t-tests (which inflates Type I error), ANOVA uses variance to determine if at least one group mean is significantly different from the others. The core idea: if the variation between groups is much larger than variation within groups, the group means are likely truly different.
Searching sources...
Finding Sources
Searching the Web

ANOVA analysis of variance complete explanation types procedure F-statistic

Finding Sources
Reading Web Page

https://www.editage.com/blog/anova-types-uses-assumptions-a-…

Finding Sources
Finding Sources
Finding Sources
Finding Sources
I have sufficient information from the web sources to deliver a comprehensive answer. Here is the complete guide on ANOVA:

ANOVA - Analysis of Variance


1. What is ANOVA?

ANOVA (Analysis of Variance) is a statistical technique used to compare the means of three or more groups at the same time to determine if at least one group mean is significantly different from the others.
Why not just use multiple t-tests? If you compare 3 groups using separate t-tests (A vs B, B vs C, A vs C), you run 3 tests, each with a 5% chance of a false positive. Together, the cumulative Type I error rises to ~14%. With 6 groups, you'd have 15 comparisons and ~54% false positive risk. ANOVA controls this by performing a single "omnibus" test, keeping Type I error at exactly α (e.g., 5%).
MethodGroups# of TestsCumulative Type I Error
Multiple t-tests33~14%
ANOVA315% (controlled)
Multiple t-tests615~54%
ANOVA615% (controlled)

2. Core Logic of ANOVA

ANOVA works by partitioning the total variability in the data into two components:
Total Variation = Between-Group Variation + Within-Group Variation
     (SST)             (SSB)                      (SSW)
  • Between-Group Variation (SSB): How much the group means differ from the overall grand mean. This reflects the effect of the independent variable (treatment).
  • Within-Group Variation (SSW): How much individual observations vary within each group (also called "error" or "residual"). This is natural random variation.
The key question: Is the between-group variation large enough compared to the within-group variation to conclude the groups are truly different?
This ratio is called the F-statistic (F-ratio):
$$\boxed{F = \frac{\text{Mean Square Between (MSB)}}{\text{Mean Square Within (MSW)}} = \frac{\text{Variance between groups}}{\text{Variance within groups}}}$$
  • F near 1: Group means are similar - evidence for H₀
  • F much greater than 1: Group means differ more than expected by chance - evidence against H₀

3. Hypotheses in ANOVA

  • H₀ (Null): All group means are equal → μ₁ = μ₂ = μ₃ = ... = μₖ
  • H₁ (Alternative): At least one group mean is different from the others (not all means are equal)
Note: ANOVA does NOT tell you which groups differ - only that some difference exists. Post-hoc tests are needed for that.

4. Types of ANOVA

4.1 One-Way ANOVA

  • Compares means of 3+ groups based on one independent variable (factor)
  • Example: Comparing pain relief scores across 3 drug dosages (10 mg, 20 mg, 30 mg)
  • One factor with multiple levels

4.2 Two-Way ANOVA

  • Compares means based on two independent variables simultaneously
  • Can detect:
    • Main effect of Factor A
    • Main effect of Factor B
    • Interaction effect between A and B (does the effect of A depend on the level of B?)
  • Example: Comparing blood pressure across 3 drugs AND 2 genders simultaneously

4.3 Repeated Measures ANOVA

  • Used when the same subjects are measured at multiple time points or under multiple conditions
  • Controls for individual differences between subjects
  • Example: Measuring anxiety scores in patients before, during, and after treatment
  • Requires testing the assumption of sphericity (Mauchly's test)

4.4 MANOVA (Multivariate ANOVA)

  • Extension of ANOVA for two or more dependent variables at once
  • Example: Comparing both systolic AND diastolic blood pressure across groups simultaneously

5. Assumptions of ANOVA

ANOVA is a parametric test and requires these assumptions:
AssumptionWhat It MeansHow to Test
IndependenceObservations are not related to each otherStudy design review
NormalityData in each group is normally distributedShapiro-Wilk test, Q-Q plots
Homogeneity of VarianceEqual variances across all groups (homoscedasticity)Levene's test, Bartlett's test
Continuous DVDependent variable is interval or ratio scaleVariable measurement check
Sphericity (RM ANOVA only)Equal variance of pairwise differencesMauchly's test
If assumptions are violated: Use Welch's ANOVA (for unequal variances) or Kruskal-Wallis test (non-parametric alternative to one-way ANOVA).

6. Step-by-Step Procedure of ANOVA

Step 1: State Hypotheses

  • H₀: μ₁ = μ₂ = μ₃ (all group means equal)
  • H₁: At least one μᵢ ≠ μⱼ

Step 2: Set Significance Level

  • Typically α = 0.05

Step 3: Calculate Sum of Squares

Grand Mean (X̄_grand): Mean of all observations combined
SSB - Sum of Squares Between groups: $$SSB = \sum_{j=1}^{k} n_j (\bar{X}j - \bar{X}{grand})^2$$
SSW - Sum of Squares Within groups: $$SSW = \sum_{j=1}^{k} \sum_{i=1}^{n_j} (X_{ij} - \bar{X}_j)^2$$
SST - Total Sum of Squares: $$SST = SSB + SSW$$

Step 4: Calculate Degrees of Freedom (df)

SourceDegrees of Freedom
Between groups (df_B)k - 1 (where k = number of groups)
Within groups (df_W)N - k (where N = total observations)
Total (df_T)N - 1

Step 5: Calculate Mean Squares (MS)

$$MSB = \frac{SSB}{df_B} = \frac{SSB}{k-1}$$
$$MSW = \frac{SSW}{df_W} = \frac{SSW}{N-k}$$

Step 6: Calculate the F-Statistic

$$F = \frac{MSB}{MSW}$$

Step 7: Build the ANOVA Table

SourceSSdfMSF
Between groupsSSBk-1MSB = SSB/(k-1)MSB/MSW
Within groups (Error)SSWN-kMSW = SSW/(N-k)-
TotalSSTN-1--

Step 8: Compare F to Critical Value / Find p-value

  • Look up the critical F value from the F-distribution table using df_B and df_W
  • Or use software to find p-value
  • If F_calculated > F_critical (or p < α): Reject H₀

Step 9: Post-Hoc Tests (if H₀ is rejected)

Since ANOVA only tells you "at least one group differs," you need post-hoc tests to find which groups differ.

7. Post-Hoc Tests

Post-Hoc TestBest ForKey Feature
Tukey's HSDEqual group sizes, equal variancesMost widely used; balances power and control
BonferroniFewer planned comparisonsVery conservative; divides α by number of comparisons
Scheffé testUnequal group sizesMost conservative; good for complex contrasts
LSD (Fisher's)Only 3 groupsLeast conservative; higher Type I error risk
Dunnett's testComparing all groups to one controlSpecifically for control group comparisons
Games-HowellUnequal variances and/or unequal nDoes not assume equal variances

8. Worked Example

A doctor tests pain relief (scale 1-10) at three drug doses: 10 mg, 20 mg, 30 mg (5 patients each).
Patient10 mg20 mg30 mg
1468
2577
3359
4468
5478
Mean4.06.28.0
Grand Mean = (4.0 + 6.2 + 8.0) / 3 = 6.07
ANOVA Table:
SourceSSdfMSF
Between groups40.12220.0635.19
Within groups6.80120.57-
Total46.9214--
F = 35.19, p < 0.001
Conclusion: Since F = 35.19 >> F_critical (≈3.89 at α=0.05, df=2,12), we reject H₀. There is a significant difference in pain relief between dosage groups (p < 0.001).
Post-hoc test (Tukey's HSD) would then confirm that each dose level differs significantly from the others.

9. How to Report ANOVA Results

"A one-way ANOVA revealed a significant effect of drug dose on pain relief, F(2, 12) = 35.19, p < .001, η² = .86. Tukey's post-hoc test indicated that 30 mg produced significantly higher relief than both 10 mg (p < .001) and 20 mg (p < .001), and 20 mg was significantly higher than 10 mg (p < .001)."

Format: F(df_between, df_within) = value, p = value, η² = effect size


10. Effect Size in ANOVA

Statistical significance (p-value) alone doesn't tell you how meaningful the difference is. Always report effect size:
MeasureFormulaInterpretation
Eta-squared (η²)SSB / SSTSmall: 0.01, Medium: 0.06, Large: 0.14
Partial η²SSB / (SSB + SSError)Used in two-way/factorial ANOVA
Omega-squared (ω²)Less biased version of η²Preferred for small samples

11. Non-Parametric Alternative

When ANOVA assumptions are violated (non-normal data, ordinal data):
  • One-Way ANOVA → Kruskal-Wallis Test (uses ranks instead of raw values)
  • Repeated Measures ANOVA → Friedman Test

12. Quick Summary

FeatureDetail
PurposeCompare means of 3+ groups
Test statisticF-ratio = MSB / MSW
Null hypothesisAll group means are equal
Decision ruleReject H₀ if F > F_critical or p < α
LimitationOnly tells IF difference exists, not WHERE
Follow-upPost-hoc tests (Tukey's, Bonferroni, etc.)
Non-parametric versionKruskal-Wallis test

Measure of central tendency

Measures of central tendency are statistical values that describe the center or typical value of a dataset. The three main measures are the Mean (arithmetic average), Median (middle value when sorted), and Mode (most frequently occurring value). Each has specific uses depending on the data type and distribution shape.
Searching sources...
Finding Sources
Searching the Web

measures of central tendency mean median mode complete explanation statistics

Finding Sources
Reading Web Page

https://statisticsbyjim.com/basics/measures-central-tendency…

Finding Sources
Reading File
Reading File
Excellent content from both textbook and web sources. Here is the complete guide:

Measures of Central Tendency


1. Definition

A measure of central tendency is a single summary value that represents the center or typical value of an entire dataset. It describes where most values in a distribution tend to cluster.
"Continuous variables are more typically described with a single summary statistic (i.e., measure of central tendency) as well as the associated uncertainty around the summary estimate (i.e., measure of spread)."
  • Rockwood and Green's Fractures in Adults, 10th ed.
The three main measures are:
MeasureDefinition
MeanArithmetic average of all values
MedianMiddle value in an ordered dataset
ModeMost frequently occurring value

2. THE MEAN (Arithmetic Mean)

Definition

The mean is the sum of all observations divided by the number of observations.

Formula

$$\bar{X} = \frac{\sum X_i}{n} = \frac{X_1 + X_2 + X_3 + ... + X_n}{n}$$
Where: X̄ = sample mean, ΣXᵢ = sum of all values, n = number of observations

Calculation Example

Data: 4, 7, 3, 9, 5, 8, 6
  • Sum = 4+7+3+9+5+8+6 = 42
  • n = 7
  • Mean = 42 / 7 = 6

Types of Mean

TypeFormulaUse
Arithmetic MeanΣX / nMost common; symmetric data
Weighted MeanΣ(wᵢXᵢ) / ΣwᵢWhen values have different importance/weights
Geometric Mean(X₁ × X₂ × ... × Xₙ)^(1/n)Ratios, rates of growth, log-normally distributed data
Harmonic Meann / Σ(1/Xᵢ)Rates and speeds

For Grouped Data (Frequency Distribution)

$$\bar{X} = \frac{\sum f_i \cdot x_i}{\sum f_i}$$ Where: fᵢ = frequency of each class, xᵢ = midpoint of each class

Properties of Mean

  • Uses all values in the dataset
  • Affected by every observation
  • Highly sensitive to outliers and skewed distributions
  • Unique - only one mean per dataset
  • Sum of deviations from the mean = 0: Σ(Xᵢ - X̄) = 0

Advantages

  • Uses all data points - most mathematically complete
  • Suitable for further algebraic and statistical calculations
  • Basis for many inferential tests (t-test, ANOVA, etc.)

Disadvantages

  • Distorted by extreme outliers
  • Not suitable for skewed distributions
  • Cannot be used for nominal (categorical) data
  • May give a non-integer value that doesn't actually exist in the data

When to Use

  • Data is normally distributed (symmetric)
  • No extreme outliers
  • Interval or ratio scale data
  • When further statistical analysis is needed

3. THE MEDIAN

Definition

The median is the middle value in a dataset arranged in ascending or descending order. Half the values fall above it, and half fall below it.
"The median of a set of measurements is the number that falls in the middle."
  • Rockwood and Green's Fractures in Adults, 10th ed.

How to Calculate

Step 1: Arrange data in ascending order Step 2: Find the middle value
  • If n is ODD: Median = value at position (n+1)/2
  • If n is EVEN: Median = average of values at positions n/2 and n/2 + 1

Examples

Odd n: Data: 3, 5, 7, 9, 11, 13, 15 → n=7 → Position = (7+1)/2 = 4th value → Median = 9
Even n: Data: 3, 5, 7, 9, 11, 13 → n=6 → Positions 3rd and 4th → Median = (7+9)/2 = 8

For Grouped Data

$$\text{Median} = L + \left(\frac{\frac{n}{2} - CF}{f}\right) \times h$$
Where:
  • L = lower boundary of median class
  • n = total frequency
  • CF = cumulative frequency before median class
  • f = frequency of median class
  • h = class width

Properties of Median

  • Divides distribution into two equal halves
  • Not affected by extreme outliers (robust statistic)
  • Only one median per dataset
  • Can be used for ordinal data
  • May not be an actual value in the dataset (for even n)

Advantages

  • Unaffected by extreme values/outliers
  • Ideal for skewed distributions
  • Can be used for ordinal data
  • Easy to understand and locate graphically

Disadvantages

  • Does not use all values in the data
  • Less suitable for further mathematical calculations
  • Less efficient than mean for symmetric, normally distributed data

When to Use

  • Data is skewed (not normally distributed)
  • Ordinal data (e.g., pain scores: 0-5)
  • Presence of extreme outliers
  • Classic example: income data (right-skewed; median better represents the typical earner)

4. THE MODE

Definition

The mode is the most frequently occurring value in a dataset.
"The mode is the most frequently occurring number in a set of measurements."
  • Rockwood and Green's Fractures in Adults, 10th ed.

Examples

  • Data: 2, 3, 3, 4, 4, 4, 5, 6 → Mode = 4 (appears 3 times)
  • Data: 1, 2, 3, 4, 5 → No mode (all values appear once)
  • Data: 2, 2, 3, 4, 4Bimodal: Mode = 2 and 4

Types of Mode

  • Unimodal: One mode
  • Bimodal: Two modes
  • Multimodal: More than two modes
  • No mode: All values occur with equal frequency

For Grouped Data

$$\text{Mode} = L + \left(\frac{f_1 - f_0}{2f_1 - f_0 - f_2}\right) \times h$$
Where:
  • L = lower boundary of modal class (class with highest frequency)
  • f₁ = frequency of modal class
  • f₀ = frequency of class before modal class
  • f₂ = frequency of class after modal class
  • h = class width

Properties of Mode

  • Can be used for any type of data (nominal, ordinal, interval, ratio)
  • May not be unique
  • Not affected by extreme values
  • May not exist in some datasets
  • Easiest to identify visually

Advantages

  • Works for all data types including categorical (nominal)
  • Unaffected by outliers
  • Represents the most "popular" value
  • Easy to identify by inspection

Disadvantages

  • May not be well-defined (bimodal or no mode)
  • Ignores most of the data
  • Least used for advanced calculations

When to Use

  • Nominal (categorical) data - only measure that works (e.g., most common blood type)
  • Bimodal distributions
  • When you want the most typical/popular value
  • Count data and probability distributions

5. Relationship Between Mean, Median, and Mode

In a Normal (Symmetric) Distribution

All three are equal: Mean = Median = Mode
This occurs at the peak of the bell curve.

In a Skewed Distribution

Positively Skewed (Right skewed): Tail extends to the right $$\text{Mode} < \text{Median} < \text{Mean}$$ The mean is pulled toward the higher outliers. Example: Income distribution - a few billionaires pull the mean far right
Negatively Skewed (Left skewed): Tail extends to the left $$\text{Mean} < \text{Median} < \text{Mode}$$ The mean is pulled toward the lower outliers. Example: Age at death - most people live long, but some die very young

Karl Pearson's Empirical Relationship

For a moderately skewed distribution: $$\boxed{\text{Mode} = 3 \times \text{Median} - 2 \times \text{Mean}}$$
This formula is useful when one measure is unknown and the other two are known.

6. Choosing the Right Measure

Data TypeBest MeasureWhy
Nominal (Categorical)ModeOnly option for categories (e.g., blood type, gender)
OrdinalMedian (or Mode)Has order but no true numeric distance
Interval / Ratio - SymmetricMeanUses all data; most informative
Interval / Ratio - SkewedMedianResistant to outliers
Interval / Ratio - BimodalModeCaptures both peaks
"The appropriate choice often depends on the distribution of data. Most data can be assumed to be normally distributed... In this situation of normality, the mean is the best-used summary statistic. If the data are not normally distributed, then the median may be a better summary statistic."
  • Rockwood and Green's Fractures in Adults, 10th ed.
Practical tip: Calculate both mean and median. If they differ significantly, use the median - it signals skewed or outlier-affected data.

7. Summary Comparison Table

FeatureMeanMedianMode
DefinitionSum ÷ nMiddle valueMost frequent value
Uses all dataYesNoNo
Affected by outliersYes (highly)No (robust)No
Data levelInterval/RatioOrdinal+Any (Nominal+)
Unique?AlwaysAlwaysMay not be unique
Best forSymmetric dataSkewed dataCategorical data
Algebraic useExtensiveLimitedVery limited
NotationX̄ (sample), μ (population)M or MdMo

8. Worked Example

Data set: Ages of 9 patients: 18, 22, 25, 28, 30, 30, 35, 40, 80
Mean: (18+22+25+28+30+30+35+40+80) / 9 = 308 / 9 = 34.2 years
Median: n=9 (odd) → position (9+1)/2 = 5th value → 30 years
Mode: 30 appears twice → Mode = 30 years
Here the outlier (80) pulls the mean up to 34.2, while the median (30) better represents the "typical" patient age. This illustrates why the median is preferred when outliers are present.

9. Connection to Dispersion

Measures of central tendency are always reported alongside measures of dispersion (spread):
Central Tendency MeasurePaired with
MeanStandard Deviation (SD)
MedianInterquartile Range (IQR) or Range
ModeFrequency/percentage
"Along with measures of central tendency, investigators will often (and should) include a measure of spread to indicate uncertainty around the estimate."
  • Rockwood and Green's Fractures in Adults, 10th ed.

Sources: Rockwood and Green's Fractures in Adults, 10th ed. | Cummings Otolaryngology Head and Neck Surgery | Statistics By Jim - Central Tendency | Scribbr - Central Tendency

Methods of data collection

Methods of data collection refer to the systematic approaches used to gather information for research or analysis. The two broad categories are primary data collection (collecting fresh data directly) and secondary data collection (using already-existing data). Primary methods include surveys, interviews, observation, experiments, and questionnaires; secondary methods include records, publications, and databases.
Searching sources...
Finding Sources
Searching the Web

methods of data collection primary secondary research statistics complete guide

Finding Sources
Reading Web Page

https://www.jotform.com/blog/primary-and-secondary-data-coll…

Finding Sources
Reading Web Page

https://www.surveycto.com/resources/guides/data-collection-m…

Finding Sources
I have sufficient material to construct a comprehensive, well-organized answer.

Methods of Data Collection


1. What is Data Collection?

Data collection is the systematic process of gathering information from relevant sources to find answers to research questions, test hypotheses, evaluate outcomes, and make informed decisions. The quality of any research depends directly on the quality of data collected.
Before collecting data, a researcher must clearly define:
  • What data to collect
  • Why it is needed (research objectives)
  • Who it will be collected from (target population)
  • How it will be collected (method)
  • When and where it will be collected

2. Types of Data

Based on Source

TypeDefinitionExample
Primary DataCollected fresh, directly from the source by the researcherSurvey responses, lab experiments, interview transcripts
Secondary DataAlready existing data collected by someone else for another purposeCensus reports, hospital records, published studies

Based on Nature

TypeDefinitionExample
QuantitativeNumerical, measurable dataHeight, weight, test scores, blood pressure
QualitativeNon-numerical, descriptive dataOpinions, experiences, behaviors, attitudes

Based on Scale

ScaleExample
NominalBlood type, gender, religion
OrdinalPain rating (1-5), satisfaction (low/medium/high)
IntervalTemperature (°C), IQ scores
RatioHeight, weight, age, income

3. PRIMARY DATA COLLECTION METHODS

Primary data is original, first-hand, and specific to the current research problem. It is more accurate and relevant but takes more time, cost, and effort to collect.

Method 1: Questionnaire

A questionnaire is a written set of pre-designed questions given to respondents to answer, usually without the researcher being present.

Types of Questions

  • Open-ended: Free-form answers ("How do you feel about...?")
  • Closed-ended: Fixed choices ("Yes/No", multiple choice)
  • Likert Scale: Degree of agreement (Strongly Agree → Strongly Disagree)
  • Ranking questions: Rank in order of preference

Types of Questionnaires

TypeDescription
Mailed questionnaireSent by post; low cost but low response rate
Online questionnaireSent via email or web; fast and cost-effective
Self-administeredRespondent fills it out independently
StructuredAll questions fixed and uniform for all respondents

Advantages

  • Can reach a large number of people
  • Low cost, especially online
  • Respondent anonymity encourages honest answers
  • Easy to quantify and analyze
  • No interviewer bias

Disadvantages

  • Low response rate for mailed versions
  • Cannot clarify ambiguous questions
  • Limited to literate respondents
  • Cannot capture non-verbal cues
  • Risk of incomplete responses

Method 2: Interview / Schedule Method

An interview is a face-to-face (or phone/video) conversation where a researcher (interviewer) asks questions and records responses from a respondent (interviewee).
A schedule is the same as a questionnaire except the interviewer fills it in based on the respondent's answers (instead of the respondent filling it themselves).

Types of Interviews

TypeDescription
Structured interviewFixed questions in a fixed order; uniform for all
Unstructured interviewFree-flowing conversation; flexible, exploratory
Semi-structured interviewMix of fixed and open questions; most commonly used
In-depth interviewDetailed exploration of a specific topic with one person
Focus group interviewGroup discussion (6-10 people) on a topic; rich data
Telephone interviewConducted by phone; cost-effective

Difference: Questionnaire vs Schedule

FeatureQuestionnaireSchedule (Interview)
Filled byRespondentInterviewer
Literacy requiredYesNo
Response rateLowHigh
Personal contactNoYes
Clarification possibleNoYes
CostLowHigh
ScopeLarge areaLimited area
Non-verbal cuesCaptured? NoYes

Advantages of Interviews

  • High response rate
  • Can probe for deeper information
  • Can clarify misunderstandings
  • Works for illiterate respondents
  • Captures non-verbal cues (body language, emotions)
  • Flexible

Disadvantages of Interviews

  • Time-consuming and expensive
  • Interviewer bias possible
  • Respondents may not be honest face-to-face
  • Difficult to cover large samples
  • Requires trained interviewers

Method 3: Observation Method

Observation is the systematic watching, recording, and describing of people's behavior, events, or phenomena as they naturally occur - without relying on self-reported data.

Types of Observation

TypeDescription
Participant observationResearcher joins the group being studied
Non-participant observationResearcher watches from outside without involvement
Covert observationSubjects do not know they are being observed (natural behavior)
Overt observationSubjects know they are being observed (may alter behavior)
Structured observationUses a checklist or coding scheme; quantitative
Unstructured observationFree-form recording; qualitative
Direct observationResearcher observes in person
Indirect observationUses records, CCTV, or traces left by behavior

Advantages

  • Captures actual behavior (not what people say they do)
  • No reliance on memory or self-report
  • Good for studying children, animals, or groups who can't respond verbally
  • Natural setting = high ecological validity

Disadvantages

  • Time-consuming
  • Observer bias possible
  • Hawthorne effect (people change behavior when observed)
  • Limited to observable behavior (not feelings or thoughts)
  • Ethical issues with covert observation

Method 4: Experiment

An experiment is a method where the researcher manipulates one variable (independent variable) and measures its effect on another variable (dependent variable), while controlling all other factors.

Types

TypeDescription
Laboratory experimentControlled environment; high internal validity
Field experimentReal-world setting; higher ecological validity
Natural experimentUses naturally occurring events as "treatments"
Randomized Controlled Trial (RCT)Gold standard in medicine; random assignment to groups

Key Features

  • Independent variable (IV): What the researcher manipulates (e.g., drug dose)
  • Dependent variable (DV): What is measured (e.g., blood pressure)
  • Control group: Receives no treatment or a placebo
  • Experimental group: Receives the treatment

Advantages

  • Establishes cause-and-effect relationships
  • High control over variables
  • Replicable

Disadvantages

  • Artificial (lab settings may not reflect real life)
  • Ethical concerns (giving harmful treatments)
  • Expensive and time-consuming
  • Not possible for all research questions

Method 5: Case Study

An in-depth investigation of a single individual, group, event, or situation over time. Used in medicine, psychology, business, and social sciences.
  • Advantages: Rich, detailed data; explores rare or unusual cases
  • Disadvantages: Cannot generalize findings; time-intensive; researcher bias

Method 6: Focus Group

A focus group is a moderated group discussion (typically 6-10 participants) exploring attitudes, perceptions, or experiences on a topic.
  • Advantages: Group interaction generates ideas; time-efficient for qualitative data
  • Disadvantages: Dominant members may influence others; not anonymous; moderator bias

4. SECONDARY DATA COLLECTION METHODS

Secondary data is data already collected by someone else for a different purpose. The researcher re-uses it to answer their own research question.

Sources of Secondary Data

A. Published Sources

SourceExamples
Government publicationsCensus data, national health surveys, RBI reports
International organizationsWHO, UN, World Bank, IMF data
Research journals & booksPublished studies, textbooks, review articles
Newspapers & magazinesMedia reports, editorials
Trade publicationsIndustry reports, market research
Online databasesPubMed, JSTOR, Scopus, Google Scholar

B. Unpublished Sources

SourceExamples
Institutional recordsHospital records, school registers, company files
Private diaries and lettersPersonal documents
Research reportsUnpublished theses, internal company reports
Government archivesHistorical records not yet published

Advantages of Secondary Data

  • Time-saving - data already exists
  • Cost-effective - no fieldwork needed
  • Large datasets available (e.g., national census)
  • Useful for longitudinal analysis and trend identification
  • Good starting point before primary research

Disadvantages of Secondary Data

  • May not be specific to the research question
  • Data may be outdated
  • Quality and reliability may be uncertain
  • Bias from the original collector
  • May not match the exact variables needed
  • Limited control over data collection process

5. PRIMARY vs. SECONDARY DATA: Comparison

FeaturePrimary DataSecondary Data
SourceCollected directly by researcherAlready collected by someone else
OriginalityOriginal, first-handSecond-hand
CostHighLow
TimeTime-consumingQuick to access
RelevanceHighly specific to research questionMay not perfectly match
AccuracyHigh (if well-designed)Variable
ControlFull controlNo control over collection process
Up-to-dateYesMay be outdated
ExamplesSurveys, experiments, interviewsCensus, records, published studies

6. QUANTITATIVE vs. QUALITATIVE Data Collection

FeatureQuantitativeQualitative
NatureNumericalDescriptive / narrative
MethodsSurveys, experiments, censusInterviews, observation, focus groups
AnalysisStatisticalThematic / interpretive
GoalMeasure, quantifyUnderstand, explore
Sample sizeLargeSmall
FlexibilityLowHigh
ExamplesBlood pressure readings, exam scoresPatient experiences, opinions, attitudes

7. Choosing the Right Method

Research GoalRecommended Method
Large-scale data, quick resultsQuestionnaire / Online survey
In-depth opinions or experiencesIn-depth interview
Natural behavior in real contextObservation
Cause-and-effect relationshipsExperiment / RCT
Rare or complex individual casesCase study
Group attitudes and ideasFocus group
Broad overview or trend analysisSecondary data
Specific + broad = best of bothCombined primary + secondary

8. Steps in Data Collection

  1. Define the research problem - What are you trying to find out?
  2. Set research objectives - What specific questions need answers?
  3. Choose data type - Primary or secondary? Quantitative or qualitative?
  4. Select the method - Survey, interview, observation, experiment, etc.
  5. Design the instrument - Develop questionnaire, interview guide, observation checklist
  6. Pilot test - Test on a small sample; revise any flaws
  7. Collect data - Execute the chosen method with the target population
  8. Record and organize - Code, enter, and store data securely
  9. Validate and clean - Check for errors, missing values, inconsistencies
  10. Analyze - Apply appropriate statistical or qualitative techniques

9. Summary Table of All Methods

MethodTypeDataBest For
QuestionnairePrimaryQuantitative/QualitativeLarge samples, wide geographic reach
Personal interviewPrimaryQualitativeIn-depth, literate or illiterate respondents
SchedulePrimaryQuantitativeIlliterate populations, field surveys
ObservationPrimaryQualitativeBehavior, natural settings
Experiment/RCTPrimaryQuantitativeCause-and-effect, clinical trials
Case studyPrimaryQualitativeIn-depth individual analysis
Focus groupPrimaryQualitativeGroup opinions, exploratory research
Government recordsSecondaryQuantitativeNational statistics, trends
Published studiesSecondaryBothLiterature review, meta-analysis
Hospital/institutional recordsSecondaryQuantitativeEpidemiology, retrospective studies

This is a shared conversation. Sign in to Orris to start your own chat.