statistics

Two sample Z-test for Proportions: Formula & Examples

In statistics, a two-sample z-test for proportions is a method used to determine whether two samples are drawn from the same population. This test is used when the population proportion is unknown and there is not enough information to use the chi-squared distribution. The test uses the standard normal distribution to calculate the test statistic. As data scientists, it is important to know how to conduct this test in order to determine whether two proportions are equal. In this blog post, we will discuss the formula and examples of the two-proportion Z-test.

What is two proportion Z-test?

A two-proportion Z-test is a statistical hypothesis test used to determine whether two proportions are different from each other. While performing the test, Z-statistics is computed from two independent samples and the null hypothesis is that the two proportions are equal. In other words, the two samples are coming from the same population. In order to be able to use the two-sample z-test, the following conditions must be met:

  • The two populations must be normal or approximately normal
  • The two samples must be randomly sampled from the two populations
  • The two proportions must be independent

If any of the above conditions are not met, the two-sample z-test cannot be used and another test must be selected. The two-sample z-test is advantageous because it does not require any knowledge of the population standard deviation.

There are two steps in conducting a two-sample z-test for proportions.

  • The first step is to calculate the standard error of the difference between the two population proportions.
  • The second step is to calculate the z-test statistic. This is done by taking the difference between the two population proportions and dividing it by the standard error of the difference.

Once the z-test statistic is calculated, the Z-table can be used to determine whether the two population proportions are different. If the z-statistic is greater than or equal to the critical value or level of significance, then it can be concluded that there is enough evidence that there exists a difference between the two population proportions. And, the null hypothesis can thus be rejected.

Here are some real-world examples where two proportions Z-test can be used:

  • Effectiveness of medicines: In a study, two different groups of people are given the same medicine. The proportion of people in each group who get better is measured. A two-proportion Z-test can be used to see if the proportions are different (i.e. one group might have a higher success rate than the other).
  • Election results: In an election, two different political parties are running. The number of people who voted for each party is measured. A two-proportion Z-test can be used to see if the proportions are different (i.e. one party might have more support than the other).
  • Customer purchase behavior: In a study, two different groups of customers are observed. The proportion of customers in each group who buy something is measured. A two-proportion Z-test can be used to see if the proportions are different (i.e. one group might be more likely to buy than the other).
  • Customer survey result: A company sends out customer surveys to customers from two different regions. The proportion of people who respond from each region is measured. A two-proportion Z-test can be used to see if the proportions are different (i.e. one region might have more positive response than the other).
  • A/B testing: In market research, two different versions of a product (A and B) are tested on two different groups of people. The proportion of people who think each version is better is measured. A two-proportion Z-test can be used to see if the proportions are different (i.e. one group might like Version A more than Version B).

Two sample Z-test for proportions: Formula

The following is the formula for two-sample Z-test for proportions:

p1-hat is the proportion of the 1st sample

p2-hat is the proportion of the 2nd sample

n1 is number of data samples in the 1st sample

n2 is number of data samples in the 2nd sample

p-hat is mean of both the samples; If k1 is successes out of n1 data in sample1 and k2 is successes out of n2 data in sample2, then the value of p-hat can be calculated as the following:

p-hat = (k1 + k2)/(n1 + n2)

In the above formula, the hypothesized difference between population proportions is 0.   

Two sample Z-test for proportions: Examples

Let’s learn the two-proportion Z-test with an example. You could use a two-proportion Z-test to determine if the proportion of people who responded positively to the medicine is different between the two groups. On one sample of 200 people, 130 people responded positively, and on another sample of 100 people, 50 people responded positively to the medicine.

P1 = 130/200 = 0.65, N1 = 200

P2 = 50/100 = 0.5, N2 = 100

P = (130 + 50)/(200 + 100) = 180/300 = 0.6

Z-score = (P1 – P2)/SQRT[P*(1-P)]*SQRT[(1/N1) + (1/N2)]

= (0.65 – 0.5)/SQRT[0.6*(1-0.6)]*SQRT[(1/200) + (1/100)]

= 0.15/SQRT[0.6*0.4]*SQRT[0.005 + 0.01]

= 0.15/SQRT[0.24]*SQRT[0.015]

= 0.15/(0.49*0.1225)

= 0.15/0.06

Z-score = 2.5

The p-value for the two-tailed test comes out to be less than 0.0124. For a significance level of 0.05, the test outcome is statistically significant as P-value is less than 0.05. Thus, the difference in response to the medicine needs to be further investigated.

Summary

The two-sample z-test for proportions is a statistical test that can be used to determine if two proportions are different. The test is advantageous because it does not require any knowledge of the population’s standard deviation. In order to use two proportions Z-test, the two populations must be normal or approximately normal and two samples must be independent and randomly sampled from the two populations. The two-sample z-test is commonly used in real-world examples such as determining the effectiveness of medicines, election results, customer purchase behavior, and A/B testing.

Ajitesh Kumar

I have been recently working in the area of Data analytics including Data Science and Machine Learning / Deep Learning. I am also passionate about different technologies including programming languages such as Java/JEE, Javascript, Python, R, Julia, etc, and technologies such as Blockchain, mobile computing, cloud-native technologies, application security, cloud computing platforms, big data, etc. I would love to connect with you on Linkedin. Check out my latest book titled as First Principles Thinking: Building winning products using first principles thinking.

View Comments

Recent Posts

Agentic Reasoning Design Patterns in AI: Examples

In recent years, artificial intelligence (AI) has evolved to include more sophisticated and capable agents,…

2 months ago

LLMs for Adaptive Learning & Personalized Education

Adaptive learning helps in tailoring learning experiences to fit the unique needs of each student.…

3 months ago

Sparse Mixture of Experts (MoE) Models: Examples

With the increasing demand for more powerful machine learning (ML) systems that can handle diverse…

3 months ago

Anxiety Disorder Detection & Machine Learning Techniques

Anxiety is a common mental health condition that affects millions of people around the world.…

3 months ago

Confounder Features & Machine Learning Models: Examples

In machine learning, confounder features or variables can significantly affect the accuracy and validity of…

3 months ago

Credit Card Fraud Detection & Machine Learning

Last updated: 26 Sept, 2024 Credit card fraud detection is a major concern for credit…

3 months ago