What is the p-value of a hypothesis test?

p-values or probability values play a very important role in hypothesis testing. The probability value or p-value associated with a test is the probability that we obtain the observed value of the test statistic or a value that is more extreme in the direction given by the alternative hypothesis when H0 is true.