Explain the relationship between statistical inference and the theory of probability and sampling.?

I am looking for answers to help understand the relationships between statistical inference, theory of probability, and sampling to write a comprehensive essay.