The expected value of an unbiased estimator of the mean is the mean of the underlying distribution. The sample mean will change with a different sample, whether smaller or larger, but this is only a function of the sample. If you take another sample of the same size, you will get a different sample mean (unless something weird happens). There is nothing about a sample size that says "This is the real mean of the population", well, until your sample is the entire population, but that's not really a sample, is it? The goal of a larger sample size is the decrease in the variance.