The following conversation from an alleged Class follower (CF) and an academic statistician (AS) may or may not have taken place. Whichever, it comes at a perfect time for our entry into Time Series. Note the brief video (at bottom) has material additional to this dialog.
CF: I couldn’t help but notice the graph on your screen. Would you mind if I looked closer?
AS: Not at all. Here:
CF: If we accept the veracity of the sources going into that picture, China’s fertility rate has really fallen over 70 years, and at last joined the rest of the civilized world. One child on average per woman is low.
AS: The sources are all official, so they’re likely right. I can see why you’d say the rate as fallen, but you know we have to do a statistical test to confirm that rate has indeed dropped.
CF: A test? I don’t understand. Let’s accept the data’s accuracy. You mean we can’t say the rate has dropped from its highs in the 1950s to 1970s without a statistical test? We can’t just look?
AS: Oh, no. That’s a common error many make, so don’t feel bad about it. Yes, we have to perform what’s known as a hypothesis test. We subject the data to a rigorous mathematical test, and this tells us whether the seeming drop is real or random.
CF: Random?
AS: That happens when it only appears changes in trend occur, but which aren’t real.
CF: Not real? So this change in trend we’re seeing might not be a change at all? The rate might not have dropped?
AS: That’s right. You can never tell without first testing. But in this case, I have already done the test. The decline we’re seeing is real.
CF: What do you mean by real?
AS: The drop is statistically significant. Hold up. I can see your next question. Statistical significance is given to us by the test. It is a point at which we judge the results to be real and not random. This is measured by the P-value.
CF: P-value? You’re not making a urology joke, are y0u?
AS: Very funny, I’m sure. No, no. It is a complex number, part of the difficult math of hypothesis testing. It’s too hard to explain simply. But when the test gives us a P-value less than 0.05, we are entitled to say the results are statistically significant.
CF: So a wee P means not random?
AS: That’s one way to put it.
CF: And not random means statistically significant?
AS: That’s right. You have it.
CF: And statistically significant means a wee P?
AS: That’s it. That’s the essence of testing. That’s more or less the whole theory, without the mathematics.
CF: Is it only time series that you need to test? I mean, can you just look at other data and say whether or why changes have taken place, or do you always need to test.
AS: Very good question. No, you always have to test. Testing is the only way to say whether changes are real or merely by chance.
CF: So, going back to pictures you have, if I wanted to know whether the trend changed at any point, I could just do a test.
AS: That’s it. They’re somewhat complicated, but software eases the burden for us.
CF: Can you show me how to use it?
AS: Why not.
[At this point, a lesson in how to use time-series change point testing supposedly occurred.]
CF: All right, so I’ve done the test, and you can check my code. And if I did it right, it confirms the fertility rate changed from before the 1-child policy, then it changed again after the 2-child policy, but that the change after the three-to-any-number-of-children politics is random. Meaning it’s not a real change. Is that right?
AS: Let’s see. Yes. Your code looks right. And so is your conclusion. I’ll have to watch out for you. You learn fast. You’ll soon have my job. [Laughs]
CF: Would you say a fertility rate below replacement, which I define as one couple breeding at least two more people, ideally who themselves go on to breed, is good or bad?
AS: It would seem to be bad, if the country wants to keep its population up.
CF: So that a fertility rate of 1, as the picture indicates at the end—
AS: Hold up. Remember, we can’t say if that 1 is real or is random. The real number may be anything.
CF: Anything?
AS: Any number that’s possible I mean. That can be 0 to as many children as an average woman can have.
CF: I see. Let me ask something different. The test says that the fertility rate was significantly higher when China had a 1-child policy than when it had a 2-child policy, and that the rate was again significantly higher in the 2-child policy than the 3-child policy (and that the rate following this may be any number). That means that if China wants to increase its fertility rate, it should eliminate its latest open policy and reinstitute the 1-child policy.
AS: Ha ha! No, no. That doesn’t follow at all.
CF: Why not? The test confirmed the changes, and those changes, the information we had about them I mean, were the 1-child policy, 2-child policy and so on. Rates were statistically significantly higher in the 1-child policy, and higher in the 2-child than the 3-child. It follows, by statistical testing, that the 1-child policy produced more children.
AS: It obviously can’t work that way. Women can’t have more children when they aren’t allowed to have more.
CF: So the test is wrong?
AS: No, but it can be wrong in five percent of the cases in which it’s used.
CF: You never said before the test can be wrong.
AS: Well, unfortunately it can. That’s one of its peculiarities. But the test is likely right. It’s that it is wrong in 5% of the cases it’s used in the long run.
CF: I see. How can you tell if the test is wrong?
AS: You can never tell in any instance whether it’s right or wrong, but we do know it can only be wrong in 5% of its cases, but again only in the long run.
CF: The long run?
AS: I mean at the limit.
CF: The limit?
AS: Out at infinity. The math guarantees that 5% at infinity.
CF: I see. What’s this field called?
AS: Time series analysis.
The conversation reportedly ended here. We’ll take it up again in Class, and investigate one of the most misused and misunderstand areas of Science: Time Series.
Video
Here are the various ways to support this work:
- Subscribe at Substack (paid or free)
- Cash App: $WilliamMBriggs
- Zelle: use email: matt@wmbriggs.com
- Buy me a coffee
- Paypal
- Other credit card subscription or single donations
- Hire me
- Subscribe at YouTube
- PASS POSTS ON TO OTHERS
Discover more from William M. Briggs
Subscribe to get the latest posts sent to your email.
I don’t know why they get all upset about the TF. When things change, things change. We are wrecking our countries by trying to import a replacement people to save the pension system which cannot be saved in any event. The TF can be reversed in a single generation. The changes brought on by a generation long TF of 1 will dramatically change a country. Two things it will almost certainly do is drop the cost of living and raise wages, at least if you don’t import millions of foreigners.
How many times have you driven down the road in the US (or Europe or China etc) and thought, “you know what this place needs? MORE CARS! MORE PEOPLE!” Not once has this ever happened. The cost of living and overcrowding conditions are likely playing a major role in the low TF. A few decades of low birth rates will dramatically lower the cost of living. People will respond to the new conditions. When things change, things change.
@Tars Tarkas
While living in China, I never felt a need for more people or cars. I did, however, often muse that a shipload of American trial lawyers would be just what the doctor orders (to gum up the works).
Well then Tars, if depopulating China is your goal, they should definitely end restrictions on births. Because the fewer the restrictions, the lower the birth rate. That’s what the data says. Significantly.
What the good doctor failed to mention, but certainly will next week, is that Ascribing Causes to time series data flux is a whole lot more iffy than just monitoring the flow.
The amusing thing is one of the facilitators of China’s rise is its falling fertility, giving it the breathing space to develop economically without having to expend capital on useless eaters. China still has half a billion of dollar a day rural peasants to bring into a modern finance economy, what does it need children for. Youth unemployment in China is at 20% even though China is the manufacturing powerhouse of the world. Young men of reproductive/fighting age are the drivers of social unrest and crime so unless you have a hot war with some other country with a surplus of the same they are a liability not an asset in the modern world where machinery does all the heavy lifting.
One may note that the richest countries in the world have relatively small populations. Pretty much every country in the world needs not just declining birthrates but a cull, particularly of coffin dodgers.
India is aggressively exporting its surplus population in a vain attempt to keep its head above water, forced sterilization having done nothing to stem the tide. The last census suggests 25% of the Indian population is under 14 years old. The growth of the Indian population is just entering the exponential phase (there’s a time series for you). The baffling thing is why the anglophone countries are accepting the surplus Indians in direct contradiction to rational economic interests, it seems the political interests of the power elite to keep the masses poor and stupid over-ride considerations of providing general wealth and high standards of living… unsurprisingly.
In any case there is only now. Time is an illusion, lunchtime doubly so.