Class 1: Uncertainty & Probability Theory: The Logic of Science: Logic Teaser

Class 1: Uncertainty & Probability Theory: The Logic of Science: Logic Teaser

See the end of this post for how the class might work and details about the video.

Video

Yes, the lighting is terrible. I give sallow a bad name.

Links:
YouTube
Twitter
Rumble

Lecture

There are really only two areas of philosophy when it comes to science: that of what is, and that of how we know of what is. We need both and neglect neither, though we will concentrate on the latter; epistemology. This is a course on philosophy, mathematics and science. But geared toward understanding understanding, and not so much on making new science, which I’ll leave to you.

There are those things we know with certainty, those in which we have only uncertainty, and an even huger array of things we don’t even know we don’t know about. That “huger” is itself an uncertain guess. After all, how we can know all of what we don’t even know we don’t about?

Well, skip that question for now. Let’s think about thinking first.

Our texts will primarily be three: Uncertainty, from me, Probability Theory: The Logic of Science, from ET Jaynes, and David Stove’s The Rationality of Induction. It would be well to acquire and read all three. But if you can’t, I’ll try and give you what you need. Bits and pieces are all online.

Let’s start with Chapter 1 of Jaynes, in which he suggests taking a leisurely look at problems of uncertainty. We will take our time. This will seem too easy, even trivial, at first.

Jaynes starts with logical deduction.

Maybe the easiest is this logic (not in Jaynes): “If A (a proposition) is true, then A is true”. Seems easy enough, anyway. But think. There’s a lot going on here, more than what exists between the quotation marks. Much more. At the least there are words and the words are in a certain order, not to mention the punctuation. All of this information is tacit and not specified in the deduction. But it is always there.

So it may seem obvious and rational to see that the sentence is true—rationalists congratulate themselves for this vision—but we cannot know it is true without assuming a lot of other things. Some of which we did not learn by rationalist deduction, and we know by other means. What means?

Hold that thought in the back of your mind, and we’ll return to it in good time. For now, we’ll retreat to the standard logical beginning. Jaynes offers “modus ponens” (don’t sweat the names), like this, remembering “A” and “B” are propositions:

If A is true, then B is true.
A is true.
Therefore, B is true.

We accept for the sake of argument that “If A is true, then B is true.” For some A and B. It does not mean the sentence fits for any and all propositions A and B. That’s another subject to which we’ll return in time, when we examines Stove’s arguments that logic is not formal. But let that pass for now, too.

Another way to say this is that B follows from A. It is discovered or assumed A is true. Thus B must follow.

This does not mean A caused B every time. If A does cause B every time, and with no proviso or limitations or contingencies, then if A is true, then it must be that B is caused, and therefore B is true.

Our deduction is logical and not necessarily causal, though, yet it can be causal. Jaynes gives an example like A = “It is raining”, and B = “It is cloudy.” Clearly, if it is raining it is cloudy—unless the Devil is beating his wife. And that if we notice it is raining, we deduce it is cloudy. Or that the rain comes from clouds in the case of Satanic domestic abuse. The logic works.

But the causal direction is backwards. The clouds, in part, and as one of the parts of a cause, cause the rain. The rain doesn’t cause the clouds. Which brings up another immensely important point: cause. We need to fully understand what we mean by that word. We’ll let that pass for now, too, and let our common understanding hold sway.

The point is that we can have logical certainty without causal certainty. We can even get the cause wrong and still have logical certainty.

The second point is that “If A then B” is subjective. It is an assumption we make. So is the assumption of the second premise, that A is true, subjective. But once we have made these subjective choices, the logic flows in a rigorously objective fashion. So logic is both subjective and objective.

Our next example inverts the first (“modus tollens”):

If A is true, then B is true.
B is false.
Therefore, A is false.

Typically this will be proved using symbols and a sort of mathematical apparatus (truth tables or line-by-line logical analysis). These methods require some real work to ensure you grasp them. But maybe we can do it an easier way.

Again we start with the subjective—hey, we picked it—sentence “If A is true, then B is true.” Then we assume or see that B is false.

The only way we know, or rather assume, that B can be true, logically, is if A is true. We said. We see that B isn’t true. Which means that A must be false, because if it wasn’t, A would be true and thus B would be true.

Next example.

If A is true, then B is true.
B is true.
Therefore, A is true.

This is a well known fallacy; the conclusion does not follow logically from the premises. How do we prove that? Usually by contradiction, by imagining other ways we can know B is true, like this:

A → B
C → B
D → B
E → B

There are, we imagine, lots of other ways that we can know B is true, A being only one of them. It could be that A is false and C is true, or D, or and so on.

What is important, even crucial, to grasp is that these premises are also tacit, part of the argument, and that we supply the list. For it could be, in a causal sense even, and we just don’t know it, that the only way for B to be true is if A is, then this argument is not a fallacy—if we add that tacit premise to it. Just as we add that picture as a tacit premise to prove it is a fallacy.

Let’s continue.

If A is true, then B is true.
B is true.
Therefore, A because more plausible.

We have moved from strict logicality to its uncertain version. This is where the some quail, and dismiss the conclusion as logical. They do this, I think, because the traditional way of manipulating symbols to prove logical arguments don’t allow for this sort of thing. But pictures can.

A → B
C → B
D → B
E → B

W = (w_1, w_2, w_3, …)

Just like in proving the fallacy, we imagine, or assume, or accept, that there are lots of ways for B to be known to be true: “If A is true then B is true”, or “If C is true then B is true”, and so on. There is some number of these ways, which we don’t even have to know, but we could, and even do in some cases. We’ll get to those examples another day. There is also a World of propositions W, which are infinite, that have nothing to do with B, which we also do not have to know, except that they exist.

Now if B is true, then we know it has to be A or C or D or whatever, and still nothing in W, that are true. So A indeed has become more plausible. If you don’t love this, consider we used the exact same move to prove the fallacy above.

Another example:

If A is true, then B is true.
A is false.
Therefore, B because less plausible.

It should be easy enough to see—using the same picture—that if A is ruled out as a reason for B, then while one of the other reasons for B being true might hold (C through etc.), there is at least one less reason for B being true. Which is to say, A.

So it does indeed follow logically that because A is false B is now less plausible.

Less plausible is another way to say less likely, and that is another way of saying less probable.

We have just proved in these two examples probability is a matter of logic. There was nothing subjective about the proof, nor anything about “relative frequencies”, nor anything about a strength of evidence, per se, nor about causality, which we’ve already seen doesn’t count. There isn’t anything here except logic.

All we did was use the very implicit and tacit premises that people use to show formal versions of some arguments are fallacies, tacit premises which are forgotten in writing down formal truth tables in the like.

Now I don’t mean this as a complete proof, as there are all kinds of niceties to discuss. This is just a tease; more is to come.

Let’s end with one more example, also from Jaynes, which is your homework:

If A is true, then B is becomes more plausible.
B is true.
Therefore, A because more plausible.

HOMEWORK: HOW CAN THIS BE SO?

Here endeth the lesson. We have done three pages of Jaynes, with only 647 to go. Not to mention the other books.

Class Notes

Even though we only did a couple of arguments, I have the idea I rushed through everything in the video. But it’s a half hour already! I think, too, I need to get a lavalier microphone, since this one is not cutting it when I turn toward the board.

I have no idea how anybody can “sign up” for this class, or even if that’s a necessity.

Homework and questions: I’ll read all comments, but I can’t take the time to answer all questions, if there are more than one or two, and because I’m posting this video in various places. I’ll take what I think it necessary and answer them in the next lesson.

All ideas welcomed.

Permanent class page link.

Subscribe or donate to support this site and its wholly independent host using credit card click here. Or use the paid subscription at Substack. Cash App: $WilliamMBriggs. For Zelle, use my email: matt@wmbriggs.com, and please include yours so I know who to thank.

12 Comments

  1. Incitadus

    If anyone doubted AI would usher in the Anti-Christ now we’ve got English majors
    flooding stats courses. Well done Briggs.

  2. Very cool.

    With Brave on debian the header video shows up properly; with safari on ipad it does not – instead there’s a msg: “This video is private”. (but the links work).

  3. Hagfish Bagpipe

    GREAT STUFF! Ha! I love it, the unfinished wall, the cheesy chalkboard, the homespun production –perfect! THIS IS WHAT WINNING LOOKS LIKE NIGGERS! Not joking or ironic, a man just starts with the means he has at hand building the good, true, and beautiful. Not whining woe is me we’re all doomed I deserve better. No sir. Just digs in and starts doing, loving the work, enjoying the opportunity to pass along the skills and wisdom that were handed down to him while making such improvements as talent and inspiration permit. That’s what it’s all about. It doesn’t get any better, in essence. Oh sure you can scale it up and look like a bigger, but the essence is unchanged, and the bigger inevitably finds bigger opportunity for corruption. Like biggers working for Harvard or MIT or Cornell where you pass out the woke poison along with lessons, your ass being owned.

    But Briggs is a free man. He paid the price and now teaches, gratis, and for donations, to grateful students hungry for real skills and knowledge. Like some ancient Greek Academy, Christianized, and now online. What an amazing world. Life is great, opportunity abounds, even, and especially, when the Enemy appears to be riding high. Just don’t accept his stupid terms and conditions. Rather, follow the Master, and take up your work with joy. That’s the American spirit. Briggs looks like he’s having fun in this video. That’s fun to watch. Even for the statistically challenged. And as if the video wasn’t enough, he even wrote out an entire lecture, in English! This is how the new, improved Harvard of the future gets built, one brick at a time.

    [Consider adding an appropriate necktie of moral resolve and insouciance to your proper ensemble of jacket, pocket square, dress shirt and slacks… no doubt the shoes we do not see are leather, and polished.]

  4. Briggs

    Hagfish,

    Shoes?

  5. Robin

    I find this part of probability to be most challenging. It’s so easy to fail in this fundamental line of reasoning when trying to address more complex problems. The terms:

    plausibility
    probability
    what is true vs
    what we know to be true
    induction
    deduction
    causality

    What about “assumption”?

    Recently I’ve been involved in a court case where the outcome will be based on the balance of probability. From your work, and my case, I now accept that probability is not frequentist, it is instead logic.

    But what I find critical in this circumstance is the ability to clearly identify and then test each and every possible assumption. This has proved the most important part of my work.

    For this reason, I think that more emphasis needs to be placed on assumptions and their role in the logic of probability. Some assumptions are so basic they easily go unnoticed. Domain specific knowledge is crucial in this respect.

  6. john b()

    Logic is a little tweeting bird, chirping in a meadow. Is that the inspiration for Twitter?
    Logic is wreath of pretty flowers that smell bad.

  7. john b()

    Logic is a little tweeting bird, chirping in a meadow.
    Logic is wreath of pretty flowers that smell bad.

    Would it be more appropriate to say if B is False then A is NOT True

    Just sayin’

  8. Hagfish Bagpipe

    Sandals maybe… but no toga.

  9. Woodrow Matthews

    If A is true, then B is becomes more plausible.
    B is true.
    Therefore, A becomes more plausible.

    HOMEWORK: HOW CAN THIS BE SO?

    This appears to be so because of implied antecedents in addition to A. If the truth or untruth of A is the only possible antecedent for the truth or untruth of B, then B is not just plausible, it is either true or not true. Given that the proposition specifies A to be true and B initially as more plausible, but then is apparently identified to be true with a subsequent conclusion that A is now described as more plausible instead of true, then the question that comes to mind is A is more plausible than what? Additional unknown or unidentified antecedents to B? There must be actual or potential additional antecedents C, D, E and so on to merit the reduced certainty of the word “plausible”. Given the stated truth of A and the “more plausible” initial description of B followed by the assertion that B is true, there is an implied recognition that additional unspecified or unknown antecedents to B may exist.

  10. Phil R

    I’m neither a statistician nor a philosopher so I’ve found this site very informative (and entertaining). However, I’m still stuck on the basics of ontology and epistemology. I get the Wikipedia or dictionary definition (what do we know and how do we know it), but I’m really stuck on epistemology. Does epistemology explain how we know stuff or does how we know stuff determine the epistemology (sorry if this is confusing, but that’s why I’m confused). I bring this up because one time I read about feminist epistemology (talk about a nightmare) and the definition (off the top of my head) was something like, epistemology as viewed through a feminist lens. In other words, what ever feminism was, it came first (ontology?) and defined the epistemology. This may be a little off topic, but is there any good or clear definition or description of epistemology? From a slow learner…

  11. Andrew

    A => B
    B
    Therefore A is more plausible

    “More plausible” is doing a lot of heavy lifting

    Example: I have a failure in my software. The most likely causes are A or C. Since A => B, I test B. B holds

    This isn’t evidence FOR A over C. Not B would have been strong evidence for C (assuming “A or C” was true), but failure to disconfirm A doesn’t imply that A becomes more likely than C

  12. I hope that you will address additional mathematical models of uncertainty, such as starting with Bayesian and progressing to Dempster-Shafer theory, DSmt, etc.

Leave a Reply

Your email address will not be published. Required fields are marked *