A look at Causality:

combined

As an Engineer, I am very interested in Cause and Effect phenomenon. We have always been trained to understand that correlation does not mean causality. But then how does one establish causality? The most common method is to use randomized blind studies.

In this post I want to highlight two pioneers who have established paradigms for understanding cause and effect. They are David Fume and Sir Bradford Hill. Understanding their approaches provides a deeper philosophical understanding on cause and effect.

David Hume:

David Hume (1711 – 1776) was a great Scottish Philosopher who authored “A treatise of human nature.” In this, he gives eight rules to clearly determine cause and effect. I have paraphrased some of them for clarity.

  1. The cause and effect must be contiguous in space and time.
  2. The cause must be prior to the effect.
  3. There must be a constant union between the cause and effect. It is chiefly this quality that constitutes the relation.
  4. The same cause always produces the same effect, and the same effect arises from the same cause.
  5. To add to rule 4, where several different objects produce the same effect, it must be by means of some quality, which we discover to be common amongst them.
  6. The difference in the effects of two resembling objects must proceed from that particular, in which they differ. For as like causes always produce like effects, when in any instance we find our expectation to be disappointed, we must conclude that this irregularity proceeds from some difference in the causes.
  7. When any object increases or diminishes with the increase or diminution of its cause, it is to be regarded as a compounded effect, derived from the union of several different effects, which arise from the several different parts of the cause. The absence or presence of one part of the cause is supposed to always be matched with the absence or presence of a proportional part of the effect. This constant conjunction sufficiently proves that the one part is the cause of the other.
  8. An object, which exists for any time in its full perfection without any effect, is not the sole cause of that effect, but requires to be assisted by some other principle, which may forward its influence and operation. For as like effects necessarily follow from like causes, and in a contiguous time and place, their separation for a moment shows, that these causes are not complete ones.

The particular section of Hume’s treatise is available here. https://ebooks.adelaide.edu.au/h/hume/david/h92t/B1.3.15.html

Sir Bradford Hill:

Sir Bradford Hill (1897–1991) is most famous for the Hill criteria in epidemiology. The hill criteria, described first in his paper “The Environment and Disease: Association or Causation”, again provides a list of rules to determine causality. As a side note, his paper used smoking-cancer link as an example, and this was refuted strongly by Sir Ronald Fischer. That will be a post for another day.

The Hill criteria consist of 9 rules, and there are some overlaps with Hume’s rules. Hill has given the following background for his criteria.

“None of these nine viewpoints can bring indisputable evidence for or against a cause and effect hypothesis …. What they can do, with greater or less strength, is to help answer the fundamental question—is there any other way of explaining the set of facts before us, is there any other answer equally, or more, likely than cause and effect?”

  1. Strength: A strong correlation is a pre-requisite to consider causality.
  2. Consistency: To quote Hill “Has it been repeatedly observed by different persons, in different places, circumstances and times?” This answers the reproducibility question. Is the effect reproducible under different set of criteria?
  3. Specificity: Ideally, in epidemiology, an effect is linked with one specific cause. In Hill’s eyes, the more specific the association to a specific cause, the stronger the argument is in favor of causation. In his words, “If the association is limited to specific workers and to particular sites and types of disease and there is no association between the work and other modes of dying, then clearly that is a strong argument in favor of causation.”
  4. Temporality: Hill presented this criterion as a question – which is the cart (effect) and which is the horse (cause)? As noted before, the cause must always come before the effect, on a timeline.
  5. Biological gradient: The keyword here is “gradient”. Is there a comparable increase in effect, with an increase in the cause factor? In his paper, Hill gave the example of death rate to number of cigarettes smoked in a day. This is a kind of feedback loop.
  6. Plausibility: This is my favorite criterion in the list. Is the cause and effect theory likely to happen from a logic stand point? I was very excited when I saw that Hill actually quoted Sherlock Holmes in his paper. “In short, the association we observe may be one new to science or medicine and we must not dismiss it too light-heartedly as just too odd. As Sherlock Holmes advised Dr Watson, ‘when you have eliminated the impossible, whatever remains, however improbable, must be the truth.’”
  7. Coherence: To expand upon criterion 6, Hill wanted to make sure that the cause and effect theory did not go against existing theories. There is always more buy-in when the theory does not conflict with existing knowledge.
  8. Experiment: One must always provide experimental evidence to back up the cause and effect theory.
  9. Analogy: If there is supporting evidence on similar factors, it makes it easier to establish causality.

Bradford Hill’s seminal paper is available here. http://www.ncbi.nlm.nih.gov/pmc/articles/PMC1898525/pdf/procrsmed00196-0010.pdf

Final words:

One must learn from great thinkers from other fields. In your next problem solving project, when you are trying to perform root cause analysis, will you be able to use Hume’s rules or Hill’s criteria?

Always keep on learning…

The greatest barrier to scientific thinking:

confirmation-bias

If one were to ask me, what I am afraid of as an Engineer, I will unequivocally declare “Confirmation Bias”.

“The human understanding when it has once adopted an opinion (either as being the received opinion or as being agreeable to itself) draws all things else to support and agree with it.”

– Francis Bacon, Novum Organum, 1620

Confirmation bias is part of everybody’s thinking process. When confronted with a problem, one has to determine how to solve it. The first step is to analyze the problem, and this requires looking inward and finding the mental model that might explain the problem at hand. If one such pattern is available, then he tries to fit the problem into the model, as if it is a suit tailored to fit the body of the problem. This is a form of deductive thinking.

In the absence of a pattern, he tries to gather further information to form a mental model. The newly created model may fit the problem much better. This is a form of inductive thinking.

Sometimes, in the absence of a pattern, one might try to find multiple mental models and see which model fits the problem the best. This is a form of abductive thinking.

No matter what form of thinking is used, the problem occurs when one tries to find evidence to prove the model, and ignores any evidence that might otherwise prove it wrong. This is the curse of confirmation bias. It can create blind spot that sometimes is large enough to hide an elephant!

“When men wish to construct or support a theory, how they torture facts into their service!”

John Mackay, Extraordinary Popular Delusions and the Madness of Crowds, 1852

This creates quite a challenge for any form of activity involving brain functioning like problem solving or decision making. I have attempted to create a list of steps that one can use to minimize the impact of confirmation bias. I will be the first person to tell you that this is a daily struggle for me.

  • Be aware that confirmation bias exists:

The first step is to be aware that confirmation bias is part of what we are. Just being aware of this can help us in asking the right questions.

  • Walk the process:

Walking the process allows us to understand the big picture, and helps us in seeing the problem from other people’s perspective. If a problem is identified on the floor during assembly, it helps to walk the process with the component starting at the receiving dock all the way to the assembly on the floor. This helps to slow us down, and we may see things counter to our initial hypothesis that we may have missed otherwise.

  • Can you turn the problem on and off?:

When a problem occurs, either in the field or on the production floor, I always try to see if I can turn the problem on and off. This helps to clarify my mental model and validate my thinking. The cause alone does not result in the effect. The cause, in the presence of enabling conditions creates the effect. Understanding the enabling conditions help us to turn the problem on and off.

  • Challenge yourself to disprove your model:

Challenging yourself to disprove your own model is probably the most challenging yet most effective way to combat confirmation bias. It is after all, easier to disprove a theory than prove it. This helps to purify one’s thinking.

In a recent conversation with my brother-in-law, he talked about the “tenth man” scene from the movie “World War Z”. In the movie, the whole world is under attack from a zombie virus. Israel had built a wall around the nation that prevented the outbreak up to a certain point in the movie. This was achieved through a policy referred to as “tenth man”. It basically states that if 9 out of 10 people in a council agree on something, the tenth person has to take the opposite side, no matter how improbable it might seem.

  • Understanding the void:

My first blog post here was about understanding the void. This is similar to the negative space idea in designing. The information that is not there or not obvious can sometimes be valuable. Looking for the negative space again helps us in looking at the big picture.

In the short story “Silver Blaze”, Sherlock Holmes talks about the “curious incident about the dog.” Holmes was able to solve the mystery that the crime was committed by somebody that the dog knew.

Gregory (Scotland Yard detective): “Is there any other point to which you would wish to draw my attention?”

Holmes: “To the curious incident of the dog in the night-time.”

Gregory: “The dog did nothing in the night-time.”

Holmes: “That was the curious incident.”

I will finish this post off with a Zen story.

There was a great Zen teacher. Some of his disciples came to him one day to complain about the villagers.

They told him that the villagers were spreading rumors that the teacher was immoral, and that his followers were not good people. They asked him what they should do.

“First, my friends,” he responded, “you should definitely consider whether what they say is true or not.”

Always keep on learning…

Meditating with the Cat and Toyota Production System

bodhidharma.350

There once lived a Zen master who was renowned for his profound wisdom. He had many disciples under him. He was said to be a great teacher of meditation.

One day, one of his disciples brought him a kitten. The master was pleased with such a gentle, curious creature. That day, it was time for the meditation class, and the master started his meditation.

Just then, the kitten jumped on his lap and started purring. This distracted the master. He ordered the cat to be tied to the chair next to him. The kitten being the gentle creature that it was, thought it was a good time to sleep while being tied to the chair. This continued every day and every day, the kitten would disrupt the master during meditation, and would get tied to the chair.

Years went by, and the cat was now regularly tied to the chair during meditation time. People from all over would come to learn from the master, and would notice the cat being tied to the chair during meditation.

The master soon died, and the new master continued this practice. Soon the cat died as well. The monastery then got a new kitten, and it got tied to the chair as well. Scholars started writing about this superior method of meditation and how this was better than “regular meditation”. People everywhere started buying cats to improve their meditation skills…

I read this story a while back, and rewrote it for this post. This post is similar to the “Spirit of Buddha” post I made earlier. It has become common to start off lean journeys by mindlessly copying the tools that are used at Toyota. Toyota has crafted the Toyota Production System over decades of trial and error. Each tool they developed or borrowed was to address a specific problem they faced. One should not copy Toyota. The cat was tied to the chair to address a specific problem faced by the master. The cat story is a good example of how we sometimes blindly follow methodologies without understanding the origins.

Shigeo Shingo, in one of the best books on Toyota Production System – “A Study of the Toyota Production System” states the following;

“It must be understood, though, one of its (Toyota Production Management System) prime features is that it is permeated with its own advanced concepts and special techniques. This does not necessarily mean, however, that one can simply copy the distinctive external techniques of the Toyota Production System in another manufacturing environment.

In the same light, Satoshi Hino in his book, “Inside the mind of Toyota” has written the following;

“Unless we could grasp the structure of their minds, then even though we might be able to copy the Toyota Production System, we wouldn’t be able to work out methods for going beyond it and we would never prevail.”

To paraphrase Alan Mulally, former President and CEO of Ford, “If you copy someone, you can only come second. You cannot come first.”

Always keep on learning…

Relationship between AQL/RQL and Reliability/Confidence:

Untitled2

The Z1.4 AQL sampling plan tables do not translate to reliability/confidence level values. In fact, the Z1.4 tables do not translate to %quality values at 95% confidence level as well. This seems to be a general misconception regarding the Z1.4 tables.  One cannot state that if the sampling plan criteria are met, the % non-conforming equates to the AQL value at 95% confidence level.

How can we define AQL in layman’s terms? Looking at the figure below, one can simply state that AQL is the % nonconforming value at which there is (1-α)% chance that the product will be accepted by the customer. Please note this does not mean that the product quality equals the AQL value.

Untitled

Similar to the AQL value, we can also define the RQL value based on the picture above. RQL is the %nonconforming value at which there is β% chance that the product will be accepted by the customer.

The RQL value corresponding to the beta value is much more important than the AQL value. The RQL value has a direct relationship with the Reliability/Confidence values.

The relationship between β and RQL is shown below, based on the Binomial equation.

rql

Where n = sample size, and x = number of rejects.

When x = 0, the above equation becomes;

eqn2

Taking logarithms, the above equation can be converted as;

eqn3

Interestingly, this equation is comparable to the Success Run Theorem equation;

eqn4

Where C is the confidence level, and R is the reliability(%).

The Reliability value(%) is (1-RQL)% value at the desired β value.

The Reliability value(%) is (1-RQL)% value at the desired β value. The confidence level value translates to the β value, as shown in the equation above.

I have created a Shiny App through R-studio where the reader can play around with this. This web based app will create OC-curve, and provide values for AQL, RQL, and reliability values based on sample size and number of rejects.

https://harishjose.shinyapps.io/OCR1

I encourage the reader to check out the above link.

I have a new post in this topic. Check out https://harishsnotebook.wordpress.com/2019/10/19/aql-rql-ltpd-oc-curve-reliability-and-confidence/

Keep on learning…

Defining “worst-case” for Medical Device packaging

Sterile-Eo

I have an ongoing interest in Medical Device packaging. When I started at my current job a while back, my manager told me that the packaging operation is most critical operation for a sterile Medical Device. The product quality does not matter if the device is not provided sterile for the end user. The qualifications of new packaging configuration and the packaging process soon became my areas of interest.

The concept of “worst-case” is rooted in product reliability and good product design practices. The applicable industry standards for packaging Medical Devices are ISO 11607 parts 1 and 2. ISO 11607 part 1 has the following section detailing the use of “worst-case” product configuration for qualifying a packaging system.

“When similar medical devices use the same packaging system, a rationale for establishing similarities and identifying the worst-case configuration shall be documented. As a minimum, the worst-case configuration shall be used to determine compliance with this part of ISO 11607.”

For a Medical device design engineer or a packaging engineer, this determination of the worst-case comes natural. It is based on engineering judgment and intuition. However, one might find it easier if this can be documented objectively. The following matrix might be useful to document the worst-case configuration. Perhaps one can utilize a scoring system (1 through 5, where 1 -> Best case, and 5 -> Worst case) for each of the items detailed in the table below. Thus, the product with the highest score can be determined to be the worst-case configuration.

# Item Comments
1 Sterilization 2X sterilized represents worst case
2 Sealing Low setting or edge of failure represent worst case
3 Mass Heaviest product represents worst case
4 Size Bulkiest represents worst case
5 Product geometry Sharp corners represents worst case
6 IFU Largest, heaviest, stapled IFU represents worst case
7 Product configuration Most number of components inside represents worst case
8 Shipper quantity Most number of units in the shipper represents worst case
9 Shipper compactness Maximum room for pouches to move around represents worst case
10 Number of pouches inside sterile barrier Maximum number of pouches represents worst case
11 Compactness inside sterile barrier Maximum room inside between product and sterile barrier represents worst case
12 Pouch Used Largest Pouch (largest pouch has largest seal area) represents worst case
13 Shipper Box Burst Strength Low strength shipper box represents worst case

Please note the worst-case for qualification tests may not always represent real life scenarios. However, qualifying using the worst-case provides assurance that the product can meet real life scenarios.

The scoring sheet sample can be downloaded here (worst-case score sheet).

Disclaimer: Please note that this post is purely based on my opinion and not to be used as advice. I shall not be responsible for any possible outcomes. Please use at your own discretion.

Yin and Yang in Root Cause Analysis

Yin_and_Yang.svg

There is a balance that exists in root cause analysis that is Yin and Yang. In Chinese philosophy, Yin and Yang represents the harmonious balance between seemingly contradictory forces. Light is Yang, darkness is Yin. Hot is Yang, cold is Yin. Top of a hill is Yang, valley of the hill is Yin. The typical representation of Yin and Yang has the white section as Yang and the black section as Yin.

The root cause analysis process can be represented by the simple schematic below:

yin yang con div

Once the problem statement is made, one should use divergent thinking to gather more data/information and identify the potential sources of a problem. This should be followed by convergent thinking where one focuses on the true root cause(s). One might use Fishbone diagram as the form of divergent thinking, and five why as the convergent thinking.

Divergent thinking is expansive in nature and lacks focus, thus it is Yin. Convergent thinking, on the other hand is zooming in and direct in nature, thus it is Yang. As with anything else in nature, a good root cause analysis process should have at least one cycle of divergent thinking and convergent thinking. The approach of Yin and Yang creates a complete/whole root cause analysis.

Jumping to conclusions is just Yang. The absence of Yin makes this an imbalanced and wrong approach. As noted above, one may use multiple cycles of divergent thinking followed by convergent thinking. Think of this as a rinse process, purifying your thinking process with each cycle. This will provide clarity in your investigation, and prevent biases that water down your efforts to fix the problem.

As you may have noted, each half (Yin or Yang) also has a dot corresponding to the opposite color. This indicates that within each section, nothing is complete. In my humble opinion, this is similar to the Japanese thinking of wabi-sabi. That is, even within the Yin, it is not completely Yin. There is a dot of Yang in it. Even when we are doing divergent thinking, we are going in a certain direction. Even when we are doing convergent thinking, we are still remaining open.

Always keep on learning…

Nash Equilibrium and some strategies to cope

nash

Although the world has lost a great and beautiful mind in John Nash, his concepts and theories are very much alive in this world. He and his wife were tragically killed in an automobile accident in New Jersey last week.

John Nash is the Nobel prize winning genius behind the “Nash Equilibrium”. He showed that every game played between two or more players will always achieve a stable state, from which either player will only incur further losses if something else is played. Thus, they have reached the rational play, knowing what the other player’s strategy is and there is no point in changing their strategy based on what they know of their opponent’s strategy. This does not mean that this is the play where they can maximize their gains. The Nash equilibrium may not always represent the best outcome for either player.

For example, in the famous Prisoner’s Dilemma game, the Nash Equilibrium represents the state where both players should confess. This play is not the one where either party can maximize their gains, but this is the play where they minimize their losses based on what the other player is playing. If they both remain silent, they both get 1 year each. However, if one confesses and the other remains silent, the one confessing gets 0 years. And the one remaining silent gets 20 years. Thus, no matter what, the “rational choice” is to confess. Sadly, the mutually beneficial state of remaining silent is not the best rational choice here.

prisoners_dilemma

Nash’s succinct paper is available here. http://web.mit.edu/linguistics/events/iap07/Nash-Eqm.pdf

In a non-cooperative situation, Nash Equilibrium will almost always result in a less than desired state. In the case of the prisoner’s dilemma example above, the values (how many years) were chosen for explanation. These values are called “utilities”. Sometimes, this is a personal preference. For example, if there are cars parked in the street coming to my house, there is space for only one car to drive in the street. If I have a car coming in the opposite direction, and if that car has the right of way (if the parked car is on my side of the street), I may not assign a large value for not going first. I am not going to lose any sleep over letting the other guy go in front of me. If there is a tornado behind me, I may assign a larger value as my utility and thus have higher motivation to cut the driver opposite of me, even if he had the right of way. For the game theory enthusiasts, this is a form of game called “Chicken”. As you can imagine, if you do not know the value assigned by the opponent, you may not always make the best move.

Game theory is unfortunately alive and well at the work place as many research studies have shown. Whenever there is a form of negotiation going on there is always a possibility of a non-cooperative situation and this can lead into not so favorable outcomes, as result of the Nash Equilibrium states. A game can have multiple Nash Equilibrium states based on the opponent’s strategy. Here are some key points that can help you in dealing with the traps set by the Nash Equilibrium when you are in a bad spot. The strategies below are geared towards minimizing the imbalance in the games.

  • Tit for Tat:

Believe it or not, the best thing to do in a repeat play game is to be the nice guy first. The strategy Tit for Tat requires you to play what the other player played last. Thus, if he was nice to you first, you play nice in the next game. If he was not nice, you also do not play nice in the next game. Thus, you are forming an immediate feedback loop to the opponent, and directing how the game shall be played. It actually might help to be the kinder person first, putting your best foot forward. This is best played between people with equal standing.

  • Information misdirection:

As I indicated before, if you do not know what the value is assigned by your opponent, your strategy may be futile. Information is gold currency when it comes to playing games. You can signal to your opponent that you value X, while you are after Y. You can also trade key information as needed to gain trust as well. It is also wise to reveal only what is required. A good example is when you play poker.

  • Change the rules:

Simply put, change the rules of the game or the game itself, if you do not like what you are playing. You may try to change how the value is perceived or try to include a new value altogether that changes the initial game. If the venue for the game was telephone, arrange for a face to face meeting.

  • Bring in an authority:

How many times have you said, “I would like to talk to your supervisor”? Nobody can be 100% confident or sure about themselves. Bringing in an authority generally will make the opponent self-conscious and even self-doubting, giving you an advantage.

  • Bring in more people:

Sometimes, it makes sense to bring in more people into the game, even if they are going to be spectators and not going to be on your side. Nobody wants to be seen as the bully or the bad guy. Nonviolent and peaceful protests are examples of this strategy. The press and media are there to catch/witness any misstep that the opponent might take.

  • Look for standards or rules that are applicable:

An easy example here is if you do your homework before going to purchase a car, and inform the salesman that you know the other vendor sells it for much less a price. You can also state your past experience as a guideline of what you are expecting out of the game.

Disclaimer: Please note that this post is purely based on my opinion and not to be used as advice. I shall not be responsible for any possible outcomes. I have not delved into much depth regarding the Nash Equilibrium or Game Theory itself. This is a vast and very interesting topic. I encourage the reader to learn about this fascinating field as much as possible.

Always keep on learning…

An organized mind and a cluttered desk:

Nicolas_P._Rougier's_rendering_of_the_human_brain

Having been immersed in TPS (Toyota Production System) or lean, I have been very interested in seeing how many lean practitioners talk about 5S and the importance of a clean and organized desk. It is almost as if, the clean and organized desk indicates a clean and organized mind – making you a more productive worker. As with everything else, generalization is not always a good thing.

The goal of 5S (or Go-Esu as our Japanese counterparts say) is not to clean and have a tidy work place. The goal of 5S is to ensure that any waste becomes immediately visible. I have delved philosophically about how this applies to an office environment, where the work does not always have routine, efficient and predictable attributes.

My own personal experience has been that having a less than tidy desk never hindered my productivity. Sometimes, the opposite was true. My desk may have piles, but the most important projects/documents are always on the top and close to me. Proximity and the order indicate the importance and timeliness requirement of the project.

My goal has been to have an organized mind first, and then an organized desk. It looks like there has been some research done about the cluttered desks, and this is not truly new news. The goal of this post is not to promote cluttered desks. The goal of this post is to promote organized minds through mindfulness.

Einstein is supposed to have asked, “If a cluttered desk is a sign of a cluttered mind, of what, then, is an empty desk a sign?” The cued answer is a tongue-in-cheek “Empty mind.”

A study conducted in 2013 by Kathleen D. Vohs, a behavioral scientist at the University of Minnesota, indicated that a cluttered desk might actually lead to outside the box thinking by allowing one to veer from the conventionally treaded paths. http://pss.sagepub.com/content/24/9/1860

It is true that many great minds have been found to have messy desks.

albert

ALBERT EINSTEIN

jobs-500x333

STEVE JOBS

twain

MARK TWAIN

But as I stated earlier, the goal of this post is not to promote a cluttered desk. 🙂

I have been trying to have a better organized mind through mindfulness practice. The goal of mindfulness practice is to be aware and to be present at the given moment. Surprisingly this has huge benefits in the hustled world that we live in. Check out this link. http://greatergood.berkeley.edu/article/item/three_benefits_to_mindfulness_at_work

Mindfulness helps in improving our emotional intelligence, and helps us being focused on the task at hand. It provides clarity to our minds.

So let us try to organize our minds, getting rid of clutter leading to clarity and focus. And then, have an organized desk. Maybe, a cluttered desk is not that bad after all.

Keep on learning…

The Price of Rice – A fable about leadership

US_long_grain_rice

I heard this story when I was a little kid. Now that I am older, I am not able to trace its source. I think it may have been a Zen story. Anyways, the way I remember it is as follows:

There was a famous teacher in a village. Two brothers came to be trained under him. Years went by, and the older brother was getting restless. In his mind, the teacher was partial to his younger brother, and he could not understand why. He is older and felt wiser than the younger brother. But the teacher never gave him any responsibilities.

One day, the older brother went to his teacher and asked him,

“Teacher, why is it that you do not give me any responsibilities? You always seem to be biased towards my younger brother. We came here at the same time, and learned everything together. Yet, you treat him better than you treat me. Why?”

The teacher smiled. He sipped his tea, and then said,

“Let’s do this; why don’t you run to the village center and go to the rice store. Ask the vendor, what is the price of rice? Come back when you are ready.”

The older brother thought this was an easy job. He ran to the village center and asked the vendor the price for rice, and ran back to his teacher.

“It is 10 rupees per kilo.” He said trying to catch his breath.

The teacher asked him. “Is this the price for brown rice?”

“Yes”. The older brother replied.

“What about the white rice?” The teacher asked.

“I do not know.” The older brother replied.

So he ran back again, and asked the vendor for the price of white rice, and ran back to his teacher.

“It is 12 rupees per kilo.” He replied again trying to catch his breath.

“Is there a price discount, if I buy 10 kilos?” The teacher asked.

“I do not know” was the answer again.

The student ran to the village center yet again to gather more information.

“The price is 8 rupees if we buy 10 kilos.” The student responded.

“What about the white rice?” was the next question from his teacher.

Now the student was too tired to run back again, so he sat down ashamed.

The teacher asked for the younger brother to come. He was unaware of any of the happenings.

“Why don’t you run to the village center and go to the rice store. Ask the vendor, what is the price of rice? Come back when you are ready.” The teacher asked the same thing to the younger brother.

“Sure thing, Teacher”, the younger brother replied.

He ran off and came back after a short while.

“The price of rice is 10 rupees per kilo for brown, and 12 rupees per kilo for white. If you buy 10 kilos, you will get a discount of 2 rupees for both brown and white. The new stock is coming in two days, so we might want to wait to get the fresh supply. The vendor also gave his regards to you.” The younger brother replied.

“Thank you, my son. You may go now”, the teacher said.

The teacher took another sip of his tea, and looked at the older brother, and said.

“When you are given a task, always try to see what the big picture is. Try to understand how your seemingly little task aligns with the big task at hand.”

“Do not be a small person caring about only small things and your own small world. Be a big person caring about both small and big things.” The teacher continued finishing his tea.

THE END.

Soon after joining the work force, I came to the realization that I have to move in and out of the big and small picture perspectives. A task or a project sometimes seems to live on even after you are done with it, and it is generally intertwined with multiple other projects. Thus I learned to keep my mind at the task at hand, while keeping my eyes on the big picture.

To me, the younger brother also ensured to maintain a personal interaction with the rice vendor. This is also an important thing to keep in mind.

Always keep on learning, and be ready when you are next asked what the price of rice is.

Evolution of Hypothesis Testing

hypo

This is the second post in the series of “Let’s not hypothesize.” The first post is available here.

This post is written to have a brief look at how the Hypothesis testing seen in most Statistics texts came into being.

My main sources of information are;

1) The empire of Chance

2) The lady tasting tea, and

3) Explorations in statistics: hypothesis tests and P values

I have the evolution separated into three phases.

1) Pre-Fisher:

The Explorations in statistics: hypothesis tests and P values provides a date of 1279 as the origin of Hypothesis testing. The Royal Mint from London used a sample of coins made from each run of the mint which were compared against a known set of standards. I welcome the reader to click on the third reference given above to read this in more detail.

gosset

The article also speaks about William Sealy Gosset (Student) and his t-test method. What struck me most was the description of Gosset explaining the significance of a drug in terms of an odds ratio. This was well before the advent of p-values to determine significance of the data.

First let us see what is the probability that [drug A] will on the average give increase of sleep. [Looking up the ratio of the sample mean to the sample standard deviation] in the table for ten experiments we find by interpolating. . .the odds are .887 to .113 that the mean is positive. That is about 8 to 1 and would correspond to the normal curve to about 1.8 times the probable error. It is then very likely that [drug A] gives an increase of sleep, but would occasion no surprise if the results were reversed by further experiments.

2) Sir Ronald Fisher:

200px-R._A._Fischer

It was Sir Ronald Fisher who clearly came up with the idea of a null hypothesis (H0) and the use of a conditional probability p-value to make a decision based on the data found. He termed this as “Significance Testing”. The main distinction here from the texts today, is that Fisher only used Null or Nil Hypothesis. He did not find value in the alternate hypothesis. His thought process was that if the p-value was less than a cut-off point (let’s say .05), this would indicate that either this was due to a very rare event or that the null hypothesis model was wrong. More than likely, it is highly probable that the null hypothesis model was wrong. Fisher did not see a need for an alternate hypothesis nor the need for repeating tests to see how powerful the test was.His method is based on Inductive Inference.

Fisher never also meant to use only .05 as the cut-off value. He viewed p-values as inductive evidence against the null hypothesis.

If one in twenty does not seem high enough odds, we may, if we prefer it, draw the line at one in fifty (the 2 per cent. point), or one in a hundred (the 1 per cent. point). Personally, the writer prefers to set a low standard of significance at the 5 per cent. point, and ignore entirely all results which fail to reach this level. A scientific fact should be regarded as experimentally established only if a properly designed experiment rarely fails to give this level of significance.

3) Neyman-Pearson Hypothesis Testing:

Jerzy_Neyman2Pearson_Egon_3

The books “Lady tasting tea” and “The empire of chance” go into detail about the “feud” between the great minds Fisher, and Neyman/Pearson.

It was Neyman and Pearson who came up with idea of using an alternate hypothesis (H1) and testing it against the null hypothesis. Additionally, they also created the idea of the power of a test, and introduced the ideas of type I and type II errors. They termed their version as Hypothesis testing.Their version is based on inductive behavior.

They defined alpha, beta and power as follows.

alpha = P(reject H0|H0 is true)

beta = P(fail to reject H0|H0 is false)

power = 1 – beta

Where we are now:

What we use and learn these days is a combined method of Fisher and Neyman/Pearson. The textbook method is generally as follows;

1) define null and alternate hypotheses.

2) set an alpha value of .05, and power value of .80 before the experiment.

3) calculate test statistic and p-value based on the data collected.

4) Reject or retain (fail to reject) null hypothesis based on the p-value.

Critiques of this combined method claim that the combined method utilizes the worst of the two methods. They emphasize the focus on effect size, and the use of confidence intervals to provide better view of the problem at hand, rather than blindly relying on the p-value alone.

Keep on learning…