The Data-Information Hierarchy, Part 1

I often come across discussions in the tech world that revolve around the data → information → knowledge → understanding → wisdom framework. Interestingly, many discussions tend to overlook or omit the step of "understanding," sometimes even disregarding both data and wisdom. However, it's essential to recognize that all five stages are integral when transitioning from complete oblivion to becoming a truly productive member of the tech community, driving progress forward. In simpler terms, it's a step-by-step process that we must embrace.

"The first sign of wisdom is to get wisdom; go, give all you have to get true knowledge." (www.basicenglishbible.com/proverbs/4.htm) This central and key verse in proverbs rings true today. Wisdom is the objective, but the progression to wisdom must begin with assimilating the data and information into knowledge. And from knowledge comes understanding, from understanding comes wisdom.

In keeping with the philosophical / religious examination of knowledge and wisdom, www.letgodbetrue.com/proverbs/04_07.htm explains it as:

"Wisdom is the principal thing - the most important matter in life. Wisdom is the power of right judgment - the ability to choose the correct solution for any situation. It is knowing how to think, speak, and act to please both God and men. It is the basis for victorious living. Without wisdom, individuals make choices that lead to pain, poverty, trouble, and even death. However, with wisdom, individuals make choices that bring them health, peace, prosperity, and life."

Understanding is closely linked to wisdom and holds significant value on its own. Understanding is the power of discernment, allowing us to see beyond surface appearances and recognize inherent strengths or weaknesses in a thing. Without understanding, individuals are easily deceived and led astray, left confused and perplexed. However, with understanding, one can perceive what others might miss, avoiding the pitfalls and traps of alluring temptations. With understanding, life's complexities become more manageable.

While this biblical foundation is profound, the world of technology and business demands the application of all five stages. As Cliff Stoll succinctly put it, "Data is not information, Information is not knowledge, Knowledge is not understanding, Understanding is not wisdom." Data is sought after, information is desired, but wisdom is the ultimate objective.

"We collect and organize data to achieve information; we process information to absorb knowledge; we utilize the knowledge to gain understanding; and we apply understanding to achieve wisdom." (Mark Reynolds)

Russell Ackoff provides a comprehensive breakdown of the five stages:

Data: symbols
Information: data that are processed to be useful; provides answers to "who", "what", "where", and "when" questions
Knowledge: application of data and information; answers "how" questions
Understanding: appreciation of "why"
Wisdom: evaluated understanding.

Data, by itself, cannot be comprehended by humans; it's merely individual units of substance, neither understandable nor desirable.

Information represents the recognizable and cognitive presentation of data. Excel charts, for instance, are popular because they facilitate data manipulation while conveying information. Information is processable by humans but remains a historical concept.

Knowledge entails the appropriate collection of information, with the intention of being useful. It's a deterministic process that demands genuine cognitive and analytical abilities, which are fully encompassed in the next stage: understanding. In the realm of technology, many applications, such as modeling and simulation, rely on some form of stored knowledge.

Understanding is an interpolative and probabilistic process, requiring cognitive and analytical faculties. It's the process through which we take existing knowledge and synthesize new insights. The distinction between understanding and knowledge is akin to the difference between "learning" and "memorizing."

Wisdom stands out as the only forward-looking, future-based aspect of the five stages. Systems engineering courses often have wisdom as their underlying foundation, whether explicitly acknowledged or not. An alternative definition of systems engineering could be the pursuit of putting knowledge and understanding to practical use. Thus, a substantial portion of systems engineering coursework involves teaching the acquisition of knowledge and understanding while encouraging students to explore the deeper meanings and functions.

Neil Fleming observes: (www.vark-learn.com/english/page.asp?p=biography)

A collection of data is not information.
A collection of information is not knowledge.
A collection of knowledge is not wisdom.
A collection of wisdom is not truth.

Ultimately, the questions of where we come from, what we're doing here, and where we're going may seem philosophical, but they form the foundation of the data, information, knowledge, understanding, wisdom tree. And once the pinnacle of wisdom is reached in any field, the question of where we're going is effectively answered. In the world of technology, embracing this holistic journey is crucial to becoming a true technologist who propels our field forward.

The Data-Information Hierarchy, Part 2
The Data-Information Hierarchy, Part 3