Friday, March 27, 2020

Data analytics – made easy



Data analytics is the most current issue that is gripping the world in all what it does, what it does not do and what it ought to do - all about handling Data and Artificial Intelligence. Cloud computing, data analytics, data mining, AI and dash board are some of the “hot” areas expected to drive businesses, science and technology, social issues, climate change, international relations, trade, war and peace, space exploration and plain entertainment, among others, in this century. Most of us remain oblivious to the technical aspects of voluminous data storage, data mining, data analytics and AI and are interested only in the output – statistical or predictive.

The practice of data management has been in existence since earliest lifeforms inhabited this Earth. The most primitive data storage, brain, and processor intelligence are as old as it can get. For millions of years people stored information in a single place – their brain. Unfortunately, the human brain was found not large enough to store the data of, say, a village, a town, a ship, a Nation; various types of logs, registers and such records were invented to store large amount of data, outside the brain, for processing as required. Technology has leapfrogged and now we have all sorts of media where large amount of data can be stored and retrieved relatively easily.

The amount of data that can be stored in a brain varies from person to person, depending on immeasurable such as memory power and intelligence et al… In ants and bees, for instance, the resilience comes from the data/information needed to sustain them that is encoded in their genome. Unfortunately, man has to retrieve and process data from memory to coordinate his actions. This mandates a high quality and integrity of data stored in the brain. The quality and integrity of this data is important to get the correct output. Memories and accelerators like interests, passion, processes and motivators that lead to actions, all reside within the brain in the unconscious, subconscious or conscious state. The data in each of these layers is variously used during our routine activities and inactivity. The actions are initiated by a trigger, an external event. The quality of the output I dependent on the level on intelligence which resides in the uppermost layer, consciousness. Here too, the adage “Garbage in Garbage out” is relevant.

In the normal course, we do not bother to arrange our data storage for optimum use. We do not find time to do that. Often, we are forced to repair data of the storage devises attached to our computer. In the digital world, cloud computing has taken data analytics to a different level. We humans (animals) do not have the luxury of “Cloud” computing while still in this world. Our onboard computer (brain) also requires periodic maintenance. THIS is the opportunity of a life time to realign our brain, so to speak.

1.    Scan for viruses
2.    Repair bad sectors.
3.    Rearrange Data into appropriate “compartments” / sectors.
4.    Delete unwanted and corrupt data
5.    Zip your data to create more storage. Zipped data can be retrieved on as required basis, using immediate triggers – like using old acquaintances for recalling events when you meet them

I have found simple ways to store and handle data in my brain (physically everyone has one). Some rules:

1.    Use firewalls to protect contamination of data: for eg. Do not discuss matters on Social media…use the platform only for communication and entertainment.
2.    Avoid listening to prime-time TV; they are known to carry very damaging viruses
3.    Put in checks to validate data received before adding to storage.
4.    Use codes to retrieve and process data – e.g. My code when I step out of the house is 5: car keys, wallet, phone, sun glasses, house keys. As I step out, I count from 1 to 5. Storing and processing numbers is easier, occupies less space and more efficient than processing letters and strings.

The list is not exhaustive; you may add more ways…