07 Sep Big Data Algorithms: What They Are, Why They Matter, What You Can Do
Big Data Algorithms are one of the six most important disruptors affecting everyone and everything on the planet, interacting with each other in complex ways, for better and for worse. Algorithms are processes or sets of rules followed in calculations or other problem-solving operations, especially by computers. Algorithms gather data about everyone and everything, from every imaginable, interconnected source, and this data is now the global economy’s most valuable resource.
Looking for algorithms in action? Their ubiquity is no farther away than your next Google search; your tap upon a smartphone app; an attempt to beat your virtual opponent in a video game; calling out to Siri or Alexa for assistance; cranking up Pandora or Spotify while you exercise; noticing what shows up first in your Facebook feed; noting your home’s value on Zillow; scanning news headlines on your phone; navigating around those annoying pop-up ads; executing trades on your stocks or mutual funds; seeing show recommendations on Netflix, Amazon Prime, or Hulu; finding that perfect match on Plenty of Fish; getting driving directions; searching for a job or a job applicant; ordering Starbucks in advance; receiving Amazon recommendations; using your thumbprint, voice, or face to log-in to an account; and trading some Bitcoin.
According to the Pew Research Center, “everything people see and do on the web is a product of algorithms. Every time someone sorts a column in a spreadsheet, algorithms are at play, and most financial transactions today are accomplished by algorithms. Algorithms help gadgets respond to voice commands, recognize faces, sort photos and build and drive cars. Hacking, cyberattacks and cryptographic code-breaking exploit algorithms. Self-learning and self-programming algorithms are now emerging, so it is possible that in the future algorithms will write many if not most algorithms.”
Barry Chudakov, founder and principal at Sertain Research and StreamFuzion Corp., adds, “If every algorithm suddenly stopped working, it would be the end of the world as we know it.”
Algorithms are optimized through a subset of artificial intelligence called machine learning. Instead of repeatedly processing a stable set of instructions, systems based on machine learning rewrite themselves as they work. Through this power, algorithms have the potential to make sense of massive amounts of data and lead to breakthroughs in disease cures, financial services, health care coverage, crime solving, transportation, faster decision-making, efficiency, productivity, and even curbing climate change.
There are plenty of potential downsides as well. Pedro Domingo, author of The Master Algorithm, writes, “We have already turned our world over to machine learning and algorithms. The question now is, how to better understand and manage what we have done?”
There’s extensive documentation on the anxiety, alienation, depression, addiction, attention deficits, and relationship strains aided by excessive use of algorithm-drunk social media–not to mention the manipulation implemented by bad actors such as the Russians who spewed misinformation during the 2016 presidential election. Algorithms can make errors that lead to bias, discrimination, and miscarriages of justice such as accusing innocent people of a crime. More and more is known about each of us, and we know less and less about the knowers. And, yes, countless jobs have and will go away because algorithms can do them faster and sometimes better.
Given that no single governmental entity, company, or philanthropist has the ambition or bandwidth to ensure the algorithmic juggernaut produces more good than harm, it falls upon individuals to exert whatever influence we have in the face of Big Data disruption.
More specifically, as this learning community advocates, we need to learn and apply core skills that can help us be responsive and proactive rather than reactive and overwhelmed. Doing nothing is not an option, and in the bliss of ignorance problems only get worse.
In my work, I write, strategize, and coach about how to develop three core skills in particular–mindfulness, learning agility, and storytelling, and their corresponding habits. These are the skills that will help us thrive amid disruptive possibilities such as AI, Big Data Algorithms, and Biotechnology, and make wise, courageous choices in the face of Climate Change, Industrial Complexes, and the National Debt.
This is the practice of becoming more fully aware of what’s taking place within and around you, and responding with one or more aspects of loving-kindness, compassion, gratitude, emotional balance, and wisdom. Here’s a few mindfulness habits that can help you respond to the reality of algorithmic ubiquity:
- Get very clear on what and who you value the most, and then be deliberate about the personal information you put into the world and why.
- “De-clutter” your news feeds, friends’ updates, and so forth, so that you’re not constantly overwhelmed with information that may or may not align with your values and what you need the most right now.
- Embrace deliberate periods of silence; how else are you going to learn to turn down the algorithmic noise?
- Re-purpose your phone’s news feeds so you’re “fed” a regular stream of articles about algorithms. This will help you gain literacy on this topic across time.
- Admit that you know a lot less than you think about algorithms, and do your homework…because, if the earlier paragraphs in this blog said anything to you, they hopefully said that algorithms matter a hell of a lot. Period.
- Use Evernote, OneNote, or a similar note-taking app to store and organize what you’re learning about algorithms, for easy reference. I’ve been an Evernote fanatic for nearly a decade, and it’s saved me dozens of hours per month and amplified my ability to learn and speak to a topic.
- Determine your personal “story brand” (what you want to be known for), and disseminate information about yourself that aligns with that brand rather than works against it.
- Tap into the learning agility habits mentioned above to constantly gather information that increases your knowledge and skills around the people you’re trying to serve through your brand.
- Advocate and be an ally to those who seem to be victimized when algorithms get things wrong, such as those on the receiving end of bias, discrimination, and accusations. You can find these people by doing Google searches on the topics, and by spending time getting to know people who have less privilege than you do (typically, someone of a different gender, gender identity, race, religion, or socio-economic class). Whatever your story brand happens to be, you’ll be better off if words like “advocate,” “helper,” and “ally” are being said about you.