IT and data leaders are constantly challenged to keep up with new trends in emerging and disruptive technologies, and to determine how each can best aid the organization. In the midst of all the changes going on in 2019, it gets increasingly hard to know where to invest in all this new technology.
To help add clarity, here are my thoughts on some of the most important trends that will shape data management and software development for the next couple of years.
The business multi-verse expands through multi-cloud as data inefficiencies are solved: Multi-cloud promises tremendous reward if it can be used properly, but data inefficiencies and complicated compliance policies hinder progress for many.
AI / machine learning / ML trust/ethics/bias
Questions around data morality will slow innovation in artificial intelligence and machine learning: Last year saw the hype around AI/ML explode, and data ethics, trust, bias and fairness have all surfaced to combat inequalities in the process to make everything intelligent.
The black box of algorithms becomes less opaque: Part of the issue with data morality with AI and machine learning is that numbers and scenarios are crunched without insight into subsequent answers came to be. Even researchers can have a hard time sorting it out after the fact.
GDPR / CA consumer privacy laws / Data privacy
The “G” in GDPR will soon stand for “Global”: Data privacy regulations are going to become more widespread. For example, California, Japan and China are already working on their own regulations to adopt rules similar to the EU’s GDPR.
As privacy regulations spread, organizations will mistake data governance for data harassment: Based on what consumers do online, companies are able to determine, through their data, their demographics, interests and even what’s going on in their personal lives. This results in marketing so hyper targeted, it could feel like harassment.
Data skills / Data as a team sport
The data skills gap will increase – but so will data literacy: Data is both the problem and the answer for businesses. It’s a problem because businesses manage to collect more data than they know how to use, yet it’s the answer because it can predict forecasts and offer insight into how the business should run.
Serverless and open source
Serverless will create new application ecosystems where startups can thrive off the low-cost architecture and creatively solve deployment challenges.
Expect to see businesses double down on open source technologies — more investments and deals will get done, and open source communities will also pour more effort and energy into projects after having seen the opportunity for open source in the marketplace.