Are you working in data engineering but tired of all the jargon and acronyms? Say no more, here is a list of 50 to get you started! — The world of Data Engineering has evolved significantly over the past decade. From a once humble data warehousing set-up to an entire discipline. This includes everything from data pipelines to building data lakes. The popularity of this field has increased, as has the jargon.

Advances in AI Will Continue to Disrupt the Modern Data Stack. — Large Language Models (LLM) have been all the rage lately, with the introduction of OpenAI’s ChatGPT. The majority of the 100m+ plus users are using Chat/Text Completions to make their daily lives easier. However, a little-known API provided by OpenAI called Embeddings is truly transformational in how we do search…

Too much data and not enough governance — let’s change that — Active Metadata is the key to unlocking the full potential of your data governance efforts. Big Data seems like an old term — and it has not stopped increasing in volume. Old methods are not good enough to handle this exponential growth. One method is using Metadata to drive critical…

Enhancing Data Governance Is the Top Most Priority for Organisations — Data Observability is all the rage in the industry right now. Vast amounts of data and endless Data Quality issues have led us to this stage. Gartner sees it in the "innovation trigger" phase and has at least 5–10 years' worth of growth left before it plateaus. …

5 Ways Data Marketplaces are Changing the Game with their Dynamic Impact — Data Marketplace is a modern Bazaar. It’s a way organisations can consolidate and share data internally and externally. Over the years, billions have been spent on modernising the legacy data stack. However, the self-serve data dream continues to be out-paced by large budget over-spend and poor data transformation. There are…

Level up Your Data Game by Mastering These 4 Skills — A colleague recently asked how they can level up their data skills this year. Data skills can come in many forms. From Data Engineering, Analysis to Data Science & Visualisation. However, they all have a common goal: to drive business value. …

Modernise Your Data Quality Framework by Including These Changes — Data Quality (DQ) continues to be a big challenge for many organisations, especially those trying to modernise their data stack. Years of underinvestment in data programmes are now costing companies nail-biting millions of pounds in regulatory fines. But that’s the stick — what is the carrot? How can you convince…

In a rush for the modern data stack, don’t forget about legacy — I have read and written many Modern Data Stack (MDS) articles, and I am so glad that, as an industry, we are taking the challenge of Big Data with its even bigger problems head-on. …

Core Lessons That Will Ultimately Help You in Your Learning Journey — At the start of any new project/venture, you should reflect on the past and the lessons learned. Having delivered multiple complex data warehouses, data lakes and analytics projects, I learned a thing or two about what to do and what to avoid. The key to any successful project is the…