The data landscape experienced significant changes in 2023, presenting new opportunities (and potential challenges) for data engineering teams. I believe we will see the following this year in the ...

Access to more information does not necessarily lead to better decision making, according to a new study from Oracle. Though 83% of those surveyed agree that access to more data should make decisions ...

First, we’ll define and demystify these terms. Second, I’ll share some key business use cases that cannot be solved with traditional relational data catalogs. Finally, I’ll wrap it up by getting ...

As we creep further into 2022, it bears remembering how still less than a decade ago, the enterprise consumer market looked upon data solutions – mostly, data warehousing – as an unavoidable fixture ...

Earlier this month, Python moved into the number one slot in the TIOBE Index, marking the first time in 20 years that a language named C or Java wasn’t at the top of the list. It’s a nice feather in ...

One of the hottest areas of big data at the moment is log monitoring and its adjacent disciplines, AIOps and cloud observability. The market, which some estimate is worth $17 billion per year, is in ...

Data scientists spend about 45% of their time on data preparation tasks, including loading and cleaning data, according to a survey of data scientists conducted by Anaconda. The company also analyzed ...

In this age of information, to say that the volume of data is exploding is a stark understatement. This big bang of big data is estimated to grow from 33 zettabytes in 2018 to 175 zettabytes by 2025, ...

With just over a week left on the 2019 calendar, it’s now time for predictions. We’ll run several stories featuring the 2020 predictions of industry experts and observers in the field. It all starts ...

Lyft was a late entrant to the ride-sharing business model, at least compared to its competitor Uber, which pioneered the concept and remains the largest provider. That delay in starting out actually ...

The data we have now is huge. But size, it turns out, is a relative thing. And according to the IDC, the sum of the world’s data – the DataSphere — will grow from 33 zettabytes in 2018 to a ...

In fact, storing data in Hadoop using those raw formats is terribly inefficient. Plus, those file formats cannot be stored in a parallel manner. Since you’re using Hadoop in the first place, it’s ...