Dell EMC Streaming Data Platform Enables Insights for Streaming Data from the Edge

Streaming Data Creates Massive Potential for Organizations Across Industries

According to IDC, more than a quarter of data created in the global datasphere will be real-time in nature by 2025. Much of that data will come from the edge, originate from sensors, cameras and drones, and come in the form of a continuous data stream.

Streaming data creates additional complexities in the already intricate world of unstructured data. With its tendency to vary in volume and boundaries and with timestamps that can fluctuate out of order, the need for a Data First infrastructure – where organizations know exactly where their data is and how to harness its full potential – becomes more critical than ever. While this type of data has the potential to drive significant innovation within an organization, it also presents those that work closely with enterprise infrastructures with a host of challenges. These challenges can include managing multiple infrastructures, dealing with data inconsistency risks and creating a time-consuming process for application developers.

Imagine providing your developers and operators with a platform purpose-built for them to ingest, analyze, and manage streaming data. Imagine monitoring anomalies in a manufacturing line, an energy field or railroad tracks through sensors – abnormalities of livestock, airplanes and shipping containers tracked through drone video feed – or the ability to adjust traffic lights depending on volume or detect security threats through video streams. These are just a few of the possibilities when an organization creates a Data First infrastructure focused on a proper streaming data foundation.

Capture the Streaming Opportunity with Dell EMC Streaming Data Platform

To help customers turn this unique set of infrastructure challenges into opportunities for deeper business insights, Dell Technologies is introducing the Dell EMC Streaming Data Platform. This all new software offering enables ingestion and analytics of real-time streaming edge data in the data center.

With the release of this enterprise-ready platform, organizations now have access to a single solution for all their data (whether streaming or not) that provides auto-scaling ingestion, tiered storage with historical recall on-demand and unified analytics for both real-time and historical business insights.

Re-Designing Complicated Infrastructures with an Out-of-the-Box Solution

As many organizations have begun to address the rise in streaming data by creating additional infrastructure solutions, they have inadvertently created duplicate data silos along the way that each require individual implementation, management, security and analysis. The Streaming Data Platform unifies those infrastructures into one out-of-the-box solution to streamline data and its management for actionable insights.

The software platform provides enterprise-grade security and serviceability and is built on open-source technologies such as Kubernetes for orchestration, Apache Flink for real-time and historical query processing and Pravega for ingestion and publish-subscribe. The Streaming Data Platform empowers innovation far into the future – creating a programming model that reduces application development time, giving your team more time to focus on innovation and the next level of business needs.

Improving Workflows and Outcomes Enterprise-Wide

As a platform that enables insights to drive innovation, the Streaming Data Platform enables a wealth of opportunities to endless industries – from retail, to agriculture, to automotive and the energy sector. Example uses of this technology include the real-time & historical analysis of video and telemetry streams to monitor livestock health or manage planning of large construction projects. One customer, RWTH Aachen University in Aachen, Germany, creates research projects for nearby small businesses – allowing them to reap the rewards of research that creates more efficiency, deeper insights and frees up time to enable innovation in use cases like the manufacturing example above. “The reduction of management needed to operate the software system and [Streaming Data Platform] stack is crucial … to ease the work of developers and minimize hard DevOps skill requirements,” said Philipp Niemietz, Head of Digital Technologies Research Group at RWTH.

Addressing the Streaming Data Challenge

When one thinks of enterprise storage, file and object are likely the first categories that come to mind. But with the rise of real-time data, it’s clear that in the years to come, storage solutions for streaming data will become a critical need in the enterprise.