IDC Report: Calming the Storm with Cloud Native Data Integration

Issue link:

Contents of this Issue


Page 2 of 6

Page 3 #US47518521 IDC TECHNOLOGY SPOTLIGHT Calming the Storm with Cloud-Native Data Integration Cloud-native technologies can leverage the scale and performance benefits of the cloud at all levels of processing. In the case of data integration, this ranges from extraction to ingestion and transformation. The result is efficient use of infrastructure, higher performance that shortens processing time, reduced data latency issues, and faster time to value. Cloud-native efficiency and elasticity also offer opportunities for cost optimization during peaks and valleys of data volumes because cloud-native technologies can provide consumption-based pricing models. In addition to performance gains and cost optimization, open APIs are standard in cloud-native services, providing opportunities for better interoperability within and across cloud ecosystems, which can be very beneficial for a data integration solution that needs to traverse hybrid and multicloud environments and utilize the cloud-native capabilities of target data repositories. Cloud-native data integration is also well positioned to help organizations deal with the growing number of SaaS data silos across their environments via accessible and open cloud APIs. Many organizations are adopting a discipline of DataOps where the ability to iterate and to fail fast are core tenets. DataOps is not DevOps for data; rather, it is a combination of technologies and methods with a focus on quality for consistent and continuous delivery of data value, shortening the time to value of data analytics, data science, and machine learning pipelines. Organizations that have deployed DataOps practices have reported a 49% reduction in the number of late-delivery incidents, according to IDC's DataOps Survey. Cloud-native solutions not only support iterative and agile approaches to data integration but also, more importantly, provide an opportunity to fail and recover fast. Security once topped the list of reasons that organizations gave for not migrating to the cloud, citing fears that data would be exposed to competitors and/or criminals. However, as cloud-native security has improved, many organizations have discovered cloud services are more secure than what is in their datacenters. In fact, according to a 2021 IDC survey of 406 data-native workers on the topic of cloud data migration, "improved security" was the most-cited benefit of cloud databases after "higher availability." The network perimeter has long since disappeared, and securing data at the edge, through network access and operating system controls, is increasingly ineffective. Securing data in motion and at rest where it resides in the cloud is another benefit of cloud-native data integration technology that can leverage cloud-native security capabilities. Cloud-Native Data Integration Trends As companies transform to compete better in the digital economy, cloud is part of their transformation journey. As business applications have moved to the cloud, so too have application databases. What is good for transactional systems is also good for analytical systems, and as a result, analytical databases, data lakes, and data warehouses are also moving to the cloud. A 2021 IDC survey of 406 database professionals in North America indicated that 63% of organizations are actively migrating data to the cloud and another 29% are planning to start migration within three years, leaving only 8% still considering migration (see Figure 2). As stated previously, the global pandemic has had an impact: 68% of respondents in this survey indicated an acceleration of their cloud database migration plans, and only 10% had decreased cloud migration momentum.

Articles in this issue

view archives of Reports - IDC Report: Calming the Storm with Cloud Native Data Integration