Big Data Management

Arcion Partners With Databricks for Real-Time Data Replication on the Lakehouse

Arcion
Arcion today announced a partnership to bring the world’s only cloud-native, CDC-based data replication platform to Databricks. Arcion is the first partner to offer preconfigured, validated data replication for users of Databricks through that company’s new Partner Connect program.

Arcion’s product enables faster, more agile analytics and AI/ML by empowering enterprises to integrate mission-critical transactional systems with their Databricks Lakehouse in real time, at scale, and with guaranteed transactional integrity. It is the only fully managed, distributed data replication as a service on the market today, offering zero-code, zero-maintenance change data capture (CDC) pipelines that can be deployed in just minutes. It empowers data teams to move high-volume data from transactional databases like Oracle and MySQL, without a single line of code.

Partner Connect makes it possible for customers to implement Arcion’s technology directly within their Databricks Lakehouse. With just a few clicks, Partner Connect automatically configures the resources necessary to begin using streaming data pipelines. Enable real-time data ingestion with powerful pipelines between Oracle, MySQL, and Snowflake (additional sources coming soon) to the Databricks Lakehouse.

“Through Partner Connect, Arcion and Databricks are deepening our thriving relationship and working together to deliver a unified experience for our customers that offers simplicity, security, rock-solid reliability, and scale. Companies across the globe are using ML and advanced analytics to turn raw data into tangible business value, but they need the right tools to help them get there. Arcion helps companies unify their data by delivering it to Databricks, where everything is available in one place, with zero delay.”

Arcion’s CEO Gary Hagmueller

Arcion Cloud uses CDC to identify and track changes to data in transactional systems, whether they are deployed on-premise, in the cloud, or across a hybrid landscape. Arcion detects any changes made within those systems and replicates them to Databricks in real time. Capable of handling petabyte-scale integration, Arcion handles high transaction volumes easily, without adversely impacting the source system’s performance.

“Arcion’s replication for Databricks’ Lakehouse provides extraordinarily rapid time to value for analytics and AI/ML,” said Adam Conway, SVP of Products at Databricks. “By making Arcion available via Partner Connect, we’re enabling thousands of Databricks customers to discover and take advantage of Arcion’s highly scalable, efficient and flexible CDC technology. With just a few clicks, users can set up a trial account and start streaming real-time data from transactional systems to their Lakehouse.”

About Arcion
Fortune 500 companies around the world rely on Arcion’s distributed, CDC-based data replication solution to drive fast and accurate data insights. Arcion helps enterprises eliminate slow, brittle data pipelines and high-maintenance overheads. Break down data silos through high-volume, scalable change data capture pipelines with guaranteed transactional integrity.

Spotlight

Other News
Big Data

Airbyte Racks Up Awards from InfoWorld, BigDATAwire, Built In; Builds Largest and Fastest-Growing User Community

Airbyte | January 30, 2024

Airbyte, creators of the leading open-source data movement infrastructure, today announced a series of accomplishments and awards reinforcing its standing as the largest and fastest-growing data movement community. With a focus on innovation, community engagement, and performance enhancement, Airbyte continues to revolutionize the way data is handled and processed across industries. “Airbyte proudly stands as the front-runner in the data movement landscape with the largest community of more than 5,000 daily users and over 125,000 deployments, with monthly data synchronizations of over 2 petabytes,” said Michel Tricot, co-founder and CEO, Airbyte. “This unparalleled growth is a testament to Airbyte's widespread adoption by users and the trust placed in its capabilities.” The Airbyte community has more than 800 code contributors and 12,000 stars on GitHub. Recently, the company held its second annual virtual conference called move(data), which attracted over 5,000 attendees. Airbyte was named an InfoWorld Technology of the Year Award finalist: Data Management – Integration (in October) for cutting-edge products that are changing how IT organizations work and how companies do business. And, at the start of this year, was named to the Built In 2024 Best Places To Work Award in San Francisco – Best Startups to Work For, recognizing the company's commitment to fostering a positive work environment, remote and flexible work opportunities, and programs for diversity, equity, and inclusion. Today, the company received the BigDATAwire Readers/Editors Choice Award – Big Data and AI Startup, which recognizes companies and products that have made a difference. Other key milestones in 2023 include the following. Availability of more than 350 data connectors, making Airbyte the platform with the most connectors in the industry. The company aims to increase that to 500 high-quality connectors supported by the end of this year. More than 2,000 custom connectors were created with the Airbyte No-Code Connector Builder, which enables data connectors to be made in minutes. Significant performance improvement with database replication speed increased by 10 times to support larger datasets. Added support for five vector databases, in addition to unstructured data sources, as the first company to build a bridge between data movement platforms and artificial intelligence (AI). Looking ahead, Airbyte will introduce data lakehouse destinations, as well as a new Publish feature to push data to API destinations. About Airbyte Airbyte is the open-source data movement infrastructure leader running in the safety of your cloud and syncing data from applications, APIs, and databases to data warehouses, lakes, and other destinations. Airbyte offers four products: Airbyte Open Source, Airbyte Self-Managed, Airbyte Cloud, and Powered by Airbyte. Airbyte was co-founded by Michel Tricot (former director of engineering and head of integrations at Liveramp and RideOS) and John Lafleur (serial entrepreneur of dev tools and B2B). The company is headquartered in San Francisco with a distributed team around the world. To learn more, visit airbyte.com.

Read More