Big Data Management
PR Newswire | October 26, 2023
Databricks, the Data and AI company, today announced it has agreed to acquire Arcion, a Databricks Ventures portfolio company that helps enterprises quickly and reliably replicate data across on-prem, cloud databases and data platforms. This will enable Databricks to provide native solutions to ingest data from various databases and SaaS applications into the Databricks Lakehouse Platform. The transaction is valued at over $100 million, inclusive of incentives.
Data Lakehouse Platforms have emerged as the de facto standard for enterprise data and AI platforms. However, these data platforms are only as valuable as the data in them. Ingesting data from existing databases and applications remains complicated, fragile, and costly. Troves of important data sit not only in transactional databases such as Oracle, MySQL, and Postgres, but also in SaaS applications such as Salesforce, SAP, and Workday. According to a recent MIT Technology Review Insights and Databricks survey of senior data and technology executives ("Laying the foundation for data- and AI-led growth"), businesses still suffer from many siloed systems; 34% have 10+ systems, and of the largest companies, more than 80% have 10+ systems to juggle.
This acquisition will enable Databricks to natively provide a scalable, easy-to-use, and cost-effective solution to ingest data from various enterprise data sources. Building on a scalable change data capture (CDC) engine, Arcion offers connectors for over 20 enterprise databases and data warehouses. The integration will simplify ingesting such data either continuously or on-demand into the lakehouse, fully integrated with the enterprise security, governance, and compliance capabilities of the Databricks platform.
To build analytical dashboards, data applications, and AI models, data needs to be replicated from the systems of record like CRM, ERP, and enterprise apps to the Lakehouse, said Ali Ghodsi, Co-Founder and CEO at Databricks. Arcion's highly reliable and easy-to-use solution will enable our customers to make that data available almost instantly for faster and more informed decision-making. Arcion will be a great asset to Databricks, and we are excited to welcome the team and work with them to further develop solutions to help our customers accelerate their data and AI journeys.
"Arcion's real-time, large-scale CDC data pipeline technology extends Databricks' market-leading ETL solution to include replication of operational data in real-time," said Gary Hagmueller, CEO of Arcion. "Databricks has been a great partner and investor in Arcion, and we are very excited to join forces to help companies simplify and accelerate their data and AI business momentum."
Big Data Management
Bloomberg | November 06, 2023
Bloomberg and Google Cloud integrate Data License Plus (DL+) with BigQuery for efficient data access and analytics.
Customers can access fully modeled data within BigQuery, eliminating data preparation time.
Mackenzie Investments adopts DL+ ESG Manager to host the acquisition, management, and publishing of Multi-vendor ESG data.
Bloomberg has unveiled a new offering designed to accelerate the data strategies of Google Cloud customers by integrating Bloomberg's cloud-based data management solution, Data License Plus (DL+), with Google Cloud's fully managed, serverless data warehouse, BigQuery.
Now, with access to Bloomberg's extensive experience modeling, managing, and delivering vast quantities of complex content, mutual customers can receive their Bloomberg Data License (DL) data, entirely modeled and seamlessly combined within BigQuery. As a result, organizations can leverage the advanced analytics capabilities of Google Cloud to extract more value from critical business information quickly and efficiently with minimal data wrangling.
Through this extended collaboration, customers can harness the powerful analytics features of BigQuery and tap into Bloomberg's extensive collection of datasets available through Data License to power their most essential workloads. Bloomberg's Data License content offers a wide variety, including reference, pricing, ESG, regulatory, estimates, fundamentals, and historical data, supporting operational, quantitative, and investment research workflows, covering over 70 million securities and 40,000 data fields.
Key benefits include:
Direct Access to Bloomberg Data in BigQuery: Bloomberg customers can seamlessly access Bloomberg Data License content within BigQuery, allowing for scalable use across their organization. This eliminates the time-consuming tasks of ingesting and structuring third-party datasets, thereby accelerating the time-to-value for analytics projects.
Elimination of Data Barriers: Google Cloud and Bloomberg will make Bloomberg's DL+ solution available to mutual customers via BigQuery. This allows for the delivery of fully modeled Bloomberg data and multi-vendor ESG content within their analytics workloads.
In a recent announcement, Bloomberg revealed that Mackenzie Investments has selected DL+ ESG Manager to host the acquisition, management, and publishing of multi-vendor ESG data. This move positions Mackenzie Investments to implement ESG investing strategies more efficiently and develop sophisticated ESG-focused insights and investment products, with BigQuery playing a central role in powering these analytics workloads moving forward.
Don Huff, the Global Head of Client Services and Operations at Bloomberg Data Management Services, stated that as capital markets firms are in the process of migrating their workloads to the Cloud, their customers require efficient access to high-quality data in a preferred environment. He expressed excitement about extending their partnership with Google Cloud, aiming to stay at the forefront of innovation in financial data management and to enhance their customers' enterprise analytics capabilities.
Stephen Orban, the VP of Migrations, ISVs, and Marketplace at Google Cloud, stated that Google Cloud and Bloomberg share a common commitment to empowering customers making data-driven decisions to power their businesses. He mentioned that the expanded alliance between the two companies would allow customers to effortlessly integrate Bloomberg's leading datasets with their own data within BigQuery. This would simplify the process of conducting analytics with valuable insights related to financial markets, regulations, ESG, and other critical business information.
Business Wire | November 02, 2023
Airbyte, creators of the fastest-growing open-source data integration platform, today announced its "Powered by Airbyte" version that enables makers of software to embed over 100 integrations into their applications – accelerating their time-to-market while increasing the focus on their core product value.
“Powered by Airbyte” removes the time-consuming task of building data integrations from scratch. Instead, using Airbyte's extensive library of connectors enables rapid data movement and synchronization between various sources and destinations. This novel approach liberates engineering teams from the burdensome task of integration development, letting them redirect their resources to building out their product's features and capabilities.
Engineering teams shouldn't need to build everything themselves, said Michel Tricot, co-founder and CEO, Airbyte. They are wasting time on integration work when they don't need to do that. Now, their data movement and integration needs are covered with Powered by Airbyte so that they can re-focus their engineering time on their product's core value proposition.
Early users of Powered by Airbyte report high satisfaction and excellent results.
Cart.com is a fast-growing provider to 6,000 brands helping them get their products in the hands of their buyers. Last year, the company helped move over $5 billion in gross merchandise value with a total of 140 million product listings. Cart utilizes Powered by Airbyte in its Unified Analytics product that helps its merchant customers to predict demand, allocate inventory and adjust advertising spending by pulling in the merchant's data from sources such as Facebook, Google Ads, Google Analytics, Hubspot, Mailchimp, Shopify, and more. The data is then consolidated in Cart’s Snowflake data warehouse with all of the integration and data movement done with Powered by Airbyte. Cart is able to offer its merchants self-service to sign up for an account, connect their data sources, connect their integrations, and begin using the product on their own.
“With Airbyte, we don’t need to worry about connectors and focus on creating value for our users instead of building infrastructure. That’s priceless,” said Chase Zieman, chief data officer, Cart. “The time and energy saved allows us to disrupt and grow faster.”
Digital marketing firm, KORTX, delivers personalized experiences for clients and custom reporting built on BigQuery and Looker. That requires centralizing all of their clients’ data from Facebook Marketing, Google Ads, Google Analytics, Hubspot and more into BigQuery so it can be analyzed. Prior to using Powered by Airbyte, data was pulled manually and put into spreadsheets and, of course, clients did not have real-time access to the data.
“Without Airbyte’s ease-of-use and library of API connectors, we would have either had to lean heavily on valuable engineering resources to build out custom connections to power our custom reporting dashboard solutions or continue with time-consuming manual reporting,” said Jeff Isreal, director of analytics at KORTX.
Damon Henry, KORTX founder and CEO, said, “With Airbyte, our team of data engineers could easily develop new connectors or customize existing ones to meet our clients' needs. The platform’s resilience and reliability mean that we can now focus more on deriving insights and less on managing data pipelines. With Airbyte as our ally, KORTX is not just meeting but exceeding client expectations, ensuring that advertising campaigns are not just effective but are also backed by data that is as robust as it is reliable.”
Airbyte makes moving data easy and affordable across almost any source and destination, helping enterprises provide their users with access to the right data for analysis and decision-making. Airbyte has the largest data engineering contributor community – with more than 800 contributors – and the best tooling to build and maintain connectors.
Pricing for Powered by Airbyte is based primarily on the number of customers syncing data through Airbyte. This makes pricing easier to forecast and more predictable than alternative solutions. Additional pricing details, and a pricing estimator can be found here.
Airbyte is the open-source data movement leader running in the safety of your cloud and syncing data from applications, APIs, and databases to data warehouses, lakes, and other destinations. Airbyte offers four products: Airbyte Open Source, Airbyte Enterprise, Airbyte Cloud, and Powered by Airbyte. Airbyte was co-founded by Michel Tricot (former director of engineering and head of integrations at Liveramp and RideOS) and John Lafleur (serial entrepreneur of dev tools and B2B). The company is headquartered in San Francisco with a distributed team around the world. To learn more, visit airbyte.com.