Big Data Management
iTWire | October 30, 2023
AVEVA, is a global leader in industrial software, driving digital transformation and sustainability, has launched AVEVA PI Data Infrastructure, a fully-integrated hybrid data solution providing easy scalability, centralised management, and the ability to share data collaboratively via the cloud.
AVEVA PI Data Infrastructure is the latest offering in the market leading AVEVA PI System portfolio, which helps companies collect, enrich, analyse and visualise operations data to achieve deeper insight and operational excellence. Moving to hybrid infrastructure gives industrial companies the flexibility, scalability and security needed to deliver valuable, high-fidelity data to authorised users and applications in any location. The initial release also gives customers the option to use the OpenID Connect protocol for user authentication, enabling enterprise-wide single sign on. Other enterprise-class data management features will be delivered over several releases.
AVEVA PI Data Infrastructure makes it easier for companies to collect and use real-time operations data in industrial environments that increasingly include sensor-enabled legacy systems, remote assets and IIoT devices. The hybrid architecture gives data access to more decision makers who rely on operations data to resolve problems and develop business insights, thereby reducing the total cost and effort of operations data management. By achieving seamless data sharing with any trusted collaborator, companies can overcome costly data silos, modernise and streamline user access and aggregate real-time and historical data for wider use and consumption. AVEVA PI Data Infrastructure is available via subscription using AVEVA Flex credits.
Harpreet Gulati, SVP - Head of PI System Business at AVEVA, said, No other industrial software company offers a fully-integrated, seamless data infrastructure that enables the fast, secure flow of real-time, high-fidelity data to anywhere it is needed – across multiple plants, at the edge, or in a trusted community over the cloud – with complete data integrity. We want to provide our customers with the flexibility to deploy across any of these areas, enabling them to increase sustainability, operating efficiency, asset reliability, and organisational agility.
Customers are embracing the new offering. Giovanna Ruggieri, Head of ICT at Italy’s EP Produzione, a subsidiary of the European energy giant, EPH, commented: "EP Produzione is actively pursuing digital transformation to maximise operational excellence and improve processes to support the business. To continue the journey, and better embrace the digital transformation, we need greater flexibility and integration at all levels, a data infrastructure that can give us full visibility across our multi-site operating environment that always keeps cyber security as high priority.
"We appreciate AVEVA PI Data Infrastructure’s aggregate tag subscription model because it allows us to better manage our current and future needs in a smart way, with AVEVA currently proposing, for us, one of the best solutions on the market."
Big Data Management
PR Newswire | October 26, 2023
Databricks, the Data and AI company, today announced it has agreed to acquire Arcion, a Databricks Ventures portfolio company that helps enterprises quickly and reliably replicate data across on-prem, cloud databases and data platforms. This will enable Databricks to provide native solutions to ingest data from various databases and SaaS applications into the Databricks Lakehouse Platform. The transaction is valued at over $100 million, inclusive of incentives.
Data Lakehouse Platforms have emerged as the de facto standard for enterprise data and AI platforms. However, these data platforms are only as valuable as the data in them. Ingesting data from existing databases and applications remains complicated, fragile, and costly. Troves of important data sit not only in transactional databases such as Oracle, MySQL, and Postgres, but also in SaaS applications such as Salesforce, SAP, and Workday. According to a recent MIT Technology Review Insights and Databricks survey of senior data and technology executives ("Laying the foundation for data- and AI-led growth"), businesses still suffer from many siloed systems; 34% have 10+ systems, and of the largest companies, more than 80% have 10+ systems to juggle.
This acquisition will enable Databricks to natively provide a scalable, easy-to-use, and cost-effective solution to ingest data from various enterprise data sources. Building on a scalable change data capture (CDC) engine, Arcion offers connectors for over 20 enterprise databases and data warehouses. The integration will simplify ingesting such data either continuously or on-demand into the lakehouse, fully integrated with the enterprise security, governance, and compliance capabilities of the Databricks platform.
To build analytical dashboards, data applications, and AI models, data needs to be replicated from the systems of record like CRM, ERP, and enterprise apps to the Lakehouse, said Ali Ghodsi, Co-Founder and CEO at Databricks. Arcion's highly reliable and easy-to-use solution will enable our customers to make that data available almost instantly for faster and more informed decision-making. Arcion will be a great asset to Databricks, and we are excited to welcome the team and work with them to further develop solutions to help our customers accelerate their data and AI journeys.
"Arcion's real-time, large-scale CDC data pipeline technology extends Databricks' market-leading ETL solution to include replication of operational data in real-time," said Gary Hagmueller, CEO of Arcion. "Databricks has been a great partner and investor in Arcion, and we are very excited to join forces to help companies simplify and accelerate their data and AI business momentum."
Business Wire | November 02, 2023
Airbyte, creators of the fastest-growing open-source data integration platform, today announced its "Powered by Airbyte" version that enables makers of software to embed over 100 integrations into their applications – accelerating their time-to-market while increasing the focus on their core product value.
“Powered by Airbyte” removes the time-consuming task of building data integrations from scratch. Instead, using Airbyte's extensive library of connectors enables rapid data movement and synchronization between various sources and destinations. This novel approach liberates engineering teams from the burdensome task of integration development, letting them redirect their resources to building out their product's features and capabilities.
Engineering teams shouldn't need to build everything themselves, said Michel Tricot, co-founder and CEO, Airbyte. They are wasting time on integration work when they don't need to do that. Now, their data movement and integration needs are covered with Powered by Airbyte so that they can re-focus their engineering time on their product's core value proposition.
Early users of Powered by Airbyte report high satisfaction and excellent results.
Cart.com is a fast-growing provider to 6,000 brands helping them get their products in the hands of their buyers. Last year, the company helped move over $5 billion in gross merchandise value with a total of 140 million product listings. Cart utilizes Powered by Airbyte in its Unified Analytics product that helps its merchant customers to predict demand, allocate inventory and adjust advertising spending by pulling in the merchant's data from sources such as Facebook, Google Ads, Google Analytics, Hubspot, Mailchimp, Shopify, and more. The data is then consolidated in Cart’s Snowflake data warehouse with all of the integration and data movement done with Powered by Airbyte. Cart is able to offer its merchants self-service to sign up for an account, connect their data sources, connect their integrations, and begin using the product on their own.
“With Airbyte, we don’t need to worry about connectors and focus on creating value for our users instead of building infrastructure. That’s priceless,” said Chase Zieman, chief data officer, Cart. “The time and energy saved allows us to disrupt and grow faster.”
Digital marketing firm, KORTX, delivers personalized experiences for clients and custom reporting built on BigQuery and Looker. That requires centralizing all of their clients’ data from Facebook Marketing, Google Ads, Google Analytics, Hubspot and more into BigQuery so it can be analyzed. Prior to using Powered by Airbyte, data was pulled manually and put into spreadsheets and, of course, clients did not have real-time access to the data.
“Without Airbyte’s ease-of-use and library of API connectors, we would have either had to lean heavily on valuable engineering resources to build out custom connections to power our custom reporting dashboard solutions or continue with time-consuming manual reporting,” said Jeff Isreal, director of analytics at KORTX.
Damon Henry, KORTX founder and CEO, said, “With Airbyte, our team of data engineers could easily develop new connectors or customize existing ones to meet our clients' needs. The platform’s resilience and reliability mean that we can now focus more on deriving insights and less on managing data pipelines. With Airbyte as our ally, KORTX is not just meeting but exceeding client expectations, ensuring that advertising campaigns are not just effective but are also backed by data that is as robust as it is reliable.”
Airbyte makes moving data easy and affordable across almost any source and destination, helping enterprises provide their users with access to the right data for analysis and decision-making. Airbyte has the largest data engineering contributor community – with more than 800 contributors – and the best tooling to build and maintain connectors.
Pricing for Powered by Airbyte is based primarily on the number of customers syncing data through Airbyte. This makes pricing easier to forecast and more predictable than alternative solutions. Additional pricing details, and a pricing estimator can be found here.
Airbyte is the open-source data movement leader running in the safety of your cloud and syncing data from applications, APIs, and databases to data warehouses, lakes, and other destinations. Airbyte offers four products: Airbyte Open Source, Airbyte Enterprise, Airbyte Cloud, and Powered by Airbyte. Airbyte was co-founded by Michel Tricot (former director of engineering and head of integrations at Liveramp and RideOS) and John Lafleur (serial entrepreneur of dev tools and B2B). The company is headquartered in San Francisco with a distributed team around the world. To learn more, visit airbyte.com.