Big Data Management
iTWire | October 30, 2023
AVEVA, is a global leader in industrial software, driving digital transformation and sustainability, has launched AVEVA PI Data Infrastructure, a fully-integrated hybrid data solution providing easy scalability, centralised management, and the ability to share data collaboratively via the cloud.
AVEVA PI Data Infrastructure is the latest offering in the market leading AVEVA PI System portfolio, which helps companies collect, enrich, analyse and visualise operations data to achieve deeper insight and operational excellence. Moving to hybrid infrastructure gives industrial companies the flexibility, scalability and security needed to deliver valuable, high-fidelity data to authorised users and applications in any location. The initial release also gives customers the option to use the OpenID Connect protocol for user authentication, enabling enterprise-wide single sign on. Other enterprise-class data management features will be delivered over several releases.
AVEVA PI Data Infrastructure makes it easier for companies to collect and use real-time operations data in industrial environments that increasingly include sensor-enabled legacy systems, remote assets and IIoT devices. The hybrid architecture gives data access to more decision makers who rely on operations data to resolve problems and develop business insights, thereby reducing the total cost and effort of operations data management. By achieving seamless data sharing with any trusted collaborator, companies can overcome costly data silos, modernise and streamline user access and aggregate real-time and historical data for wider use and consumption. AVEVA PI Data Infrastructure is available via subscription using AVEVA Flex credits.
Harpreet Gulati, SVP - Head of PI System Business at AVEVA, said, No other industrial software company offers a fully-integrated, seamless data infrastructure that enables the fast, secure flow of real-time, high-fidelity data to anywhere it is needed – across multiple plants, at the edge, or in a trusted community over the cloud – with complete data integrity. We want to provide our customers with the flexibility to deploy across any of these areas, enabling them to increase sustainability, operating efficiency, asset reliability, and organisational agility.
Customers are embracing the new offering. Giovanna Ruggieri, Head of ICT at Italy’s EP Produzione, a subsidiary of the European energy giant, EPH, commented: "EP Produzione is actively pursuing digital transformation to maximise operational excellence and improve processes to support the business. To continue the journey, and better embrace the digital transformation, we need greater flexibility and integration at all levels, a data infrastructure that can give us full visibility across our multi-site operating environment that always keeps cyber security as high priority.
"We appreciate AVEVA PI Data Infrastructure’s aggregate tag subscription model because it allows us to better manage our current and future needs in a smart way, with AVEVA currently proposing, for us, one of the best solutions on the market."
Cision | October 27, 2023
Neo4j, the world's leading graph database and analytics company, announced major new capabilities enabling cloud or self managed customers to increase analytical queries by up to 100x faster, run both transactional and analytical processing within one database, and automatically track data changes in real time for faster mission-critical decision making.
Neo4j's integration of operational and analytical workloads within a single database is now enhanced by the power of parallel runtime and change data capture, empowering our customers with real-time insights, cost-efficient data management, and simplified architecture, said Sudhir Hasbe, Chief Product Officer, Neo4j. The results foster quicker decision-making, superior customer experiences, and a competitive edge in the market at a magnitude of speed, performance and agility that is far greater than ever before.
New capabilities and benefits include:
Up to 100X faster performance of analytical queries via Parallel Runtime capability, which adds concurrent threads across multiple CPU cores to run analytical graph queries. Neo4j also leverages a technique called morsel-based parallelism to optimize this capability, for greater scalability, better resource utilization, and seamless multitasking.
Faster mission-critical decisions now enabled by native Change Data Capture (CDC), which automates the real-time tracking and notification of data changes in the database. CDC is also integrated with Neo4j Connector for Kafka and Confluent, which streams these changes for easier consumption across other data platforms and applications.
Easier Knowledge Graph creation via new embedding models that predict and find missing relationships and infer new connections within an organization's knowledge graph for greater semantic understanding.
New pathfinding algorithms that make complex workflows more efficient by identifying the best sequence and critical paths between nodes on a graph.
"Neo4j's Change Data Capture capability enables us to synchronize the latest changes happening in our customers' various data sources simultaneously – and helps us guarantee that when they use Dropbox Dash, they can search and find their content accurately," said Anil Masakal, Engineering Leader, Dropbox.
"Neo4j's new capabilities enable modern law enforcement agencies to react with greater agility to mission-critical events, empowering them to fight more crimes and solve them faster," said Christophe Willemsen, CTO, GraphAware. "For example, we can trigger alerts and send them to front-line officers when the phone number of a Person of Interest pings from a cellular tower near a high-risk event where a VIP is present, bodycam footage shows the image of a child at risk, and other events."
These advancements follow a series of milestones for Neo4j. The company recently integrated native vector search into its core database capabilities, enabling more accurate, explainable, and transparent outcomes for LLMs and other generative AI applications. It earlier won Google Cloud's 2023 Technology Partner of the Year award in the data management category, and placement in CRN's 2023 Big Data 100. Neo4j was recognized for the first time in the 2022 Gartner Magic Quadrant for Cloud Database Management Systems, the first time that any native graph vendor was included in the report.
Neo4j, the Graph Database & Analytics leader, helps organizations find hidden relationships and patterns across billions of data connections deeply, easily, and quickly. Customers leverage the structure of their connected data to reveal new ways of solving their most pressing business problems, from fraud detection, customer 360, knowledge graphs, supply chain, personalization, IoT, network management, and more – even as their data grows. Neo4j's full graph stack delivers powerful native graph storage with native vector search capability, data science, advanced analytics, and visualization, with enterprise-grade security controls, scalable architecture, and ACID compliance. Neo4j's community of data leaders comprises a vibrant, open-source community of more than 250,000 developers, data scientists, and architects across hundreds of Fortune 500 companies, government agencies, and NGOs. Visit neo4j.com
Business Wire | November 02, 2023
Airbyte, creators of the fastest-growing open-source data integration platform, today announced its "Powered by Airbyte" version that enables makers of software to embed over 100 integrations into their applications – accelerating their time-to-market while increasing the focus on their core product value.
“Powered by Airbyte” removes the time-consuming task of building data integrations from scratch. Instead, using Airbyte's extensive library of connectors enables rapid data movement and synchronization between various sources and destinations. This novel approach liberates engineering teams from the burdensome task of integration development, letting them redirect their resources to building out their product's features and capabilities.
Engineering teams shouldn't need to build everything themselves, said Michel Tricot, co-founder and CEO, Airbyte. They are wasting time on integration work when they don't need to do that. Now, their data movement and integration needs are covered with Powered by Airbyte so that they can re-focus their engineering time on their product's core value proposition.
Early users of Powered by Airbyte report high satisfaction and excellent results.
Cart.com is a fast-growing provider to 6,000 brands helping them get their products in the hands of their buyers. Last year, the company helped move over $5 billion in gross merchandise value with a total of 140 million product listings. Cart utilizes Powered by Airbyte in its Unified Analytics product that helps its merchant customers to predict demand, allocate inventory and adjust advertising spending by pulling in the merchant's data from sources such as Facebook, Google Ads, Google Analytics, Hubspot, Mailchimp, Shopify, and more. The data is then consolidated in Cart’s Snowflake data warehouse with all of the integration and data movement done with Powered by Airbyte. Cart is able to offer its merchants self-service to sign up for an account, connect their data sources, connect their integrations, and begin using the product on their own.
“With Airbyte, we don’t need to worry about connectors and focus on creating value for our users instead of building infrastructure. That’s priceless,” said Chase Zieman, chief data officer, Cart. “The time and energy saved allows us to disrupt and grow faster.”
Digital marketing firm, KORTX, delivers personalized experiences for clients and custom reporting built on BigQuery and Looker. That requires centralizing all of their clients’ data from Facebook Marketing, Google Ads, Google Analytics, Hubspot and more into BigQuery so it can be analyzed. Prior to using Powered by Airbyte, data was pulled manually and put into spreadsheets and, of course, clients did not have real-time access to the data.
“Without Airbyte’s ease-of-use and library of API connectors, we would have either had to lean heavily on valuable engineering resources to build out custom connections to power our custom reporting dashboard solutions or continue with time-consuming manual reporting,” said Jeff Isreal, director of analytics at KORTX.
Damon Henry, KORTX founder and CEO, said, “With Airbyte, our team of data engineers could easily develop new connectors or customize existing ones to meet our clients' needs. The platform’s resilience and reliability mean that we can now focus more on deriving insights and less on managing data pipelines. With Airbyte as our ally, KORTX is not just meeting but exceeding client expectations, ensuring that advertising campaigns are not just effective but are also backed by data that is as robust as it is reliable.”
Airbyte makes moving data easy and affordable across almost any source and destination, helping enterprises provide their users with access to the right data for analysis and decision-making. Airbyte has the largest data engineering contributor community – with more than 800 contributors – and the best tooling to build and maintain connectors.
Pricing for Powered by Airbyte is based primarily on the number of customers syncing data through Airbyte. This makes pricing easier to forecast and more predictable than alternative solutions. Additional pricing details, and a pricing estimator can be found here.
Airbyte is the open-source data movement leader running in the safety of your cloud and syncing data from applications, APIs, and databases to data warehouses, lakes, and other destinations. Airbyte offers four products: Airbyte Open Source, Airbyte Enterprise, Airbyte Cloud, and Powered by Airbyte. Airbyte was co-founded by Michel Tricot (former director of engineering and head of integrations at Liveramp and RideOS) and John Lafleur (serial entrepreneur of dev tools and B2B). The company is headquartered in San Francisco with a distributed team around the world. To learn more, visit airbyte.com.