Big Data Management, Business Strategy, Data Science

ArangoDB Boosts Performance and Usability Across Search, Graph, and Analytics with Release of ArangoDB 3.11

ArangoDB Boosts Performance and Usability Across Search

ArangoDB, the company behind the most complete graph data and analytics platform, today announced the GA release of ArangoDB 3.11 to accelerate its performance across search, graph, and analytics use cases. ArangoDB 3.11 includes performance improvements for ArangoSearch, ArangoDB’s natively-integrated full-text search and ranking engine, as well as new functionality to its web interface to simplify the database’s operations.

“ArangoDB 3.11 is designed to take the capabilities of advanced search and analytics to new heights, while also introducing a wealth of new performance, usability, and operational improvements,” said Jörg Schad, PhD, CTO at ArangoDB. “With today’s release, ArangoDB runs even faster and is more intuitive to use, allowing our customers and community to continue to unlock insights that help them optimize decision-making and accelerate innovation.”

New functionality in ArangoDB 3.11 includes:

  • Faster query performance across search and graph: ArangoDB 3.11 brings new functionality to ArangoSearch that improves its performance. New column caching options allow for common values to be stored in memory, and a new Analyzer for GeoJSON data stores geo-spatial data more efficiently. In addition, reduced memory usage of in-memory edge indexes as well as index cache refilling accelerate graph traversal performance while consuming fewer resources.
  • Improved user experience for database administration and management: With new features available in its web interface, even more of ArangoDB’s capabilities can be managed outside of the command line in a user-friendly graphical interface. The graph viewer for visualizing named graphs has received substantial improvements as well as new functionality. It has been reimplemented based on the vis.js library, the interface has been streamlined and rewritten to use the React framework, and overall performance has been improved. New features include the ability to search the visible graph to center a specific vertex, as well as by Start node. New functionality for ArangoSearch has also been added to ArangoDB’s web interface, including a search-alias View to create and manage search views, the ability to create inverted indexes on collections, as well as a new sorting mechanism and search box for Saved Queries to make it simpler to find relevant queries and discover which ones have been created or used recently.
  • Data science and analytics operational enhancements: ArangoDB 3.11 offers persisted Pregel execution statistics to better assist data science and graph analytics use cases.

Further features in ArangoDB 3.11 include parallel gather, write-write conflict improvements, various performance enhancements across AQL (the ArangoDB Query Language), new server options, and more.

Packaging and availability

ArangoDB 3.11 is available immediately. All new features are included in both the open source ArangoDB Community Edition and the commercial ArangoDB Enterprise Edition, except for column caching and the geo_s2 Analyzer, which are Enterprise only.

ArangoDB 3.11 is available for download as a self-managed deployment here, as well as on ArangoGraph Insights Platform, ArangoDB’s managed service.

About ArangoDB

ArangoDB is the company behind ArangoGraph Insights Platform: a next-generation graph data and analytics platform that uncovers insights in data that are difficult or impossible with traditional SQL, document, or even other graph databases – making it easier to drive value from connected data, faster. ArangoGraph Insights Platform is the scalable backbone for graph analytics and complex data architectures for thousands of Fortune 500 enterprises and innovative startups across many different industries, including financial services, healthcare, and telecommunications.

Founded in 2015 in Cologne, Germany, ArangoDB Inc. is a venture-backed, next-generation graph data and analytics company headquartered in San Francisco, California, with offices and employees worldwide. Learn more at http://www.arangodb.com.

Spotlight

Other News
Data Science

PingCAP Attains Coveted AWS Data and Analytics Competency Status

PingCAP | September 13, 2023

On September 12, 2023, PingCAP, a prominent distributed SQL database provider, announced its attainment of the coveted Amazon Web Services (AWS) Data and Analytics Competency status. This prestigious designation underscores PingCAP's track record of successfully assisting customers in collecting, storing, governing, and analyzing data at any scale. The achievement of AWS Data and Analytics Competency signifies PingCAP as a distinguished member of the AWS Partner Network (APN), specializing in software solutions tailored to assist enterprises in embracing, developing, and deploying intricate projects on the AWS platform. This designation is reserved for APN members with extensive AWS proficiency who deliver solutions seamlessly within the AWS environment. Moreover, PingCAP has also secured AWS Service Ready designations for both AWS PrivateLink and Amazon Linux 2. The AWS Service Ready Program rigorously assesses AWS partner solutions for compatibility with specific AWS services. To obtain these accolades, PingCAP underwent meticulous technical evaluations of its product architecture, received references from customers, and provided product documentation. By harnessing AWS PrivateLink, customers gain access to a streamlined experience for connecting PingCAP TiDB Cloud with other AWS services and applications, ensuring heightened security and adaptable network configuration. AWS empowers organizations of all sizes with scalable, flexible, and cost-effective solutions, ranging from startups to global enterprises. In support of seamless integration and deployment of these solutions, AWS has instituted the AWS Competency Program, enabling customers to identify AWS Partners with profound industry acumen and expertise. Eddie Xu, Director of Cloud Alliances at PingCAP, commented, We are thrilled to achieve the AWS Data and Analytics Competency. Many of our customers have made long-term strategic investments to build their digital businesses on AWS. Being a part of this program reflects PingCAP's commitment to delivering a solution that meets security, compliance, and efficiency standards in support of our customers scaling their transactional workloads on AWS. [Source: Globe Newswire] About PingCAP PingCAP, headquartered in Silicon Valley, is the visionary behind TiDB, an advanced, open-source, distributed SQL database. This database powers modern applications, boasting a streamlined tech stack, elastic scalability, real-time analytics, and uninterrupted access to data—all unified within a singular database solution. These innovative capabilities liberate emerging enterprises from the complexities of data infrastructure management, allowing them to set their sights firmly on the future. Some of the world's leading businesses across the travel, technology, financial services, web3, and gaming sectors trust TiDB to manage their mission-critical workloads.

Read More

Data Visualization

Airbyte Integrates with Datadog for Superior Data Pipeline Management

Airbyte | September 11, 2023

Airbyte, the leading open-source data movement platform, has announced a strategic integration with Datadog, Inc., a prominent cloud application monitoring and security platform. This integration offers customers a comprehensive solution to monitor and analyze data pipelines with access to nearly 50 metrics, all at no additional cost. The integration between Airbyte Self-Managed and Datadog's data observability and security monitoring capabilities allows organizations to maintain a close watch on the health of their critical data pipelines. Key features of this integration include: A centralized overview of Airbyte data pipeline performance Real-time detection and immediate alerts for failing syncs or connections Notifications regarding long-running jobs, which could indicate potential latency issues Michel Tricot, CEO of Airbyte, emphasized the significance of this integration, stating, The new Datadog integration provides transparency and actionable insights, empowering users to optimize performance and ensure reliable data pipelines by proactively addressing potential data issues. [Source: Business Wire] Yrieix Garnier, Vice President of Product at Datadog, further elaborated on the benefits, explaining, Airbyte's data extraction and loading process involves numerous complex components. The integration with Datadog offers users peace of mind, enabling them to monitor data pipelines across their organization and troubleshoot any potential data integration workflow issues, ultimately ensuring data quality. [Source: Business Wire] This integration will be immediately available to users. Existing Datadog customers can configure their Airbyte deployments to send metrics to Datadog. For those not already using Datadog, a free trial is available. Similarly, users new to Airbyte can sign up for free. Airbyte continues its commitment to delivering robust data integration and analysis solutions to organizations. The Datadog integration represents a significant milestone in Airbyte's mission to empower businesses with efficient data integration capabilities. Airbyte simplifies data movement across various sources and destinations, making it accessible and cost-effective for enterprises. With the largest data engineering contributor community, boasting over 800 contributors as well as top-tier tools for connector development and maintenance, Airbyte remains at the forefront of the data integration landscape. About Airbyte Founded in 2020, Airbyte is an open-source platform for EL (T) that enables data teams to replicate data from various sources to different destinations. The company, which has raised $181 million in funding, believes in the power of open source to address data integration challenges and offers over 200 connectors for data syncing. Currently, it serves over 25,000 companies.

Read More

Big Data Management

Arity Launches Arity IQ on Google Cloud's Analytics Hub

Business Wire | October 19, 2023

Arity, a leading mobility and data analytics company, today announces that the Arity IQ network and attributes dataset are now available in Google Cloud’s data exchange, Analytics Hub. Google Cloud’s auto insurance customers can now more accurately price insurance policies at time of quote by using driving behavior history. By having access to this data, insurers are able to increase pricing sophistication, improve profitability, and grow their book of business. With access to the Arity IQ network in Google Cloud’s Analytics Hub, insurance carriers can: Enhance owned datasets with comprehensive driving behavior data through Arity’s DrivesightScore or specific driving attributes within Google Cloud’s privacy-safe environment. Analyze and segment customers at time of quote to increase pricing sophistication. Deliver personalized experiences with more accurate quotes to customers at new and renewed business. We’re excited to bring the Arity IQ network to Google Cloud's insurance customers, said Gary Hallgren, Arity’s president. We’re not only expanding the reach of one of the world’s largest driving behavior databases tied to claims, but we’re helping insurers price more competitively at time of quote. Arity uses privacy forward methods for secure and safe data storage, including encrypting data at rest and in transit and by making the data available within Google Cloud’s Analytics Hub, carriers can access the data in a privacy-safe environment. “Google Cloud Analytics Hub provides Arity’s customers with an efficient, secure platform to exchange data and combine their business data with third-party insights,” said Yolande Piazza, Vice President of Financial Services at Google Cloud. “With the addition of the Arity IQ network, our insurance customers can increase value for their business while providing more accurate prices based on how their customers behave behind the wheel.” About Arity Arity is a mobility data and analytics company that provides data-driven solutions to companies invested in transportation, enabling them to deliver mobility services that are smarter, safer, and more economical. Arity collects and analyzes over a trillion of miles of driving data to create a greater understanding of how people move. With the world’s largest driving dataset tied to insurance claims collected through mobile devices, in-car devices, and vehicles themselves, Arity derives unique insights that help insurers, developers, marketers, and communities understand and predict driving behavior at scale.

Read More

Data Science

Airbyte Announces Additional Vector Database Connectors, Making Hundreds of Data Sources Available for Artificial Intelligence Applications

Business Wire | October 20, 2023

Airbyte, creators of the fastest-growing open-source data movement platform, today made available additional connectors for the Milvus, Qdrant and Weaviate vector databases as the destination for moving data from hundreds of data sources, which then can be accessed by artificial intelligence (AI) models. We were the first general-purpose data movement platform to add support for vector databases – the first to build a bridge between data movement platforms and AI, said Michel Tricot, CEO, Airbyte. Now, we are doubling down as our users are clamoring for more and more vector database support so they don’t have to struggle with creating custom code to bring in data; they can use the new Airbyte connector to select the data sources they want. Because vector databases have the ability to detect and identify relationships in data, their usage has become increasingly popular as users seek to gain more meaning from data. Vector databases are ideal for applications like recommendation systems, anomaly detection and natural language processing, and as sources for AI applications – specifically Large Language Models (LLM). The vector database destination in Airbyte now enables users to configure the full ELT pipeline, starting from extracting records from a wide variety of sources to separating unstructured and structured data, preparing and embedding text contents of records, and finally loading them into vector databases – all through a single, user-friendly interface. These vector databases can then be accessed by LLMs. All existing advantages of the Airbyte platform are now extended to vector databases, including: The largest catalog of data sources that can be connected within minutes, and optimized for performance. Availability of the no-code connector builder that makes it possible to easily and quickly create new connectors for data integrations that addresses the “long-tail” of data sources. Ability to do incremental syncs to only extract changes in the data from a previous sync. Built-in resiliency in the event of a disrupted session moving data, so the connection will resume from the point of the disruption. Secure authentication for data access. Ability to schedule and monitor status of all syncs. Airbyte continues to innovate and support cutting-edge technologies to empower organizations in their data integration journey. The addition of more vector database support marks another significant milestone in Airbyte's commitment to providing powerful and efficient solutions for data integration and analysis. Certified connectors for both Airbyte Cloud and Airbyte Open Source Software (OSS) versions are now available for Milvus, Pinecone, and Weaviate. There is a community connector for both versions of Airbyte for Qdrant, as well as a community connector for Airbyte OSS available for Chroma. More options are planned for the future. Airbyte makes moving data easy and affordable across almost any source and destination, helping enterprises provide their users with access to the right data for analysis and decision-making. Airbyte has the largest data engineering contributor community – with more than 800 contributors – and the best tooling to build and maintain connectors. About Airbyte Airbyte is the open-source data movement leader running in the safety of your cloud and syncing data from applications, APIs, and databases to data warehouses, lakes, and other destinations. Airbyte offers four products: Airbyte Open Source, Airbyte Enterprise, Airbyte Cloud, and Powered by Airbyte. Airbyte was co-founded by Michel Tricot (former director of engineering and head of integrations at Liveramp and RideOS) and John Lafleur (serial entrepreneur of dev tools and B2B). The company is headquartered in San Francisco with a distributed team around the world. To learn more, visit airbyte.com.

Read More