Big Data Management

Kinetica Redefines Real-Time Analytics with Native LLM Integration

Kinetica Unveils Native LLM Integration for Real-Time Analytics

Kinetica, a renowned speed layer for generative AI and real-time analytics, has recently unveiled a native Large Language Model (LLM) integrated with Kinetica's innovative architecture. This empowers users to perform ad-hoc data analysis on real-time, structured data with the ease of natural language, all without the need for external API calls and without data ever leaving the secure confines of the customer's environment. This significant milestone follows Kinetica's prior innovation as the first analytic database to integrate with OpenAI.

Amid the LLM fervor, enterprises and government agencies are actively seeking inventive ways to automate various business functions while safeguarding sensitive information that could be exposed through fine-tuning or prompt augmentation. Public LLMs, exemplified by OpenAI's GPT 3.5, raise valid concerns regarding privacy and security. These concerns are effectively mitigated through native offerings, seamlessly integrated into the Kinetica deployment, and securely nestled within the customer's network perimeter.

Beyond its superior security features, Kinetica's native LLM is finely tuned to the syntax and industry-specific data definitions, spanning domains such as telecommunications, automotive, financial services, logistics, and more. This tailored approach ensures the generation of more reliable and precise SQL queries. Notably, this capability extends beyond conventional SQL, enabling efficient handling of intricate tasks essential for enhanced decision-making capabilities, particularly for time-series, graph, and spatial inquiries. Kinetica's approach to fine-tuning places emphasis on optimizing SQL generation to deliver consistent and accurate results, in stark contrast to more conventional methods that prioritize creativity but yield diverse and unpredictable responses. This steadfast commitment to reliable SQL query outcomes offers businesses and users the peace of mind they deserve.

Illustrating the practical impact of this innovation, the US Air Force has been collaborating closely with Kinetica to leverage advanced analytics on sensor data, enabling swift identification and response to potential threats. This partnership contributes significantly to the safety and security of the national airspace system. The US Air Force now employs Kinetica's embedded LLM to detect airspace threats and anomalies using natural language.

Kinetica's database excels in converting natural language queries into SQL, delivering responses in mere seconds, even when faced with complex or unfamiliar questions. Furthermore, Kinetica seamlessly combines various analytics modes, including time series, spatial, graph, and machine learning, thereby expanding the range of queries it can effectively address. What truly enables Kinetica to excel in conversational query processing is its ingenious use of native vectorization. In a vectorized query engine, data is organized into fixed-size blocks called vectors, enabling parallel query operations on these vectors. This stands in contrast to traditional approaches that process individual data elements sequentially. The result is significantly accelerated query execution, all within a smaller compute footprint. This remarkable speed is made possible by the utilization of GPUs and the latest CPU advancements, which enable simultaneous calculations on multiple data elements, thereby greatly enhancing the processing speed of computation-intensive tasks across multiple cores or threads.

About Kinetica

Kinetica is a pioneering company at the forefront of real-time analytics and is the creator of the groundbreaking real-time analytical database specially designed for sensor and machine data. The company offers native vectorized analytics capabilities in the fields of generative AI, spatial analysis, time-series modeling, and graph processing. A distinguished array of the world's largest enterprises spanning diverse sectors, including the public sector, financial services, telecommunications, energy, healthcare, retail, and automotive industries, entrusts Kinetica to forge novel solutions in the realms of time-series data and spatial analysis. The company's clientele includes various illustrious organizations such as the US Air Force, Citibank, Ford, T-Mobile, and numerous others.

Spotlight

Other News
Data Visualization

BlackBerry to Showcase Innovative Automotive Solutions Powered by the BlackBerry IVY Connected Vehicle Data Platform at CES 2024

BlackBerry Limited | December 18, 2023

At CES 2024, BlackBerry Limited will be showcasing the breadth and power of its BlackBerry IVY® connected vehicle data platform through in-vehicle and virtualized demos with a range of ecosystem partners. The BlackBerry IVY platform enables developers across industries to design and deploy insights-enabled automotive services more quickly, leveraging in-vehicle AI-enabled processing and a developer-friendly platform. This ease of development has led to a growing diversity of solutions developed on the BlackBerry IVY platform, giving automakers new opportunities to quickly enable additional services to differentiate and potentially monetize the connected car. This year's IVY™ showcase at CES will feature a wide array of mobility applications; IVY powered in-vehicle AI demonstrations will include: Michelin's tire wear monitoring solution with real-time integration to its consumer retail network COMPREDICT hardware sensor replacement solutions, utilizing virtual sensors to create cost savings and monetize vehicle health insights. Intelligent in-cabin experiences powered by Cinemo, CorrActions, CarIQ, idrive, and emotion3D. Next generation insurance solutions, such as First Notification of Loss and Collision Reconstruction featured by Nexar, and crash analytics and driver scoring by CerebrumX. Intelligent vehicle cybersecurity & quality insights powered by Upstream Security. Additional partners will be showcasing how BlackBerry IVY powers next generation digital cockpits and intelligent fleet management services. Demonstrations include: MIH Consortium will feature its intelligent fleet capabilities, with IVY insights, from Electra Vehicles, COMPREDICT, and CerebrumX Mitsubishi Electric will showcase its FLEXConnect™ advanced vehicle cockpit system in a Cadillac Escalade Intellias will showcase its IntelliKit 2.0 solution which is centered around the Qualcomm SA8295 with QNX Real Time Operating System (RTOS), QNX Hypervisor, and pre-processing connected vehicle insights with BlackBerry IVY. "The IVY Ecosystem has grown rapidly, and now embraces an impressive range of applications that are set to change the mobility business and the in-car experience by harnessing the power of connected vehicle data," said Vito Giallorenzo, Senior Vice President & General Manager, BlackBerry IVY. "We're looking forward to demonstrating the many and varied ways that our ecosystem members are innovating on the IVY platform and how it has enabled them to easily develop and scale their solutions." For more information on how BlackBerry IVY can help with building safe and secure data solutions for the Software Defined Vehicles of tomorrow, and to see a BlackBerry IVY powered vehicle in action, please visit us at CES on January 9-12 in the West Hall at Booth #4224 or www.blackberry.com/ivy. Live demos of other BlackBerry IVY powered applications will also be showcased in the West Hall at CES with Mitsubishi Electric (#3151), MIH (#7216), and Intellias (#7075). About BlackBerry BlackBerry (NYSE: BB; TSX: BB) provides intelligent security software and services to enterprises and governments around the world. The company secures more than 500M endpoints including over 235M vehicles. Based in Waterloo, Ontario, the company leverages AI and machine learning to deliver innovative solutions in the areas of cybersecurity, safety and data privacy solutions, and is a leader in the areas of endpoint management, endpoint security, encryption, and embedded systems. BlackBerry's vision is clear - to secure a connected future you can trust.

Read More

Data Architecture

SingleStore Announces Real-time Data Platform to Further Accelerate AI, Analytics and Application Development

SingleStore | January 25, 2024

SingleStore, the database that allows you to transact, analyze and contextualize data, today announced powerful new capabilities — making it the industry’s only real-time data platform. With its latest release, dubbed SingleStore Pro Max, the company announced ground-breaking features like indexed vector search, an on-demand compute service for GPUs/ CPUs and a new free shared tier, among several other innovative new products. Together, these capabilities shrink development cycles while providing the performance and scale that customers need for building applications. In an explosive generative AI landscape, companies are looking for a modern data platform that’s ready for enterprise AI use cases — one with best-available tooling to accelerate development, simultaneously allowing them to marry structured or semi-structured data residing in enterprise systems with unstructured data lying in data lakes. “We believe that a data platform should both create new revenue streams while also decreasing technological costs and complexity for customers. And this can only happen with simplicity at the core,” said Raj Verma, CEO, SingleStore. “This isn’t just a product update, it’s a quantum leap… SingleStore is offering truly transformative capabilities in a single platform for customers to build all kinds of real-time applications, AI or otherwise.” “At Adobe, we aim to change the world through digital experiences,” said Matt Newman, Principal Data Architect, Adobe. “SingleStore’s latest release is exciting as it pushes what is possible when it comes to database technology, real-time analytics and building modern applications that support AI workloads. We’re looking forward to these new features as more and more of our customers are seeking ways to take full advantage of generative Al capabilities.” Key new features launched include: Indexed vector search. SingleStore has announced support for vector search using Approximate Nearest Neighbor (ANN) vector indexing algorithms, leading to 800-1,000x faster vector search performance than precise methods (KNN). With both full-text and indexed vector search capabilities, SingleStore offers developers true hybrid search that takes advantage of the full power of SQL for queries, joins, filters and aggregations. These capabilities firmly place SingleStore above vector-only databases that require niche query languages and are not designed to meet enterprise security and resiliency needs. Free shared tier. SingleStore has announced a new cloud-based Free Shared Tier that’s designed for startups and developers to quickly bring their ideas to life — without the need to commit to a paid plan. On-demand compute service for GPUs and CPUs. SingleStore announces a compute service that works alongside SingleStore’s native Notebooks to let developers spin up GPUs and CPUs to run database-adjacent workloads including data preparation, ETL, third-party native application frameworks, etc. This capability brings compute to algorithms, rather than the other way around, enabling developers to build highly performant AI applications safely and securely using SingleStore — without unnecessary data movement. New CDC capabilities for data ingest and egress. To ease the burden and costs of moving data in and out of SingleStore, SingleStore is adding native capabilities for real-time Change Data Capture (CDC) in for MongoDB®, MySQL and ingestion from Apache Iceberg without requiring other third party CDC tools. SingleStore will also support CDC out capabilities that ease migrations and enable the use of SingleStore as a source for other applications and databases like data warehouses and lakehouses. SingleStore Kai™. Now generally available, and ready for both analytical and transactional processing for apps originally built on MongoDB. Announced in public preview in early 2023, SingleStore Kai is an API to deliver over 100x faster analytics on MongoDB® with no query changes or data transformations required. Today, SingleStore Kai supports BSON data format natively, has improved transactional performance, increased performance for arrays and offers industry-leading compatibility with MongoDB query language. Projections: To further advance as the world’s fastest HTAP database, SingleStore has added Projections. Projections allow developers to greatly speed up range filters and group by operations by introducing secondary sort and shard keys. Query performance improvements range from 2-3x or more, depending on the size of the table. With this latest release, SingleStore becomes the industry’s first and only real-time data platform designed for all applications, analytics and AI. SingleStore supports high-throughput ingest performance, ACID transactions and low-latency analytics; and structured, semi-structured (JSON, BSON, text) and unstructured data (vector embeddings of audio, video, images, PDFs, etc.). Finally, SingleStore’s data platform is designed not just with developers in mind, but also ML engineers, data engineers and data scientists. “Our new features and capabilities advance SingleStore’s mission of offering a real-time data platform for the next wave of gen AI and data applications,” said Nadeem Asghar, SVP, Product Management + Strategy at SingleStore. “New features, including vector search, Projections, Apache Iceberg, Scheduled Notebooks, autoscaling, GPU compute services, SingleStore Kai™, and the Free Shared Tier allow startups — as well as global enterprises — to quickly build and scale enterprise-grade real-time AI applications. We make data integration with third-party databases easy with both CDC in and CDC out support.” "Although generative AI, LLM, and vector search capabilities are early stage, they promise to deliver a richer data experience with translytical architecture," states the 2023 report, “Translytical Architecture 2.0 Evolves To Support Distributed, Multimodel, And AI Capabilities,” authored by Noel Yuhanna, Vice President and Principal Analyst at Forrester Research. "Generative AI and LLM can help democratize data through natural language query (NLQ), offering a ChatGPT-like interface. Also, vector storage and index can be leveraged to perform similarity searches to support data intelligence." SingleStore has been on a fast track leading innovation around generative AI. The company’s product evolution has been accompanied by high-momentum growth in customers and surpassing $100M in ARR late last year. SingleStore also recently ranked #2 in the emerging category of vector databases, and was recognized by TrustRadius as a top vector database in 2023. Finally, SingleStore was a winner of InfoWorld’s Technology of the year in the database category. To learn more about SingleStore visit here. About SingleStore SingleStore empowers the world’s leading organizations to build and scale modern applications using the only database that allows you to transact, analyze and contextualize data in real time. With streaming data ingestion, support for both transactions and analytics, horizontal scalability and hybrid vector search capabilities, SingleStore helps deliver 10-100x better performance at 1/3 the costs compared to legacy architectures. Hundreds of customers worldwide — including Fortune 500 companies and global data leaders — use SingleStore to power real-time applications and analytics. Learn more at singlestore.com. Follow us @SingleStoreDB on Twitter or visit www.singlestore.com.

Read More

Data Visualization

SensiML Unveils Data Studio - Next-Generation Sensor Data Management for AI / ML

SensiML | December 20, 2023

SensiML Corporation, a leader in AI software for IoT and a subsidiary of QuickLogic, announced the launch of Data Studio, a ground-breaking platform designed to redefine the landscape of sensor data management. With a focus on practicality and efficiency, Data Studio empowers engineers and data scientists by offering an integrated solution that addresses the most time-consuming tasks in AI engineering projects - creating high-quality datasets for evaluating and developing ML models. According to Cognilytica, a well-respected AI / ML consulting firm, approximately 80% of the total time for machine learning (ML) projects is allocated to data preparation. These tasks include data identification, aggregation, cleansing, labeling, and augmentation – all of which are supported in SensiML's collaborative development environment. SensiML Data Studio significantly improves productivity and simplifies dataset management for anyone working on sensor data ML projects. With real-time connectivity, intuitive visualization tools, sensor data video synchronization, and robust support for large-scale collaborative projects, it offers a seamless experience for developers on edge devices, gateways, PCs, and cloud platforms. A comprehensive overview of all the features of Data Studio can be found on the SensiML website. The primary features are highlighted below: Effortless Data Capture and Import - Capture live sensor data, analyze it instantly, and label any data for seamless insights. Collaboratively Label Sensor Data - Employ flexible labeling methodologies for sensor data, including manual, AI-assisted, and custom – and sync video for effortless complex labeling. Store and analyze data locally on your computer or remotely. Data Analysis and Model Evaluation - Visually compare ML models, filter, transform, and fuse sensor data – all with built-in tools and your own Python expertise. Label and Data Versioning – Keep track of your labels and model results with versioned labels. Easily export your project to an open format. "SensiML Data Studio makes sensor data management and analysis more accessible and efficient, empowering developers to build better, more impactful applications using sensor data across a wide range of industries," said Chris Knorowski, CTO of SensiML. SensiML Data Studio is poised to transform sensor data analysis, offering a valuable resource for researchers, engineers, and data scientists across diverse sectors from agriculture and consumer wearables to medical devices, smart buildings, and factory maintenance. About SensiML SensiML, a subsidiary of QuickLogic (NASDAQ: QUIK), offers cutting-edge software that enables ultra-low power IoT endpoints that implement AI to transform raw sensor data into meaningful insight at the device itself. The company's flagship solution, the SensiML Analytics Toolkit, provides an end-to-end development platform spanning data collection, labeling, algorithm and firmware auto-generation, and testing. The SensiML Toolkit supports Arm® Cortex®-M class and higher microcontroller cores, Intel® x86 instruction set processors, and heterogeneous core QuickLogic SoCs and QuickAI platforms with FPGA optimizations.

Read More

Big Data Management

Dremio Partners With Carahsoft to Bring Modern Data Infrastructure to the Public Sector

Dremio | January 05, 2024

Dremio, the easy and open data lakehouse, and Carahsoft Technology Corp., The Trusted Government IT Solutions Provider, today announced a partnership. Under the agreement, Carahsoft will serve as Dremio’s Master Government Aggregator®, making the company’s complete cloud and software portfolio for Government, Defense, Intelligence and Education available through Carahsoft’s reseller partners and NASA Solutions for Enterprise-Wide Procurement (SEWP) V, Information Technology Enterprise Solutions – Software 2 (ITES-SW2), National Association of State Procurement Officials (NASPO) ValuePoint, National Cooperative Purchasing Alliance (NCPA) and OMNIA Partners contracts. This collaboration paves the way for Public Sector organizations to harness cutting-edge data analytics capabilities which empower them to make smarter decisions and significantly enhance operational efficiency through lightning-fast data access. Dremio propels agencies into the future by embracing a state-of-the-art data lakehouse architecture in Public Sector organizations. By transitioning to Dremio's solutions, organizations can enjoy sub-second query performance and a remarkable 10-fold improvement in price performance. The new environment eliminates costly and complex legacy data lake solutions and implements a flexible, highly modern architecture. Dremio provides cost-effective self-service analytics and data management, simplifying data pipelines and ETL complexity while accelerating insights across diverse storage locations. With a proven track record of modernizing legacy Hadoop environments and implementing the modern data lakehouse solution, Dremio and Carahsoft aim to transform Public Sector data management by breaking down data silos. Embracing a data mesh concept enables efficient handling of various data sources, fostering cross- collaboration and decentralized data control. Dremio’s expertise supports Public Sector agencies in implementing these principles, eradicating data silos for a more collaborative and efficient approach to data analytics. "Public sector organizations face a range of data infrastructure challenges, many of which are common to both Government and non-government entities. These issues often hinder effective data management, analysis, and decision-making,” said Roger Frey, Vice President of Alliances at Dremio. “Dremio's mission is to make data easily accessible and analyzable for all users, regardless of where it resides. We are excited to partner with Carahsoft to bring our state-of-the-art data analytics solutions to the Public Sector." “Within the Public Sector’s intricate data landscape, complexities often impede efficient data management and decision making,” said Laura Howton, Sales Director who leads the Analytics and Data Management Team at Carahsoft. “By adding Dremio to our AI and Machine Learning portfolio, our reseller partners can now provide modern, cost-effective and easily accessible data analytics tools to Government customers, bolstering their modernization efforts.” Dremio’s solutions are available through Carahsoft’s SEWP V contracts NNG15SC03B and NNG15SC27B, ITES-SW2 Contract W52P1J-20-D-0042, NASPO ValuePoint Master Agreement #AR2472, NCPA Contract NCPA01-86 and OMNIA Partners Contract #R191902. For more information, contact the Carahsoft team at 571-591-6430 or Dremio@carahsoft.com; or register for a complimentary webcast, “The Key Steps in Decreasing Costs and Improving Performance Through Data Lake Modernization,” Thursday, January 25, at 2p.m. About Dremio Dremio is the easy and open data lakehouse, providing self-service analytics with data warehouse functionality and data lake flexibility across all of your data. Use Dremio's lightning-fast SQL query service and any other processing engine on the same data. Dremio increases agility with a revolutionary data-as-code approach that enables Git-like data experimentation, version control, and governance. In addition, Dremio eliminates data silos by enabling queries across data lakes, databases, and data warehouses, and by simplifying ingestion into the lakehouse. Dremio's fully managed service helps organizations get started with analytics in minutes, and automatically optimizes data for every workload. As the original creator of Apache Arrow and committed to Arrow and Iceberg’s community-driven standards, Dremio is on a mission to reinvent SQL for data lakes and meet customers where they are on their lakehouse journey.

Read More