Big Data Management, Data Science

Qlik Expands Strategic Alignment with Databricks Through SQL-Based Ingestion to Databricks Lakehouse and Partner Connect Integration

Qlik
Qlik® today announced two significant enhancements to its partnership with Databricks that make it easier than ever for customers to combine Qlik’s solutions and Databricks to advance their cloud analytics strategies. First is the launch of the Databricks Lakehouse (Delta) Endpoint, a new capability in Qlik Data Integration, which will simplify and improve customers' ability to ingest and deliver data to the Databricks Lakehouse. Second is the integration of Qlik Cloud® with Databricks Partner Connect, enhancing the Qlik Data Analytics trial experience with Databricks. Both deepen and expand the ability of customers to combine Qlik and Databricks in their efforts to leverage the cloud for impact.

“We’re excited about the potential of Qlik’s Databricks Lakehouse (Delta) Endpoint to seamlessly and efficiently deliver the data customers need to drive more value from their investment in the Databricks Lakehouse. “And, with Qlik Analytics now integrated with Databricks Partner Connect, we are making it even easier for customers to discover, use and share data-driven insights across their organizations.”

Roger Murff, VP of Technology Partners at Databricks

Leveraging Databricks SQL, Qlik’s Databricks (Delta) Endpoint optimizes the continuous and real-time data ingestion through Qlik Data Integration into Delta Lake on Databricks. This gives organizations the ability to cost effectively drive more data from a wide range of enterprise data sources, including SAP and Mainframe, into the Databricks Lakehouse while leveraging their cloud provider of choice such as Amazon Web Services (AWS), Google Cloud Platform (GCP) or Microsoft Azure.

Qlik has also recently integrated Qlik Cloud with Databricks Partner Connect. Databricks customers can now seamlessly experience Qlik Sense® SaaS within the Databricks Lakehouse Platform through an existing Qlik tenant or a free Qlik trial. The experience includes automatic configuration of connectivity to the customer’s Databricks environment, making it easier for Databricks customers to experience the power of Qlik Cloud.

Both the new Databricks Lakehouse (Delta) Endpoint and Partner Connect integration demonstrate Qlik’s commitment to supporting customers like J.B. Hunt in their efforts to combine Qlik and Databricks for impact.

“We’re seeing more demand for real-time data related to shippers and carriers in order to provide up-to-the-minute information on how they are performing. Qlik and Databricks help us to meet those demands,” said Joe Spinelle, Director of Engineering and Technology at J.B. Hunt.

“As they migrate more and more to the cloud, Databricks customers want strategic partners that make it as easy as possible to deliver and analyze data for impact,” said Itamar Ankorion, SVP of Technology Alliances at Qlik. “With our new Databricks Lakehouse Endpoint and Databricks Partner Connect integration, Qlik is clearly demonstrating its alignment with Databricks and our dedication to the Databricks community to deliver an amazing experience that furthers their overall data strategies.”

About Qlik
Qlik’s vision is a data-literate world, where everyone can use data and analytics to improve decision-making and solve their most challenging problems. A private company, Qlik offers real-time data integration and analytics solutions, powered by Qlik Cloud®, to close the gaps between data, insights and action. By transforming data into Active Intelligence, businesses can drive better decisions, improve revenue and profitability, and optimize customer relationships. Qlik serves more than 38,000 active customers in over 100 countries.

Spotlight

Other News
Big Data

Airbyte Racks Up Awards from InfoWorld, BigDATAwire, Built In; Builds Largest and Fastest-Growing User Community

Airbyte | January 30, 2024

Airbyte, creators of the leading open-source data movement infrastructure, today announced a series of accomplishments and awards reinforcing its standing as the largest and fastest-growing data movement community. With a focus on innovation, community engagement, and performance enhancement, Airbyte continues to revolutionize the way data is handled and processed across industries. “Airbyte proudly stands as the front-runner in the data movement landscape with the largest community of more than 5,000 daily users and over 125,000 deployments, with monthly data synchronizations of over 2 petabytes,” said Michel Tricot, co-founder and CEO, Airbyte. “This unparalleled growth is a testament to Airbyte's widespread adoption by users and the trust placed in its capabilities.” The Airbyte community has more than 800 code contributors and 12,000 stars on GitHub. Recently, the company held its second annual virtual conference called move(data), which attracted over 5,000 attendees. Airbyte was named an InfoWorld Technology of the Year Award finalist: Data Management – Integration (in October) for cutting-edge products that are changing how IT organizations work and how companies do business. And, at the start of this year, was named to the Built In 2024 Best Places To Work Award in San Francisco – Best Startups to Work For, recognizing the company's commitment to fostering a positive work environment, remote and flexible work opportunities, and programs for diversity, equity, and inclusion. Today, the company received the BigDATAwire Readers/Editors Choice Award – Big Data and AI Startup, which recognizes companies and products that have made a difference. Other key milestones in 2023 include the following. Availability of more than 350 data connectors, making Airbyte the platform with the most connectors in the industry. The company aims to increase that to 500 high-quality connectors supported by the end of this year. More than 2,000 custom connectors were created with the Airbyte No-Code Connector Builder, which enables data connectors to be made in minutes. Significant performance improvement with database replication speed increased by 10 times to support larger datasets. Added support for five vector databases, in addition to unstructured data sources, as the first company to build a bridge between data movement platforms and artificial intelligence (AI). Looking ahead, Airbyte will introduce data lakehouse destinations, as well as a new Publish feature to push data to API destinations. About Airbyte Airbyte is the open-source data movement infrastructure leader running in the safety of your cloud and syncing data from applications, APIs, and databases to data warehouses, lakes, and other destinations. Airbyte offers four products: Airbyte Open Source, Airbyte Self-Managed, Airbyte Cloud, and Powered by Airbyte. Airbyte was co-founded by Michel Tricot (former director of engineering and head of integrations at Liveramp and RideOS) and John Lafleur (serial entrepreneur of dev tools and B2B). The company is headquartered in San Francisco with a distributed team around the world. To learn more, visit airbyte.com.

Read More

Big Data Management

The Modern Data Company Recognized in Gartner's Magic Quadrant for Data Integration

The Modern Data Company | January 23, 2024

The Modern Data Company, recognized for its expertise in developing and managing advanced data products, is delighted to announce its distinction as an honorable mention in Gartner's 'Magic Quadrant for Data Integration Tools,' powered by our leading product, DataOS. “This accolade underscores our commitment to productizing data and revolutionizing data management technologies. Our focus extends beyond traditional data management, guiding companies on their journey to effectively utilize data, realize tangible ROI on their data investments, and harness advanced technologies such as AI, ML, and Large Language Models (LLMs). This recognition is a testament to Modern Data’s alignment with the latest industry trends and our dedication to setting new standards in data integration and utilization.” – Srujan Akula, CEO of The Modern Data Company The inclusion in the Gartner report highlights The Modern Data Company's pivotal role in shaping the future of data integration. Our innovative approach, embodied in DataOS, enables businesses to navigate the complexities of data management, transforming data into a strategic asset. By simplifying data access and integration, we empower organizations to unlock the full potential of their data, driving insights and innovation without disruption. "Modern Data's recognition as an Honorable Mention in the Gartner MQ for Data Integration is a testament to the transformative impact their solutions have on businesses like ours. DataOS has been pivotal in allowing us to integrate multiple data sources, enabling our teams to have access to the data needed to make data driven decisions." – Emma Spight, SVP Technology, MIND 24-7 The Modern Data Company simplifies how organizations manage, access, and interact with data using its DataOS (data operating system) that unifies data silos, at scale. It provides ontology support, graph modeling, and a virtual data tier (e.g. a customer 360 model). From a technical point of view, it closes the gap from conceptual to physical data model. Users can define conceptually what they want and its software traverses and integrates data. DataOS provides a structured, repeatable approach to data integration that enhances agility and ensures high-quality outputs. This shift from traditional pipeline management to data products allows for more efficient data operations, as each 'product' is designed with a specific purpose and standardized interfaces, ensuring consistency across different uses and applications. With DataOS, businesses can expect a transformative impact on their data strategies, marked by increased efficiency and a robust framework for handling complex data ecosystems, allowing for more and faster iterations of conceptual models. About The Modern Data Company The Modern Data Company, with its flagship product DataOS, revolutionizes the creation of data products. DataOS® is engineered to build and manage comprehensive data products to foster data mesh adoption, propelling organizations towards a data-driven future. DataOS directly addresses key AI/ML and LLM challenges: ensuring quality data, scaling computational resources, and integrating seamlessly into business processes. In our commitment to provide open systems, we have created an open data developer platform specification that is gaining wide industry support.

Read More

Data Visualization

SensiML Unveils Data Studio - Next-Generation Sensor Data Management for AI / ML

SensiML | December 20, 2023

SensiML Corporation, a leader in AI software for IoT and a subsidiary of QuickLogic, announced the launch of Data Studio, a ground-breaking platform designed to redefine the landscape of sensor data management. With a focus on practicality and efficiency, Data Studio empowers engineers and data scientists by offering an integrated solution that addresses the most time-consuming tasks in AI engineering projects - creating high-quality datasets for evaluating and developing ML models. According to Cognilytica, a well-respected AI / ML consulting firm, approximately 80% of the total time for machine learning (ML) projects is allocated to data preparation. These tasks include data identification, aggregation, cleansing, labeling, and augmentation – all of which are supported in SensiML's collaborative development environment. SensiML Data Studio significantly improves productivity and simplifies dataset management for anyone working on sensor data ML projects. With real-time connectivity, intuitive visualization tools, sensor data video synchronization, and robust support for large-scale collaborative projects, it offers a seamless experience for developers on edge devices, gateways, PCs, and cloud platforms. A comprehensive overview of all the features of Data Studio can be found on the SensiML website. The primary features are highlighted below: Effortless Data Capture and Import - Capture live sensor data, analyze it instantly, and label any data for seamless insights. Collaboratively Label Sensor Data - Employ flexible labeling methodologies for sensor data, including manual, AI-assisted, and custom – and sync video for effortless complex labeling. Store and analyze data locally on your computer or remotely. Data Analysis and Model Evaluation - Visually compare ML models, filter, transform, and fuse sensor data – all with built-in tools and your own Python expertise. Label and Data Versioning – Keep track of your labels and model results with versioned labels. Easily export your project to an open format. "SensiML Data Studio makes sensor data management and analysis more accessible and efficient, empowering developers to build better, more impactful applications using sensor data across a wide range of industries," said Chris Knorowski, CTO of SensiML. SensiML Data Studio is poised to transform sensor data analysis, offering a valuable resource for researchers, engineers, and data scientists across diverse sectors from agriculture and consumer wearables to medical devices, smart buildings, and factory maintenance. About SensiML SensiML, a subsidiary of QuickLogic (NASDAQ: QUIK), offers cutting-edge software that enables ultra-low power IoT endpoints that implement AI to transform raw sensor data into meaningful insight at the device itself. The company's flagship solution, the SensiML Analytics Toolkit, provides an end-to-end development platform spanning data collection, labeling, algorithm and firmware auto-generation, and testing. The SensiML Toolkit supports Arm® Cortex®-M class and higher microcontroller cores, Intel® x86 instruction set processors, and heterogeneous core QuickLogic SoCs and QuickAI platforms with FPGA optimizations.

Read More

Machine Learning

InterSystems Introduces Two New Cloud-Native Smart Data Services to Accelerate Database and Machine Learning Application Development

InterSystems | January 12, 2024

InterSystems, a creative data technology provider dedicated to helping customers solve their most critical scalability, interoperability, and speed problems, today announced general availability of the InterSystems IRIS Cloud SQL and InterSystems IRIS Cloud IntegratedML® services. These fully managed cloud-native smart data services empower developers to build cloud-native database and machine learning (ML) applications in SQL environments with ease. With Cloud SQL and Cloud IntegratedML, developers can access a next generation relational database-as-a-service (DBaaS) that is fast and easy to provision and use. Embedded AutoML capabilities allow developers to easily develop and execute machine learning models with just a few SQL-like commands in a fully-managed, elastic cloud-native environment. Shaping a complete data management portfolio for mission-critical applications As part of the InterSystems Cloud portfolio of smart data services, Cloud SQL and Cloud IntegratedML provide application developers with access to InterSystems proven enterprise-class capabilities as self-service, fully managed offerings on Amazon Web Services (AWS), while providing a fast and seamless on-ramp to the full suite of capabilities in InterSystems IRIS® data platform. InterSystems IRIS is a next-generation data platform designed for organizations implementing smart data fabrics that provide powerful database management, integration, and application development capabilities. By consolidating these capabilities into a single product, InterSystems IRIS accelerates the time it takes to realize value from data, simplifies overall system architectures, and reduces both maintenance effort and costs. “We are excited for the capabilities of InterSystems IRIS to be exposed through these new, easy to deploy and easy to use services,” said Scott Gnau, Global Head of Data Platforms at InterSystems. “With native support for AutoML, we give developers the power to build comprehensive, predictive, and prescriptive applications.” Fully managed, enterprise-class reliability with InterSystems IRIS Cloud SQL Cloud SQL makes it easy for application developers to leverage advanced relational database capabilities as a fully managed, secure, scalable, high performance, highly available cloud-native database-as-a-service (DBaaS). Cloud SQL delivers the following benefits for SQL developers: Extremely high performance, especially for ingesting and processing incoming data and performing SQL queries on the data with low latency at scale Fast and easy to provision and use Ability to easily connect client applications via JDBC, ODBC, DB-API, and ADO.NET drivers Automated security, data encryption, and backups Automation of machine learning tasks with InterSystems IRIS Cloud IntegratedML Available as an additional cloud managed service for InterSystems IRIS Cloud SQL customers, Cloud IntegratedML extends the capabilities of Cloud SQL to enable SQL developers to quickly build, tune, and execute machine learning models with just a few SQL-like commands, without moving or copying data to a different environment. A significant advantage of Cloud IntegratedML is the elimination of the need to transfer or replicate data to an external platform to build ML models, or to move ML models to a different environment for execution. Cloud IntegratedML delivers the following benefits for SQL developers: Automation of machine learning processes and resource-intensive tasks such as feature engineering, model development, and fine-tuning Seamless integration of models developed and trained with Cloud IntegratedML within Cloud SQL, facilitating real-time predictive insights and prescriptive actions in response to events and transactions This comprehensive suite of smart data services establishes the InterSystems Cloud portfolio of smart data services as an optimal choice for SQL developers seeking a robust, high-performance database solution tailored to their needs. The new Cloud SQL and Cloud IntegratedML services are available through InterSystems Developer Hub. About InterSystems Established in 1978, InterSystems is the leading provider of next-generation solutions for enterprise digital transformations in the healthcare, finance, manufacturing, and supply chain sectors. Its cloud-first data platforms solve interoperability, speed, and scalability problems for large organizations around the globe. InterSystems is committed to excellence through its award-winning, 24×7 support for customers and partners in more than 80 countries. Privately held and headquartered in Cambridge, Massachusetts, InterSystems has 38 offices in 28 countries worldwide. For more information, please visit InterSystems.com.

Read More