Big Data Management

Qlik Expands Real-Time Data Integration and Cloud Analytics Services for Snowflake

Qlik | June 16, 2022

Qlik
Qlik® today announced multiple new and enhanced capabilities that will help customers maximize the value of their investment in Snowflake Data Cloud. These services expand the ability to both seamlessly feed Snowflake with near real-time data and more easily access data in real-time and action it for decision making across the enterprise.

“Customers are looking to augment their investment in Snowflake with services that accelerate the access and availability of near real-time data for modern analytics. “We are excited about Qlik’s latest SaaS platform integrations with Snowflake, which can make it easier for customers to leverage near real-time data through Snowflake to improve decision-making across the organization with up-to-date insights.”

Tarik Dwiek, Head of Technology Alliances of Snowflake

“Since the start of our collaboration with Qlik and Snowflake, we’ve seen some immense results. By moving the database to the cloud and having it work with Qlik's automated solutions, we can unlock new data sources in our data warehouse within five days, instead of 20, and create new incremental data marts in days rather than weeks. We also achieved a 75% cost reduction on ETL development,” said Maikel Jaspers, BI Engineer at Ewals Cargo Care. “Now not only can we run reports more efficiently, but we can also fulfil more requests. This has given us more agility, and ultimately makes the entire company much more effective, something we've been striving to do for a very long time.”

Qlik enhanced its Cloud Analytics Services for Snowflake with two new features that help customers drive more value from near real-time data when deploying Qlik’s cloud platform with Snowflake. Direct Query enables users to automatically generate pushdown SQL to query Snowflake on demand from within Qlik Sense. This combines the ability to optimize Snowflake queries with immediate access to the most recent data, while allowing for the creation of best-in-class visualizations and dashboards in Qlik Sense. Qlik’s FinOps and query optimization analytic applications expand on Qlik’s existing Snowflake usage dashboards and provide CDOs and data leaders with a comprehensive understanding of what is driving Snowflake usage and how to best optimize Snowflake workloads to improve the user experience.

Qlik also released new and enhanced Qlik Cloud Data Services capabilities for Snowflake, including:

  • Real-time change data capture and movement to Snowflake including major databases, SAP, mainframe and SaaS applications.
  • Data warehouse automation for model-driven code generation, which dramatically reduces the time, cost, and risk to realize the full potential of Snowflake.
  • Reverse ETL to replicate enriched data from the Snowflake platform back to the operational systems of record.

At QlikWorld, Qlik’s recent customer and partner event, industry leaders such as ABB, Best Buy Canada, CSS, Harman, Novartis, SDI and Urban Outfitters showcased how they leverage Qlik solutions with Snowflake to activate data for insights and action.

  • ABB demonstrated how they combine Qlik Data Integration to feed Snowflake with SAP and other data sources to unlock the hidden value of data at scale and help create deeper insights faster.
  • Best Buy Canada showed how they partnered with Accenture, Qlik and Snowflake to accelerate the delivery of the initial phase of a multi-phased data ecosystem modernization journey in the cloud.
  • CSS outlined how they built a modern cloud data lakehouse with near real-time data ingestion and fully automated creation of analytics structures for rapid business insights by using Qlik Data Integration with Snowflake.
  • SDI showcased ZEUS, their MRO technology platform, which digitizes a portion of the supply chain by leveraging Qlik and Snowflake to uniquely summarize activity for any supply chain manager.

“We’re seeing continued customer success and growth in demand to leverage Qlik and Snowflake together to advance cloud data analytics strategies,” said Itamar Ankorion, SVP of Technology Alliances at Qlik. “These recent new features and enhancements, including Direct Query capabilities and Cloud Data Integration Services, are part of our continued investments to innovate and help customers accelerate time to value and drive more insights and action from their data.”

About Qlik
Qlik’s vision is a data-literate world, where everyone can use data and analytics to improve decision-making and solve their most challenging problems. A private company, Qlik offers real-time data integration and analytics solutions, powered by Qlik Cloud, to close the gaps between data, insights and action. By transforming data into Active Intelligence, businesses can drive better decisions, improve revenue and profitability, and optimize customer relationships. Qlik serves more than 38,000 active customers in over 100 countries.

Spotlight

User Entity and Behavior Analytics (UEBA) is a cybersecurity technology and approach that focuses on analyzing the behavior of users and entities (such as devices, applications, and systems) within an organization's IT environment. By using advanced data analytics, machine learning algorithms, and artificial intelligence, UEBA aims to detect and prevent cyber threats by identifying anomalies, deviations, or patterns in user and entity activities that might indicate potential security risks.


Other News
Big Data Management

Congruity360 Delivers Intelligent Data Migrations and Storage Tiering

PR Newswire | September 27, 2023

Congruity360, a leading unstructured data management and risk mitigation provider, announces the addition of data mobility in Enterprise Insights. As unstructured data grows at the annual rate of 55% to 65% and accounts for more than 80% of all enterprise data, businesses must find a way to identify, classify and move data intelligently and automatically during its lifecycle. As enterprises grow, their valuable data must mature with their business. This may require a journey to the cloud, SLA changes which optimize storage costs, classification to mitigate risk, and moving the right data to additional key AI platform initiatives. A simple, scalable, high-performance data classification engine, Enterprise Insights delivers next-generation data lifecycle management for storage optimization, security and risk optimization, and IT business optimization. Enterprise Insights Approach to Successful Data Optimization: Identify – Securely analyze PBs of unstructured data across on premises (NAS & object) and cloud (files/objects & SaaS) sources by harnessing the power of the platform's rapid insights and auto-discover technologies, which can reduce data identification times by 1,000%. Classify – Quickly identify key client data attributes for cost savings, risk mitigation, and business impact with simple to consume dashboards and drill down capabilities. Review – Confidently create and take actions by leveraging the comprehensive search engine to quickly find and preview data for movement without ever leaving the platform. Remediate – Seamlessly take action (migrate and tier) on classified data to ensure it's properly protected, optimally stored, and most effectively serving the business. Enterprise Insights offers three use case-driven insight analysis modules: Storage and Migration Optimization – Insights into over 35 file data attributes including systems' aged, stale, obsolete, redundant, trivial, and types of systems files. Business Optimization – Insight into and classification by business units' or cost centers' aged, stale, obsolete, redundant, trivial, and types of files. Data Security and Risk Optimization – Insights into files containing PII and SPII, financial, legal, security, and risk data, as well as open shares and other network & storage security vulnerabilities. By leveraging Enterprise Insights, clients can classify data for simple and secure migration both on premise and in the cloud. Equally important is Insights data tiering capabilities, enabling users to match data storage costs to data usage. Powered by the Classify360 Platform, Enterprise Insights' secure hybrid approach to data analysis scales capabilities to exabyte levels at unmatched speed. Enterprise Insights is the industry's most powerful weapon to tackle the costs, time, and complexity of cloud migration projects, backup modernization, storage tiering, hardware refresh, and security posture management. By providing users with dashboards highlighting their existing storage costs and risks, Enterprise Insights frees clients from hidden, legacy, CapEx and OpEx expenditures, performance, and scalability bottlenecks while discovering and acting on sensitive and risk data. Unstructured data insanity is treating all data equally with zero insights into its business impact, said Brian Davidson, Chief Executive Officer and Managing Partner of Congruity360. Enterprise Insights is the first step in implementing optimized data lifecycle management. With historically high data growth and new business uses for unstructured data, it is essential to attack the costs and risks inherent in unmanaged data. Our customers have realized 7-10x returns on their data lifecycle management implementations while reducing risk in an auditable compliance framework. As AI continues to gain steam, don't overpay by moving useless data to your expensive AI platforms. The Classify360 Platform is comprehensive, simple to implement, scale, and operate. Businesses leverage the Classify360 Platform for unstructured data discovery, classification, business workflows, remediation actions, and insightful reporting. Congruity360 continues to tackle additional data governance challenges through innovations to the Classify360 Platform to continue delivering revolutionary data governance and classification, at scale, to the enterprise world. ABOUT CONGRUITY360 Congruity360 delivers the only data life cycle management solution built on a foundation of classification, by expert data storage engineers alongside expert data privacy consultants. The Classify360 Platform is easy to implement, requires no outside consultants, and quickly analyzes your data at the petabyte scale in days, not weeks or months.

Read More

Data Science

J.D. Power Acquires Autovista Group to Expand Automotive Data Portfolio

J.D. Power | September 18, 2023

J.D. Power, a prominent global leader in data analytics, has recently announced a definitive agreement to acquire Autovista Group, a renowned pan-European and Australian automotive data, analytics, and industry insights provider. This strategic acquisition complements J.D. Power's existing strengths in vehicle valuation and intricate vehicle specification data and analytics while significantly expanding its presence within the European and Australian automotive markets. This acquisition represents a crucial moment, as it delivers substantial value to the customers of both companies. It brings together Autovista Group's extensive European and Australian market intelligence with J.D. Power's market-leading predictive analytics, valuation data, and customer experience datasets. These complementary offerings will empower original equipment manufacturers (OEMs), insurers, dealers, and financing companies with a truly global perspective on critical industry trends. They will also provide the tools to accurately predict risk, capitalize on emerging trends, and align sales strategies with real-time market dynamics. Pete Cimmet, Chief Strategy Officer at J.D. Power, stated: The addition of Autovista Group broadens our global presence allowing us to serve our customers across key global markets including North America, Europe and Asia/Australia. We look forward to partnering with the Autovista team to launch innovative new products and pursue strategic add-on acquisitions in Europe and Australia. [Source: Business Wire] Autovista Group, through its five prominent brands—Autovista, Glass's, Eurotax, Schwacke, and Rødboka—standardizes and categorizes a multitude of technical attributes for nearly every vehicle manufactured in European and Australian markets. This comprehensive approach offers clients a 360-degree view of detailed vehicle data, which is invaluable for valuations, forecasts, and repair estimates. Furthermore, Autovista Group's robust analytical solutions and its team of seasoned experts are trusted by stakeholders across the automobile industry for their in-depth insights and benchmarks related to vehicle values, ownership, replacements, and repair costs. Under this agreement, Autovista Group's senior leadership, along with its 700 employees, will remain part of the organization, serving as J.D. Power's automotive data and analytics platform for Australia and Europe. Lindsey Roberts will continue to lead the team in her role as President of J.D. Power Europe, reporting to CEO Dave Habiger. Currently, Autovista Group is owned by Hayfin Capital Management, a prominent European alternative asset management firm. The anticipated closure of the Autovista Group acquisition is set for conclusion by the end of 2023, pending customary closing conditions and regulatory review and approval. For this transaction, RBC Capital Markets acted as the exclusive financial advisor, and Kirkland & Ellis provided legal counsel to J.D. Power. TD Cowen served as the exclusive financial advisor, with Macfarlanes, Cravath, Swaine & Moore, and Mishcon de Reya acting as legal advisors to Autovista Group and Hayfin. About J.D. Power J.D. Power, a renowned consumer insights, advisory services, and data and analytics firm, has consistently spearheaded the use of big data, artificial intelligence (AI), and algorithmic modeling to illuminate the intricacies of consumer behavior for more than half a century. With a storied legacy of providing in-depth industry intelligence on customer interactions with brands and products, J.D. Power serves as the trusted leader for the world's preeminent enterprises, spanning diverse major sectors, profoundly influencing and refining their customer-centric strategies.

Read More

Big Data Management

iMerit Unveils Innovative Solution for Radiology AI Data Challenges

iMerit | September 07, 2023

iMerit, a prominent player in the field of artificial intelligence (AI) data solutions, has unveiled its latest offering, the Radiology Annotation Product Suite. This innovative suite is designed to cater to the needs of medical AI developers by providing advanced automation, annotation, and analytics capabilities. This new product suite is firmly rooted in iMerit's Ango Hub platform, an end-to-end enterprise-grade technology platform that is specifically tailored to deliver top-notch data annotation tools for AI development teams. Within this suite, a comprehensive range of solutions awaits, including data sourcing, workflow design, cutting-edge data annotation tools, and the invaluable input of human experts, all seamlessly integrated into a single platform. This unique fusion of iMerit's technological prowess and radiology expertise ensures a smooth journey from training data all the way to regulatory benchmarking. A significant hurdle in radiology AI applications is the demand for specialized tools and insights from domain experts to ensure the necessary accuracy and precision in training data. For developers, the Radiology Annotation Product Suite offers a one-stop solution, combining automation, annotation tools, and analytics within a single platform, facilitating the creation of precise data pipelines essential for quick scaling radiology AI solutions into production. Sina Bari MD, Senior Director of Medical AI at iMerit, explained that their suite aims to combine human expertise, data management, and automation in a single solution. Notable features include Customized workflows designed for Radiologists with consensus and multistep capabilities. Diagnostic-level annotation accuracy with multiplanar functionality and 3D volume rendering. Efficient annotation facilitated by smart automation tools and model integration. Stringent data security and regulatory compliance, including CFR 21 Part 11, HIPAA, and SOC2. This solution seamlessly integrates U.S. and offshore experts, including board-certified radiologists, all within a highly secure end-to-end platform, ensuring cost-effective scaling of annotation efforts. Radha Basu, Founder and CEO of iMerit, emphasized the importance of their work, stating that they understand the challenges of developing AI applications and that their suite was built to scale data annotation efforts with high quality, accuracy, and speed. About iMerit iMerit is a prominent AI data solutions company specializing in data services such as dataset creation, image tagging, sentiment analysis, data verification, and content aggregation. It serves Fortune 500 enterprises in various industries and have a global presence, with headquarters in the United States and teams in India, the US, Bhutan, and Europe. iMerit's investors include Omidyar Network, Dell.org, Khosla Ventures, and British International Investment.

Read More

Data Visualization

Airbyte Integrates with Datadog for Superior Data Pipeline Management

Airbyte | September 11, 2023

Airbyte, the leading open-source data movement platform, has announced a strategic integration with Datadog, Inc., a prominent cloud application monitoring and security platform. This integration offers customers a comprehensive solution to monitor and analyze data pipelines with access to nearly 50 metrics, all at no additional cost. The integration between Airbyte Self-Managed and Datadog's data observability and security monitoring capabilities allows organizations to maintain a close watch on the health of their critical data pipelines. Key features of this integration include: A centralized overview of Airbyte data pipeline performance Real-time detection and immediate alerts for failing syncs or connections Notifications regarding long-running jobs, which could indicate potential latency issues Michel Tricot, CEO of Airbyte, emphasized the significance of this integration, stating, The new Datadog integration provides transparency and actionable insights, empowering users to optimize performance and ensure reliable data pipelines by proactively addressing potential data issues. [Source: Business Wire] Yrieix Garnier, Vice President of Product at Datadog, further elaborated on the benefits, explaining, Airbyte's data extraction and loading process involves numerous complex components. The integration with Datadog offers users peace of mind, enabling them to monitor data pipelines across their organization and troubleshoot any potential data integration workflow issues, ultimately ensuring data quality. [Source: Business Wire] This integration will be immediately available to users. Existing Datadog customers can configure their Airbyte deployments to send metrics to Datadog. For those not already using Datadog, a free trial is available. Similarly, users new to Airbyte can sign up for free. Airbyte continues its commitment to delivering robust data integration and analysis solutions to organizations. The Datadog integration represents a significant milestone in Airbyte's mission to empower businesses with efficient data integration capabilities. Airbyte simplifies data movement across various sources and destinations, making it accessible and cost-effective for enterprises. With the largest data engineering contributor community, boasting over 800 contributors as well as top-tier tools for connector development and maintenance, Airbyte remains at the forefront of the data integration landscape. About Airbyte Founded in 2020, Airbyte is an open-source platform for EL (T) that enables data teams to replicate data from various sources to different destinations. The company, which has raised $181 million in funding, believes in the power of open source to address data integration challenges and offers over 200 connectors for data syncing. Currently, it serves over 25,000 companies.

Read More

Spotlight

User Entity and Behavior Analytics (UEBA) is a cybersecurity technology and approach that focuses on analyzing the behavior of users and entities (such as devices, applications, and systems) within an organization's IT environment. By using advanced data analytics, machine learning algorithms, and artificial intelligence, UEBA aims to detect and prevent cyber threats by identifying anomalies, deviations, or patterns in user and entity activities that might indicate potential security risks.

Resources