Business Intelligence, Big Data Management

VAST Data and Dremio Break Down Data Silos And Accelerate Queries At Any Scale

VAST Data | September 30, 2022 | Read time : 03:00 min

VAST Data
VAST Data, the data platform company for the AI-powered world, today announced a strategic partnership with Dremio, the easy and open data lakehouse platform, to enable enterprises to get from data to insights faster with a hybrid, multi-cloud architecture for scalable analytics. Regardless of physical location – on-premises or in the public cloud – Dremio customers can now analyze their data anywhere by leveraging VAST’s massively parallel architecture for concurrent and near real-time data access at any scale.

VAST and Dremio are at the forefront of a market shift away from siloed data warehouses and legacy data platforms such as Hadoop. As businesses struggle with the exponential growth of data volumes and data sources, they need a highly-scalable solution for storing that data, and providing broad and concurrent access for a wide range of technical and non-technical data consumers. Paired with Dremio, VAST's Universal Storage enables organizations to escape the restrictive, walled garden environment of Hadoop and the Hadoop File System. It provides customers with an open data lakehouse platform that powers the data management, data governance, and enterprise analytics capabilities typically found in a data warehouse, powered by an all-flash data store that is purpose-built to manage large volumes of structured, semi-structured, and unstructured data.

In the spirit of public cloud object storage offerings like Amazon Simple Storage Service (S3), VAST unifies an organization’s data for analytics on a common, single-tiered and linearly scalable data platform - while also enabling customers to step into an all-flash S3 experience without the flash expense that’s common with conventional systems. Dremio provides an open data lakehouse platform that executes lightning-fast SQL queries using a common semantic layer across data sources, and a simple user interface. As a result, organizations can build capabilities that are superior to even public cloud offerings with cloud-native infrastructure that provide choice and flexibility on how and where data is managed.

“Partnering with VAST ensures Dremio users are equipped with the lakehouse data capacity and scalable high performance necessary to run their business intelligence workloads and data analytics applications. “As data volumes continue to grow, VAST’s disaggregated architecture enables users to easily scale the performance and capacity that businesses demand, and that our open data lakehouse platform delivers.”

Roger Frey, vice president of alliances at Dremio

Faster time to data access

Dremio’s open lakehouse platform enables organizations to query data directly in the data lake – and on S3 architecture – without having to copy or move data. By querying data in place, Dremio eliminates the need for complex and brittle ETL pipelines and data copies. Dremio reduces the time required to fulfill data access requests from weeks or months to just hours, and makes data teams more productive. Dremio also centralizes security and governance, and its no-copy architecture reduces network and storage costs.

Dremio’s simplified data architecture complements VAST’s all-flash Universal Storage storage platform, which reduces latency and delivers a high-performance infrastructure for analytics at any scale. VAST’s breakthrough Universal Storage data platform reduces the amount of storage capacity necessary in cloud-native environments without compromising performance, optimizing spend and space. Together, Dremio and VAST accelerate access to data for analytics, and deliver insights to a wide range of data consumers.

“We continue to see high market demand to underpin organizations’ modern data analytics infrastructure with VAST. Partnering with ecosystem leaders like Dremio drives a new approach to data analytics,” said Jeff Denworth, chief marketing officer and co-founder of VAST. “Partnering with Dremio ensures that our mutual customers have an optimized and simple out-of-the-box experience as they embrace a cloud-native architecture for their rapidly evolving data management needs.”

About VAST Data
VAST Data delivers the data platform at the heart of the AI-powered world, accelerating time-to-insight for workload-intensive applications. The performance, scalability, ease of use and cost efficiencies of VAST’s software helps enterprise organizations overcome the historic barriers to building all-flash data centers. Launched in 2019, VAST is the fastest-selling data infrastructure startup in history.

Spotlight

User Entity and Behavior Analytics (UEBA) is a cybersecurity technology and approach that focuses on analyzing the behavior of users and entities (such as devices, applications, and systems) within an organization's IT environment. By using advanced data analytics, machine learning algorithms, and artificial intelligence, UEBA aims to detect and prevent cyber threats by identifying anomalies, deviations, or patterns in user and entity activities that might indicate potential security risks.


Other News
Big Data Management

iMerit Unveils Innovative Solution for Radiology AI Data Challenges

iMerit | September 07, 2023

iMerit, a prominent player in the field of artificial intelligence (AI) data solutions, has unveiled its latest offering, the Radiology Annotation Product Suite. This innovative suite is designed to cater to the needs of medical AI developers by providing advanced automation, annotation, and analytics capabilities. This new product suite is firmly rooted in iMerit's Ango Hub platform, an end-to-end enterprise-grade technology platform that is specifically tailored to deliver top-notch data annotation tools for AI development teams. Within this suite, a comprehensive range of solutions awaits, including data sourcing, workflow design, cutting-edge data annotation tools, and the invaluable input of human experts, all seamlessly integrated into a single platform. This unique fusion of iMerit's technological prowess and radiology expertise ensures a smooth journey from training data all the way to regulatory benchmarking. A significant hurdle in radiology AI applications is the demand for specialized tools and insights from domain experts to ensure the necessary accuracy and precision in training data. For developers, the Radiology Annotation Product Suite offers a one-stop solution, combining automation, annotation tools, and analytics within a single platform, facilitating the creation of precise data pipelines essential for quick scaling radiology AI solutions into production. Sina Bari MD, Senior Director of Medical AI at iMerit, explained that their suite aims to combine human expertise, data management, and automation in a single solution. Notable features include Customized workflows designed for Radiologists with consensus and multistep capabilities. Diagnostic-level annotation accuracy with multiplanar functionality and 3D volume rendering. Efficient annotation facilitated by smart automation tools and model integration. Stringent data security and regulatory compliance, including CFR 21 Part 11, HIPAA, and SOC2. This solution seamlessly integrates U.S. and offshore experts, including board-certified radiologists, all within a highly secure end-to-end platform, ensuring cost-effective scaling of annotation efforts. Radha Basu, Founder and CEO of iMerit, emphasized the importance of their work, stating that they understand the challenges of developing AI applications and that their suite was built to scale data annotation efforts with high quality, accuracy, and speed. About iMerit iMerit is a prominent AI data solutions company specializing in data services such as dataset creation, image tagging, sentiment analysis, data verification, and content aggregation. It serves Fortune 500 enterprises in various industries and have a global presence, with headquarters in the United States and teams in India, the US, Bhutan, and Europe. iMerit's investors include Omidyar Network, Dell.org, Khosla Ventures, and British International Investment.

Read More

Big Data Management

Reltio Set to Transform Data Management with AI-Powered MDM Solution

Reltio | September 20, 2023

Reltio, a leading modern data management solutions provider, has introduced an innovative AI-powered Master Data Management (MDM) solution. For over a decade, Reltio has been a pioneer in data management, offering a leading cloud-native SaaS MDM solution. The firm is poised to preview novel AI-driven capabilities tailored to meet the growing demand for delivering customers more insightful and timely intelligence powered by reliable data. Participants at the upcoming DataDriven23 conference, taking place from October 3 to 5 in Dallas, TX, will have the opportunity to directly engage with Reltio's innovations and witness how AI is poised to revolutionize MDM, enhancing the quality of data that shapes business outcomes. During the event, experts will showcase three pivotal AI-driven solution capabilities designed to drive remarkable 10X enhancements: Generative AI-driven Search and Data Visualizations: Powered by Reltio's AI-powered MDM platform, enterprises can swiftly pinpoint critical data segments and data visualizations to the Reltio UI, facilitated by a conversational interface powered by GenAI. This simplifies the process of data analysis within Reltio. Increased Data Steward Productivity: Harnessing the power of Machine Learning, Reltio's latest capabilities aim to further automate entity resolution and data quality management processes and enhance data precision while boosting data steward efficiency by 10X. Automated Predictions: Reltio's new AI-driven MDM platform empowers businesses to effortlessly anticipate key insights using propensity models. This aids in identifying crucial customer segments, thereby fostering higher customer acquisition and retention rates. Reltio remains committed to continuous investment in machine learning-based automation within Reltio's Connected Data Platform 2023.3. This includes the introduction of new features in entity resolution and data quality anomaly detection designed to expedite MDM implementations, fortify data unification, and elevate the productivity of data teams. About Reltio Reltio, a renowned leader in modern data management, believes steadfastly in the critical role of data in driving business achievements. The firm is well-known for its cutting-edge data management platform, which effortlessly integrates vital data from different sources into a unified repository of reliable information. This combination of pristine, interconnected, and actionable data empowers Reltio's esteemed clientele to enhance operational efficiency, mitigate risk, and foster sustainable growth. The solution has received praise and is utilized by prominent corporate brands across a wide range of sectors in over 140 countries.

Read More

Data Science

J.D. Power Acquires Autovista Group to Expand Automotive Data Portfolio

J.D. Power | September 18, 2023

J.D. Power, a prominent global leader in data analytics, has recently announced a definitive agreement to acquire Autovista Group, a renowned pan-European and Australian automotive data, analytics, and industry insights provider. This strategic acquisition complements J.D. Power's existing strengths in vehicle valuation and intricate vehicle specification data and analytics while significantly expanding its presence within the European and Australian automotive markets. This acquisition represents a crucial moment, as it delivers substantial value to the customers of both companies. It brings together Autovista Group's extensive European and Australian market intelligence with J.D. Power's market-leading predictive analytics, valuation data, and customer experience datasets. These complementary offerings will empower original equipment manufacturers (OEMs), insurers, dealers, and financing companies with a truly global perspective on critical industry trends. They will also provide the tools to accurately predict risk, capitalize on emerging trends, and align sales strategies with real-time market dynamics. Pete Cimmet, Chief Strategy Officer at J.D. Power, stated: The addition of Autovista Group broadens our global presence allowing us to serve our customers across key global markets including North America, Europe and Asia/Australia. We look forward to partnering with the Autovista team to launch innovative new products and pursue strategic add-on acquisitions in Europe and Australia. [Source: Business Wire] Autovista Group, through its five prominent brands—Autovista, Glass's, Eurotax, Schwacke, and Rødboka—standardizes and categorizes a multitude of technical attributes for nearly every vehicle manufactured in European and Australian markets. This comprehensive approach offers clients a 360-degree view of detailed vehicle data, which is invaluable for valuations, forecasts, and repair estimates. Furthermore, Autovista Group's robust analytical solutions and its team of seasoned experts are trusted by stakeholders across the automobile industry for their in-depth insights and benchmarks related to vehicle values, ownership, replacements, and repair costs. Under this agreement, Autovista Group's senior leadership, along with its 700 employees, will remain part of the organization, serving as J.D. Power's automotive data and analytics platform for Australia and Europe. Lindsey Roberts will continue to lead the team in her role as President of J.D. Power Europe, reporting to CEO Dave Habiger. Currently, Autovista Group is owned by Hayfin Capital Management, a prominent European alternative asset management firm. The anticipated closure of the Autovista Group acquisition is set for conclusion by the end of 2023, pending customary closing conditions and regulatory review and approval. For this transaction, RBC Capital Markets acted as the exclusive financial advisor, and Kirkland & Ellis provided legal counsel to J.D. Power. TD Cowen served as the exclusive financial advisor, with Macfarlanes, Cravath, Swaine & Moore, and Mishcon de Reya acting as legal advisors to Autovista Group and Hayfin. About J.D. Power J.D. Power, a renowned consumer insights, advisory services, and data and analytics firm, has consistently spearheaded the use of big data, artificial intelligence (AI), and algorithmic modeling to illuminate the intricacies of consumer behavior for more than half a century. With a storied legacy of providing in-depth industry intelligence on customer interactions with brands and products, J.D. Power serves as the trusted leader for the world's preeminent enterprises, spanning diverse major sectors, profoundly influencing and refining their customer-centric strategies.

Read More

Business Intelligence

Dremio Launches Next-gen Reflections Redefining SQL Query Acceleration

Dremio | September 15, 2023

Dremio, a renowned easy and open data lakehouse solution provider, has recently introduced its next-gen Reflections technology, marking a transformative milestone in SQL query acceleration. Dremio Reflections facilitate sub-second analytics performance across an organization's entire data ecosystem, irrespective of data location. This groundbreaking technology is redefining data access and analysis, ensuring that valuable insights are derived efficiently and swiftly, all while reducing costs to merely one-third of a typical cloud data warehouse. Reflections represent Dremio's innovative SQL query acceleration technology. Queries that leverage Reflections exhibit performance gains ranging from 10 to 100 times faster than their non-accelerated counterparts. This latest release introduces the Dremio Reflection Recommender, a pioneering feature that empowers users to accelerate Business Intelligence workloads in a matter of seconds. The Reflection Recommender automatically evaluates an organization's SQL queries and generates recommended Reflections to accelerate them. Tomer Shiran, founder of Dremio, commented, Dremio Reflections accelerate SQL queries by orders of magnitude, eliminating the need for BI extracts/imports and enabling companies to run their most mission-critical BI workloads directly on a lakehouse. With automatic recommendations and next-generation incremental updates, we've made it even easier for organizations to take advantage of this innovative technology. [Source: Business Wire] Reflection Recommender eliminates the need for labor-intensive manual data and workload analysis, making the process of obtaining the fastest and most intelligent query results effortless, requiring only a few simple actions. The user-friendly nature of the Reflection Recommender puts advanced query acceleration capabilities within the reach of all users, significantly saving both time and expenses. Dremio has also refined the process of refreshing Reflections to further bolster query performance and drive cost efficiencies. It now intelligently refreshes Reflections on Apache Iceberg tables, promptly capturing incremental data changes. This innovative approach obviates the requirement for complete data refreshes, resulting in speedier updates and reduced compute expenses. Dremio Reflections eliminates the need for data teams to export data from the data lakehouse into BI extracts or imports for analytical reasons and overcomes performance bottlenecks for BI dashboards and reports. In addition, Reflections negate the necessity of creating precomputed tables within the data lake or data warehouse to achieve sub-second performance for BI workloads, reducing the workload and complexity for data teams. About Dremio Dremio is a leading, easy and open data lakehouse solution provider, offering organizations the versatility of self-service analytics coupled with the functionality of a data warehouse and the flexibility of a data lake. Dremio's platform empowers users to harness the lightning-fast SQL query service alongside various processing engines, all on the same dataset. The company distinguishes itself through a pioneering data-as-code methodology akin to Git, which facilitates data experimentation, version control, and governance. This innovative approach enhances agility and empowers organizations to explore and manage their data resources with unprecedented efficiency. Furthermore, Dremio offers a fully managed service that expedites organizations' entry into analytics, allowing them to commence their data-driven journey within minutes.

Read More

Spotlight

User Entity and Behavior Analytics (UEBA) is a cybersecurity technology and approach that focuses on analyzing the behavior of users and entities (such as devices, applications, and systems) within an organization's IT environment. By using advanced data analytics, machine learning algorithms, and artificial intelligence, UEBA aims to detect and prevent cyber threats by identifying anomalies, deviations, or patterns in user and entity activities that might indicate potential security risks.

Resources