Business Intelligence, Big Data Management, Data Science

Unravel Data Launches Cloud Data Cost Observability and Optimization for Google Cloud BigQuery

Unravel Data Launches Cloud Data Cost Observability

Unravel Data, the first AI-enabled data observability and FinOps platform built to address the speed and scale of modern data platforms, today announced the release of Unravel 4.8.1, enabling Google Cloud BigQuery customers to see and better manage their cloud data costs by understanding specific cost drivers, allocation insights, and performance and cost optimization of SQL queries. This launch comes on the heels of the recent BigQuery pricing model change that replaced flat-rate and flex slot pricing with three new pricing tiers, and will help BigQuery customers to implement FinOps in real-time to select the right new pricing plan based on their usage, and maximize workloads for greater return on cloud data investments.

As today’s enterprises implement artificial intelligence (AI) and machine learning (ML) models, to continually garner more business value from their data, they are experiencing exploding cloud data costs, with a lack of visibility into cost-drivers and a lack of control for managing and optimizing their spend. As cloud costs continue to climb, managing cloud spend remains a top challenge for global business leaders. Data management services are the fastest-growing category of cloud service spending, representing 39% of the total cloud bill. Unravel 4.8.1 enables visibility into BigQuery compute and storage spend and provides cost optimization intelligence using its built-in AI to improve workload cost efficiency.

Unravel’s purpose-built AI for BigQuery delivers insights based on Unravel’s deep observability of the job, user, and code level to supply AI-driven cost optimization recommendations for slots and SQL queries, including slot provisioning, query duration, autoscaling efficiencies, and more. With Unravel, BigQuery users can speed cloud transformation initiatives by having real-time cost visibility, predictive spend forecasting, and performance insights for their workloads. BigQuery customers can also use Unravel to customize dashboards and alerts with easy-to-use widgets that offer insights on spend, performance, and unit economics.

“As AI continues to drive exponential data usage, companies are facing more problems with broken pipelines and inefficient data processing which slows time to business value and adds to the exploding cloud data bills. Today, most organizations do not have the visibility into cloud data spend or ways to optimize data pipelines and workloads to lower spend and mitigate problems,” said Kunal Agarwal, CEO and Co-founder, Unravel Data. “With Unravel’s built-in AI, BigQuery users have data observability and FinOps in one solution to increase data pipeline reliability and cost efficiency so that businesses can bring even more workloads to the cloud for the same spend.”

“Enterprises are increasingly concerned about lack of visibility into and control of their cloud-related costs, especially for cloud-based analytics projects,” says Kevin Petrie, VP of Research at The Eckerson Group. "By implementing FinOps programs, they can predict, measure, monitor, optimize and account for cloud-related costs related to data and analytics projects."

At the core of Unravel Data’s platform is its AI-powered Insights Engine, purpose-built for data platforms, which understands all the intricacies and complexities of each modern data platform and the supporting infrastructure to optimize efficiency and performance. The Insights Engine ingests and interprets the continuous millions of ongoing metadata streams to provide real-time insights into application and system performance, and recommendations to optimize costs and performance for operational and financial efficiencies.

Unravel 4.8.1 includes additional features, such as:

  • Recommendations for baseline and max setting for reservations
  • Scheduling insights for recurring jobs
  • SQL insights and anti-patterns
  • Recommendations for custom quotas for projects and users
  • Top-K projects, users, and jobs
  • Showback by compute and storage types, services, pricing plans, etc.
  • Chargeback by projects and users
  • Out-of-the-box and custom alerts and dashboards
  • Project/Job views of insights and details
  • Side-by-side job comparisons
  • Data KPIs, metrics, and insights such as size and number of tables and partitions, access by jobs, hot/warm/cold tables

About Unravel Data

Unravel Data radically transforms the way businesses understand and optimize the performance and cost of their modern data applications – and the complex data pipelines that power those applications. Providing a unified view across the entire data stack, Unravel’s market-leading data observability platform leverages AI, machine learning, and advanced analytics to provide modern data teams with the actionable recommendations they need to turn data into insights. A recent winner of the Best Data Tool & Platform of 2023 as part of the annual SIIA CODiE Awards, some of the world’s most recognized brands like Adobe, Maersk, Mastercard, Equifax, and Deutsche Bank rely on Unravel Data to unlock data-driven insights and deliver new innovations to market. To learn more, visit https://www.unraveldata.com.

Spotlight

Spotlight

Related News

Big Data Management

NetSuite Extends Analytics Warehouse to Help Customers Gain Greater and Faster Value from Data

PR Newswire | October 18, 2023

Oracle NetSuite today announced the latest updates to NetSuite Analytics Warehouse – the first and only AI-enabled, prebuilt cloud data warehouse and analytics solution for NetSuite customers. The latest updates will help organizations improve data management so customers can quickly build analyses to increase efficiencies and reduce costs, gain a better understanding of their customers, and leverage data to innovate and grow faster. NetSuite Analytics Warehouse is now available to customers in North America, Israel, U.K., Ireland, Spain, France, Germany, Denmark, Norway, Sweden, Netherlands, Australia, New Zealand, Mexico, Colombia, Brazil, Philippines, and Singapore. Organizations need to make sense of the vast volumes of data they create, and that can often be an extremely complex and time-consuming task, said Evan Goldberg, founder and EVP, Oracle NetSuite. NetSuite Analytics Warehouse changes all of this by bringing together data from across a multitude of applications and leveraging AI to recognize patterns and turn that data into actionable insights. Creating a single source of truth and applying the latest advancements in AI helps our customers quickly unlock value from their data and turn it into a business advantage that drives growth. Built on Oracle Analytics Cloud and Oracle Autonomous Data Warehouse (ADW), NetSuite Analytics Warehouse leverages AI to harness business data and accelerate value creation. It consolidates and centralizes data, including NetSuite transactional data, historical data, as well as data from other cloud or on-premises applications, and then guides the business user on their path to actionable insights. The latest updates to NetSuite Analytics Warehouse provide: Analytics Embedded in User Dashboards: Customers can now add links to important and frequently-used visualizations from NetSuite Analytics Warehouse to NetSuite dashboards. Customers can efficiently track key metrics and drill into charts based on NetSuite data blended with other relevant systems' data. This gives direct access to the comprehensive insights needed for data-driven decisions in the moment, without the need to toggle between applications. More Frequent Data Refreshes: New data pipeline settings give customers more current insights into their financial, sales, and inventory activity. Customers now have greater flexibility to schedule the frequency and time of data refreshes, so they can get more value from their data. Enhanced Analysis of Financial Data: The new financial analysis subject area helps customers analyze financial activity from different angles and incorporate more business systems data to identify areas for P&L improvement. The new budget subject area helps to track and adjust resource allocation with budget vs. actual scenario analysis. Deeper Insights: New line-level details enable customers to conduct analysis below summary level into key revenue-impacting subject areas like sales order and inventory activity. This provides deeper access to role-based business insights and encourages data-backed decision-making across the organization. Improved User Access Management: New Single Sign-On simplifies user authentication with a single logon to NetSuite and NetSuite Analytics Warehouse. In addition, all customers have greater flexibility applying user view and access rights to analytic content. New roles and dimensions, such as department, subsidiary, and sales territory enable a user, for example, to view a dashboard chart but not the underlying transaction detail. Customer Success with NetSuite Analytics Warehouse NetSuite Analytics Warehouse is helping organizations across industries consolidate and enhance their data with AI-backed insights. BirdRock Brands offers high-quality goods for home, outdoor, pets, kitchen, holidays, and the office. With thousands of orders each day, BirdRock uses NetSuite Analytics Warehouse to calculate and forecast profitability, track inventory in motion, and forecast warehouse capacity. "NetSuite Analytics Warehouse helps us elevate our business intelligence by delivering impactful visualizations into our business processes," said Mark Chuberka, NetSuite administrator, BirdRock Brands. "With thousands of daily orders and ever-evolving requirements for inventory, webstore development, sales, and business planning, the AI features in NetSuite Analytics Warehouse help us make more informed decisions based on patterns and customer insights." Overture Promotions helps brands build creative promotional marketing programs. Overture uses NetSuite to support its end-to-end in-house services, which span supply chain management, ecommerce, inventory management, warehousing, and packaging. "It is not enough just to have data. We need to be able to pull insights from that data to drive improved business outcomes," said Brian Lisinski, chief financial officer, Overture Promotions. "With NetSuite Analytics Warehouse, we gain predictive insights from our sales trends, channels, and product lines to inform our supply chain plans and to make proactive decisions that will increase customer satisfaction. In short, NetSuite Analytics Warehouse helps us turn data into decisions." Terlato Wine Group, a multi-generational family business that markets and distributes fine wines and artisanal spirits, is using NetSuite Analytics Warehouse to enhance decision-making and gain the insights it needs to successfully deliver premium beverages from world-class producers to customers. "Prior to using NetSuite Analytics Warehouse, we were overly reliant on spreadsheets and manually adjusting data, but as our product portfolio expanded, we knew this was not sustainable," said Chris Janes, head of integrated enterprise systems, Terlato Wine Group. "NetSuite Analytics Warehouse brings together all our data and leverages AI to provide clear insights to help us better understand sales trends and ensure resources are allocated to key growth areas. NetSuite has been a game changer and is providing the strategic insights and new features we need to stay nimble as we grow."

Read More

Data Architecture

IQVIA Earns Healthcare Leader Recognition in Data Stack Awards

IQVIA | September 18, 2023

Snowflake recognizes IQVIA as a Global Healthcare Leader in the Measurement and Attribution category as part of its annual Modern Marketing Data Stack awards. The Modern Marketing Data Stack report comprehensively analyzes data tools, applications, technologies, and processes in marketing data stacks. Orchestrated Analytics GM Tanveer Nasir expressed his gratitude for the recognition and emphasized the company's commitment to improving brand performance and patient lives through data-driven insights and solutions. Snowflake, a leading data cloud platform, has recognized IQVIA as a Global Healthcare Leader in the prestigious Measurement and Attribution category. This recognition comes as part of Snowflake's annual Modern Marketing Data Stack awards. The Modern Marketing Data Stack report is the outcome of a comprehensive year-long analysis focusing on data tools, applications, technologies, and processes employed by organizations in their marketing data stacks. This exhaustive assessment, encompassing approximately 8,100 Snowflake customers, employs a weighted scoring algorithm to discern "marketplace leaders" across diverse data-driven business functions and technology categories. The report underscores IQVIA's proficiency in aiding healthcare and life sciences organizations in the compliant utilization of extensive data resources. This enables swift and precise measurement and reporting, ultimately leading to actionable insights that facilitate informed decision-making and the formulation of effective sales and marketing strategies. In recent years, life sciences firms have significantly increased their investments in business intelligence (BI) solutions to enhance their competitiveness and performance. However, this growth has also brought forth challenges, such as analytics failing to address essential business questions, the absence of a "single source of truth" for dependable insights, and the inability to prioritize personalized prescriptive insights. IQVIA's Orchestrated Analytics platform has emerged as a preeminent solution in the industry due to its comprehensive consulting and change management approach. This approach guarantees that solutions align with specific business requirements, irrespective of the market while minimizing initial investment risks. Furthermore, the platform offers an array of self-service applications empowering business stakeholders to customize insights and extract reliable and actionable intelligence. An exceptional feature of IQVIA's Orchestrated Analytics is its extensive library of algorithms, featuring over 200 algorithms and a multitude of Key Performance Indicators (KPIs) exceeding 400, all aimed at elevating commercial impact through personalized insights for each user. The platform's user-friendly interface is complemented by embedded smart assistants, ensuring effortless access to personalized intelligence across a spectrum of business intelligence tools. IQVIA's global presence is another hallmark, with a team of over 86,000 experts operating in more than 100 countries. This expansive network accelerates the commercial impact of life sciences companies by furnishing market-relevant insights. In addition, Orchestrated Analytics is entrusted by seven out of the top ten pharmaceutical companies worldwide as they expand their brand portfolios. Tanveer Nasir, General Manager, Orchestrated Analytics, commented We are honored to be selected by Snowflake as the global leader in Measurement and Attribution in their Modern Marketing Data Stack report. [Source: IQVIA] He further explains that their insight recommendations and user adoption framework worked together effectively to enhance the sales force's efficiency and increase productivity. They had exhibited a significant ROI just by demonstrating Rx uplift for a top 10 pharmaceutical brand. Nasir conveyed that their commitment to enhancing brand performance and improving patients' lives worldwide by identifying the right customer at the right time through the correct channel and messaging continues to drive their passion.

Read More

Big Data Management

Microsoft's AI Data Exposure Highlights Challenges in AI Integration

Microsoft | September 22, 2023

AI models rely heavily on vast data volumes for their functionality, thus increasing risks associated with mishandling data in AI projects. Microsoft's AI research team accidentally exposed 38 terabytes of private data on GitHub. Many companies feel compelled to adopt generative AI but lack the expertise to do so effectively. Artificial intelligence (AI) models are renowned for their enormous appetite for data, making them among the most data-intensive computing platforms in existence. While AI holds the potential to revolutionize the world, it is utterly dependent on the availability and ingestion of vast volumes of data. An alarming incident involving Microsoft's AI research team recently highlighted the immense data exposure risks inherent in this technology. The team inadvertently exposed a staggering 38 terabytes of private data when publishing open-source AI training data on the cloud-based code hosting platform GitHub. This exposed data included a complete backup of two Microsoft employees' workstations, containing highly sensitive personal information such as private keys, passwords to internal Microsoft services, and over 30,000 messages from 359 Microsoft employees. The exposure was a result of an accidental configuration, which granted "full control" access instead of "read-only" permissions. This oversight meant that potential attackers could not only view the exposed files but also manipulate, overwrite, or delete them. Although a crisis was narrowly averted in this instance, it serves as a glaring example of the new risks organizations face as they integrate AI more extensively into their operations. With staff engineers increasingly handling vast amounts of specialized and sensitive data to train AI models, it is imperative for companies to establish robust governance policies and educational safeguards to mitigate security risks. Training specialized AI models necessitates specialized data. As organizations of all sizes embrace the advantages AI offers in their day-to-day workflows, IT, data, and security teams must grasp the inherent exposure risks associated with each stage of the AI development process. Open data sharing plays a critical role in AI training, with researchers gathering and disseminating extensive amounts of both external and internal data to build the necessary training datasets for their AI models. However, the more data that is shared, the greater the risk if it is not handled correctly, as evidenced by the Microsoft incident. AI, in many ways, challenges an organization's internal corporate policies like no other technology has done before. To harness AI tools effectively and securely, businesses must first establish a robust data infrastructure to avoid the fundamental pitfalls of AI. Securing the future of AI requires a nuanced approach. Despite concerns about AI's potential risks, organizations should be more concerned about the quality of AI software than the technology turning rogue. PYMNTS Intelligence's research indicates that many companies are uncertain about their readiness for generative AI but still feel compelled to adopt it. A substantial 62% of surveyed executives believe their companies lack the expertise to harness the technology effectively, according to 'Understanding the Future of Generative AI,' a collaboration between PYMNTS and AI-ID. The rapid advancement of computing power and cloud storage infrastructure has reshaped the business landscape, setting the stage for data-driven innovations like AI to revolutionize business processes. While tech giants or well-funded startups primarily produce today's AI models, computing power costs are continually decreasing. In a few years, AI models may become so advanced that everyday consumers can run them on personal devices at home, akin to today's cutting-edge platforms. This juncture signifies a tipping point, where the ever-increasing zettabytes of proprietary data produced each year must be addressed promptly. If not, the risks associated with future innovations will scale up in sync with their capabilities.

Read More