DATA ARCHITECTURE

Databricks Launches Data Lakehouse for Retail and Consumer Goods Customers

Databricks | January 14, 2022

Databricks, the Data and AI company and pioneer of the data lakehouse architecture, today announced the Databricks Lakehouse for Retail, the company's first industry-specific data lakehouse for retailers and consumer goods (CG) customers. With Databricks' Lakehouse for Retail, data teams are enabled with a centralized data and AI platform that is tailored to help solve the most critical data challenges that retailers, partners, and their suppliers are facing. Early adopters of Databricks' Lakehouse for Retail include industry-leading customers and partners like  Walgreens, Columbia, H&M Group, Reckitt, Restaurant Brands International, 84.51°(a subsidiary of Kroger Co.), Co-Op Food, Gousto, Acosta and more.

"As the retail and healthcare industries continue to undergo transformative change, Walgreens has embraced a modern, collaborative data platform that provides a competitive edge to the business and, most importantly, equips our pharmacists and technicians with timely, accurate patient insights for better healthcare outcomes," said Luigi Guadagno, Vice President, Pharmacy and HealthCare Platform Technology at Walgreens. "With hundreds of millions of prescriptions processed by Walgreens each year, Databricks' Lakehouse for Retail allows us to unify all of this data and store it in one place for a full range of analytics and ML workloads. By eliminating complex and costly legacy data silos, we've enabled cross-domain collaboration with an intelligent, unified data platform that gives us the flexibility to adapt, scale and better serve our customers and patients."

"Databricks has always innovated on behalf of our customers and the vision of lakehouse helps solve many of the challenges retail organizations have told us they're facing," said Ali Ghodsi, CEO and Co-Founder at Databricks. "This is an important milestone on our journey to help organizations operate in real-time, deliver more accurate analysis, and leverage all of their customer data to uncover valuable insights. Lakehouse for Retail will empower data-driven collaboration and sharing across businesses and  partners in the retail industry."

Databricks' Lakehouse for Retail delivers an open, flexible data platform, data collaboration and sharing, and a collection of powerful tools and partners for the retail and consumer goods industries. Designed to jumpstart the analytics process, new Lakehouse for Retail Solution Accelerators offer a blueprint of data analytics and machine learning use cases and best practices to save weeks or months of development time for an organization's data engineers and data scientists. Popular solution accelerators for Databricks' Lakehouse for Retail customers include:

  • Real-time Streaming Data Ingestion: Power real-time decisions critical to winning in omnichannel retail with point-of-sale, mobile application, inventory and fulfillment data.
  • Demand forecasting and time-series forecasting: Generate more accurate forecasts in less time with fine-grained demand forecasting to better predict demand for all items and stores.
  • ML-powered recommendation engines: Specific recommendations models for every stage of the buyer journey - including neural network, collaborative filtering, content-based recommendations and more - enable retailers to create a more personalized customer experience.
  • Customer Lifetime Value: Examine customer attrition, better predict behaviors of churn, and segment consumers by lifetime and value with a collection of customer analytics accelerators to help improve decisions on product development and personalized promotions.

Additionally, industry-leading Databricks partners like Deloitte and Tredence are driving lakehouse vision and value by delivering pre-built analytics solutions on the lakehouse platform that address real-time customer use cases. Tailor-made for the retail industry, featured partner solutions and platforms include:

  • Deloitte's Trellis solution accelerator for the retail industry is one of many examples of how Deloitte and client partners are adopting the Databricks Lakehouse architecture construct and platform to deliver end-to-end data and AI/ML capabilities in a simple, holistic, and cost-effective way. Trellis provides capabilities that solve retail clients' complex challenges around forecasting, replenishment, procurement, pricing, and promotion services. Deloitte has leveraged their deep industry and client expertise to build an integrated, secured, and multi-cloud ready "as-a-service" solution accelerator on top of Databricks' Lakehouse platform that can be rapidly customized as appropriate based on client's unique needs. Trellis has proven to be a game-changer for our joint clients as it allows them to focus on the critical shifts occurring both on the demand and supply side with the ability to assess recommendations, associated impact, and insights in real-time that result in significant improvement to both topline and bottom line numbers.
  • Tredence will meet the explosive enterprise Data, AI & ML demand and deliver real-time transformative industry value for their business by delivering solutions for Lakehouse for Retail. The partnership first launched the On-Shelf Availability Solution (OSA) accelerator in August 2021, combining Databricks' data processing capability and Tredence's AI/ML expertise to enable Retail, CPG & Manufacturers to solve their trillion dollar out-of-stock challenge. Now with Lakehouse for Retail, Tredence and Databricks will jointly expand the portfolio of industry solutions to address other customer challenges and drive global scale together.

About Databricks
Databricks is the data and AI company. More than 5,000 organizations worldwide — including Comcast, Condé Nast, H&M, and over 40% of the Fortune 500 — rely on the Databricks Lakehouse Platform to unify their data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe. Founded by the original creators of Apache Spark™, Delta Lake and MLflow, Databricks is on a mission to help data teams solve the world's toughest problems.

Spotlight

This report stemmed from a World Bank pilot activity to explore the potential of big data to address development challenges in Central American countries. As part of this activity we collected and analyzed a number of examples of leveraging big data for development. Because of the growing interest in this topic this report makes available to a broader audience those examples as well as the underlying conceptual framework to think about big data for development.


Other News
BUSINESS INTELLIGENCE,BIG DATA MANAGEMENT

ActionIQ Launches HybridCompute, Empowering IT Leaders to Build Composable Customer Data Stacks

ActionIQ | September 14, 2022

ActionIQ, the leader in customer experience (CX) solutions that deliver actionable insight from customer data, today announced the launch of HybridCompute, a new feature of the AIQ InfiniteCompute technology that removes the requirement to replicate and move data, allowing enterprise IT teams to unbundle their customer data stack and take full control over where data is stored and queried. The AIQ CX Hub with HybridCompute now seamlessly integrates directly on top of cloud data lakes, helping enterprise IT teams maximize the value of existing technology investments, while empowering business users with drag and drop simplicity. . InfiniteCompute is the data infrastructure technology that delivers unlimited computational power, making it possible for AIQ to manage and process more data than any other solution available. And with the addition of HybridCompute, InfiniteCompute can query data stored across multiple systems, enabling analytics anywhere data lives and post-processing that provides a consistent view of data across the entire AIQ CX Hub. "AIQ's mission has always been to empower IT and business leaders to orchestrate personalized customer experiences at scale, and we've approached innovations in infrastructure as a key enabler to that. "However, a lot has changed in data infrastructure space over the last 8 years since we started on that mission. Many companies have made investments to consolidate their customer data into a cloud data lake, and the gap to leveraging that data is less on data unification and more on simplified business access." Justin DeBrabant, Senior Vice President of Product at AIQ "We want to meet our customers wherever they are on their data infrastructure journey, and help them generate greater value on those investments by providing them scalable storage and compute infrastructure when they need it, or the ability to query the data where it is with HybridCompute if they've already done the work of data unification. And importantly, they won't need to choose all of one or the other, as InfiniteCompute will span seamlessly across any of these systems," he continued. The AIQ CX Hub with HybridCompute gives enterprise IT teams the ability to unbundle their customer data stack, significantly streamlining resources, increasing flexibility, generating greater value on IT investments and driving accelerated CX transformation. "By 2024, 80% of CIOs surveyed will list modular business redesign through composability, as a top-five reason for accelerated business performance," cites "Predicts 2022: Composable Applications Accelerate Digital Business" a Gartner® report published Dec. 1, 2021. The report goes on to say, "Composable digital business will use digital resources to cope with the rapid pace of business change, unfamiliar risks, diversifying customer expectations, and business, economic, societal and other uncertainties." See also related announcements today and this week on partnerships with Databricks, Snowflake and Teradata to integrate HybridCompute and maximize value of existing investments. Enterprise brands such as Autodesk, M&T Bank, The New York Times, Neiman Marcus, Hertz and many more use the AIQ CX Hub to drive growth through extraordinary customer experiences. About ActionIQ AIQ brings order to CX chaos. Our Customer Experience Hub empowers everyone to be a CX champion by giving business teams the freedom to explore and action on customer data while helping technical teams extend and enhance existing technology investments to manage data governance, costs and performance. Enterprise brands such as Autodesk, M&T Bank, The New York Times, Neiman Marcus, Hertz and many more use our CX Hub to drive growth through extraordinary customer experiences.

Read More

BUSINESS INTELLIGENCE,BIG DATA MANAGEMENT

Variphy Releases Software Version 13.0

Variphy | September 20, 2022

Variphy, the preferred Cisco Unified Collaboration reporting and analytics software solution for over 1,500 businesses, announced today the release of Variphy 13.0, its latest software version. "Our latest release delivers features allowing for an even faster and more streamlined reporting experience with greatly improved scalability," Derek Falter, director of product development, said. "With the addition of Multi-Database Reporting, Auto-Archiving, and Audible Alerts, we make it easier to monitor and report on CUCM, UCCX, and CUBE activities." Variphy 13.0 core feature enhancements include: CDR Auto Database Archiving & Multi-Database Support Variphy overhauled CUCM and CUBE configuration UIs to isolate CDR-specific settings and activation. Auto Database Archiving allows the archive databases to be automatically created for an even more seamless reporting process. Scheduled Call Analytics Report Queueing The update includes a new application setting to determine the maximum number of reports executed simultaneously. CCX CSQ Widget Threshold Audible Alerts An audible alert will be triggered when a configured threshold is breached. The flexible audio configuration is designed to fit any purpose. Report on Individual CUBE Events Variphy 13.0 features the ability to build CUBE CDR reports, widgets, and searches based on individual events. Pill select input was included to allow clients to focus their CDR output on individual events or sequences. Active Directory Authentication Improvements The Active Directory Server form has been updated to include fields to capture an Active Directory Distinguished Name User and Password. CUBE CDR Monitoring CUBE CDR Monitoring alerts users if Variphy does not receive a minimum number of CDRs from CUBE in the previous hour. The update includes other application settings and improvements for seamless monitoring and reporting. Email alerts, CUBE CDR processing, and widget settings are among the enhancements available. Variphy 13.0 is just the latest version in the company's tradition of consistently delivering software updates and new products. Updates are always free for existing users. About Variphy Variphy creates leading-edge UC tools and analytics software solutions to streamline the service delivery and management of Cisco Unified Communications and Collaboration. Since 2004, it has helped over 1,500 organizations visualize, search, analyze, and report on their Cisco UC environments. Product development, sales and marketing, service delivery, and support teams are based in the United States.

Read More

BUSINESS INTELLIGENCE,BIG DATA MANAGEMENT

Alation Named Market Leader in BARC Score Data Intelligence Platforms Report

Alation | September 02, 2022

Alation Inc., the leader in enterprise data intelligence solutions, has been named a Market Leader in the inaugural BARC Score Data Intelligence Platforms report, recognizing the company’s convincing market execution and strong year-over-year global growth trajectory. The report underscores Alation’s demonstrated ability to help enterprises create a data culture where anyone can find, understand, and trust data. The BARC Score Data Intelligence Platforms report evaluates the most important international vendors of modern data intelligence platforms based on an extensive criteria catalog and customer evaluations. As a pioneer in categories including Metadata Management, Data Governance, and Data Cataloging, Alation is now a forerunner in Data Intelligence, a category that combines a range of different data components in a broader market space. Similar to how data fabric helps stitch together an organization’s business data landscape, BARC defines Agile Data Intelligence as the corresponding fabric for metadata. The report assesses vendors via comprehensive scores based on a detailed set of criteria, including the product’s global reach, the company’s total revenue, the product’s functionality as an independent data catalog, and data governance capabilities. As reported in the BARC Data Intelligence Platforms report, Alation: Has experienced a strong year-over-year global growth trajectory, particularly in EMEA and APAC, where the company is expected to continue expanding its partner network. Delivers a strong product strategy and roadmap, evidenced by the launch of Alation Cloud Service for Snowflake, a new offering that enables organizations of all sizes to catalog and govern data on Snowflake’s platform. Demonstrates a clear ability to share crowd-sourced wisdom, driving greater confidence in analytics and AI/ML by connecting every individual to governed, high-quality data and each other. Provides support for behavioral metadata, which offers an additional valuable resource on how metadata is handled across an organization. “A data intelligence platform lays the foundation for organizations creating a data culture, and empowering anyone in the business to find, understand, and trust data. “We’re proud to be recognized as a market leader by the BARC Score Data Intelligence Platforms report. Alation helps more than 400 enterprises get the most value from their data, and that’s why we are consistently recognized by top industry analyst firms. As Alation continues to expand globally, we’re excited to support organizations as they overcome their data challenges and drive widespread engagement and adoption of trusted data.” Satyen Sangani, CEO and co-founder at Alation “Organizations are understanding the significant value and benefits that data intelligence platforms provide,” said Timm Grosser, Senior Analyst Data and Analytics at BARC. “Upon analyzing the market, Alation was selected as a clear leader in the Data Intelligence Platforms report for their demonstrated ability to help customers accelerate data governance, organize business-valuable data, and choose from the data that meets their needs. Alation has refined and mastered catalog capabilities while expanding to support data collaboration, data governance, and automation offerings, catalyzing the shift toward a data-driven approach to business.” BARC describes data intelligence as “a smart and automated approach to extract, collect, and connect expert knowledge to get business value,” of which Alation expertly executes through the marriage of data intelligence and human brilliance. The report explicitly addresses data intelligence platforms, covering three main areas of focus: smart and automated extraction, collection and cross-linking of siloed, disparate metadata sources; smart support of human and machine-driven metadata curation and crowdsourcing; and smart and flexible metadata analysis to provide augmented and automated support for the needs of diverse user roles. This report follows Alation recently being named to the Constellation ShortList™ for Metadata Management, Data Cataloging, and Data Governance in Q3 2022 for the third consecutive year; recognized as a leader in the IDC MarketScape: Worldwide Data Catalog Software 2022 Vendor Assessment for the second successive year; named a top vendor in the Dresner Advisory Services’ 2022 Wisdom of Crowds Data Catalog Market Study for the sixth consecutive year; and recognized as Data Governance Partner of the Year by Snowflake, the Data Cloud company, for the second consecutive year. About Alation Alation is the leader in enterprise data intelligence solutions, including data search & discovery, data governance, data stewardship, analytics, and digital transformation. Alation’s initial offering dominates the data catalog market. Thanks to its powerful Behavioral Analysis Engine, inbuilt collaboration capabilities, and open interfaces, Alation combines machine learning with human insight to successfully tackle even the most demanding challenges in data and metadata management. More than 400 enterprises drive data culture, improve decision making, and realize business outcomes with Alation, including AbbVie, Allianz Global Investors, American Family Insurance, Autozone, Cisco, Draft Kings, Exelon, Fifth Third Bank, Finnair, General Mills, Munich Re, NASDAQ, Parexel, Pfizer, Salesforce, Virgin Australia, and Vistaprint.

Read More

BIG DATA MANAGEMENT

VAST Data Accelerates CeGaT Genetic Data Analytics, Delivering Medical Insights Significantly Faster Than Competing Hybrid Storage Solution

VAST Data | July 29, 2022

VAST Data, the data platform company for the AI-powered world, today announced the company was selected by CeGaT to accelerate time-to-insight for genetic analytics essential to diagnostic healthcare, genetic research and pharmaceutical discovery. VAST’s high-capacity all-flash data platform replaces CeGaT's legacy hard-drive-based solutions, which constrained the company's genome sequencing application pipeline due to scale and performance limitations. Genome sequencing and genetic data analysis are crucial to discovering biomarkers that help doctors and scientists understand how specific diseases, such as cancer and diabetes, are formed. As genetics has evolved from the laboratory into diagnostic environments, these tools can now facilitate clinical decision-making to assist with advanced patient illness detection and make personalized medicine possible. Clinical genetics has enhanced patient care and is now an instrumental component of disease prevention and specialized targeted treatment. Since 2009, CeGaT has been helping doctors and patients find the genetic causes of rare diseases. Today, each of CeGaT’s genome sequencers generates up to five terabytes (TB) of data. This data must be collected, analyzed and interpreted quickly and accurately. When CeGaT recognized that its existing hybrid flash + HDD storage system couldn't keep up with growing demands for speed, volume and scalability, the company turned to VAST Data’s Universal Storage data platform. VAST’s Disaggregated and Shared Everything (DASE) architecture is a revolutionary leap in system scale, performance and resiliency. It brings the simplicity needed to support any scale of genomic data discovery, laying the foundation for the future of CeGaT’s ambitious growth strategy. Since deploying VAST, CeGaT’s ability to process genomic data through its pipeline has accelerated significantly, resulting in new compute hardware efficiency, savings and improvement to CeGaT’s overall business agility. “To support our scientific and healthcare agenda, we’re constantly pioneering new ways to extract new insights from larger and larger datasets. “When we began our search for new data infrastructure, we decided that our mission-critical business would not compromise on scale or uptime. VAST Data’s Universal Storage is an always-on platform that can easily scale with our data program. The system is fast, too. The improvement to our pipeline allows us to take on more work within the same infrastructure envelope, saving us money while also driving science forward and furthering data-intensive methods of scientific discovery.” Tim Scheurenbrand, IT director at CeGaT CeGaT can realize the vision of an all-flash data center, without incurring exorbitant all-flash storage costs. Universal Storage combines the high performance, low-latency and capacity of hyperscale all-flash storage with novel storage efficiency algorithms to make all-flash infrastructure affordable for ever-increasing datasets. “We chose VAST because the Universal Storage concept completely won us over,” added Scheurenbrand. “With VAST we get a highly performant all-flash system for the price of a less powerful hybrid storage system.” “CeGaT is committed to pushing the scientific boundaries of gene diagnostics, helping healthcare providers find the fastest path to patient therapy. With CeGaT, we are able to showcase the distinctive performance capabilities of our architecture and contribute to life-changing research. Ultimately, it’s about using technology for faster detection, prevention and personalized treatment plans, all in the pursuit of creating a healthier world. And that is a powerful reminder of why we do what we do,” said Peter Gadd, Vice President, International at VAST Data. About VAST Data VAST Data delivers the data platform at the heart of the AI-powered world, accelerating time-to-insight for workload-intensive applications. The performance, scalability, ease of use and cost efficiencies of VAST's software helps enterprise organizations overcome the historic barriers to building all-flash data centers. Launched in 2019, VAST is the fastest-selling data infrastructure startup in history.

Read More

Spotlight

This report stemmed from a World Bank pilot activity to explore the potential of big data to address development challenges in Central American countries. As part of this activity we collected and analyzed a number of examples of leveraging big data for development. Because of the growing interest in this topic this report makes available to a broader audience those examples as well as the underlying conceptual framework to think about big data for development.

Resources