BIG DATA MANAGEMENT

Equifax Partners with Snowflake to Make Differentiated Data Available Through Snowflake Data Marketplace

Equifax | August 17, 2021

Equifax (NYSE: EFX) has partnered with Snowflake to make select differentiated data assets rapidly and securely available through Snowflake Data Marketplace. Snowflake Data Marketplace offers a frictionless data sharing experience with no data transfer or integration requirements, enabling data scientists, business intelligence and analytics professionals access to live and ready-to-query data from Equifax for smarter decision making. Customers can now leverage Snowflake's Data Cloud to rapidly obtain anonymized Equifax Analytic Dataset™ consumer and loan-level credit data, U.S. Consumer Credit Trends macro-level information, B2bConnect™ commercial marketing data, IXI™ economic data, and unique property and housing data for new decision intelligence.

"Equifax understands that to be successful and to achieve repeatable, profitable and sustainable business growth, our customers need to be able to make predictive and informed decisions quickly," said Joy Wilder Lybeer, United States Information Solutions (USIS) Chief Revenue Officer and Senior Vice President of Global Partnerships at Equifax. "By bringing our unique data to Snowflake Data Marketplace, we're meeting organizations with the insights they need through their channels of choice - making critical insights more easily available to more customers in a highly secure environment. "

Equifax participation in Snowflake Data Marketplace is enabled by the Equifax Cloud™, the foundation of the Equifax business. The Equifax datasets now available on Snowflake Data Marketplace include:
  • U.S. Consumer Credit Trends, for unique perspective from Equifax into anonymous, time-series credit data, specifically attributed for trending, market analysis, benchmarking and research purposes. Insights available on the Snowflake platform include consumer auto loan and lease activity, first mortgage originations and delinquencies, and student or personal loan trends.
  • Analytic Dataset, an unbiased, anonymized statistical sample of loan-level credit data representing the U.S. credit active population, enabling users to better model delinquency, default, loss severity and prepayment.
  • B2bConnect commercial marketing data, including verified firmographic information on more than 30 million U.S. businesses, such as vertical industry coding, revenues, number of employees, corporate hierarchy, and many other valuable attributes for better targeting of revenue-generating activities.
  • IXI economic data from our exclusive network of more than 95 leading financial institutions. Equifax directly measures about $20 trillion in anonymous U.S. consumer assets and investments, representing over 45 percent of all U.S. consumer invested assets. IXI data available through Snowflake includes Affluence Index™ consumer spending estimates and Income360™ household income estimates.
  • Property and housing data, including National Property Insights for a comprehensive look at public record data on residential properties across the U.S. and Housing Characteristics from County Assessor offices.

"Equifax and Snowflake share the understanding that more data enables better decisions," said Matt Glickman, VP of Customer Product Strategy, Financial Services, at Snowflake. "Snowflake Data Marketplace is designed to deliver data at scale in the Data Cloud without compromising data privacy and security. Inclusion of Equifax datasets supports Snowflake customer demand for differentiated data across industries that drives decision intelligence."

Rigorous data security, compliance and governance standards are the hallmark of Equifax participation in data marketplaces.

ABOUT EQUIFAX INC.
At Equifax (NYSE: EFX), we believe knowledge drives progress. As a global data, analytics, and technology company, we play an essential role in the global economy by helping financial institutions, companies, employers, and government agencies make critical decisions with greater confidence. Our unique blend of differentiated data, analytics, and cloud technology drives insights to power decisions to move people forward. Headquartered in Atlanta and supported by more than 12,000 employees worldwide, Equifax operates or has investments in 24 countries in North America, Central and South America, Europe, and the Asia Pacific region.

Spotlight

In this week’s Whiteboard Walkthrough, Dale Kim, Sr. Director of Industry Solutions at MapR, describes how MapR addresses the challenge of providing a persistence tier to containers in big data settings. Dale describes a new technology to support Docker containers, the MapR Persistent Application Client Container, or PACC. This lets you deploy containers anywhere, with security enabled, while also providing access to the MapR Converged Data Platform, which includes NoSQL database and streaming message transport as well as files for the persistence layer.


Other News
BIG DATA MANAGEMENT

Komprise Automates Unstructured Data Discovery with Smart Data Workflows

Komprise | May 20, 2022

Komprise, the leader in analytics-driven unstructured data management and mobility, today announced Komprise Smart Data Workflows, a systematic process to discover relevant file and object data across cloud, edge and on-premises datacenters and feed data in native format to AI and machine learning (ML) tools and data lakes. Industry analysts predict that at least 80% of the world’s data will be unstructured by 2025. This data is critical for AI and ML-driven applications and insights, yet much of it is locked away in disparate data storage silos. This creates an unstructured data blind spot, resulting in billions of dollars in missed big data opportunities. Komprise has expanded Deep Analytics Actions to include copy and confine operations based on Deep Analytics queries, added the ability to execute external functions such as running natural language processing functions via API and expanded global tagging and search to support these workflows. Komprise Smart Data Workflows allow you to define and execute a process with as many of these steps needed in any sequence, including external functions at the edge, datacenter or cloud. Komprise Global File Index and Smart Data Workflows together reduce the time it takes to find, enrich and move the right unstructured data by up to 80%. “Komprise has delivered a rapid way to visualize our petabytes of instrument data and then automate processes such as tiering and deletion for optimal savings,” says Jay Smestad, senior director of information technology at PacBio. “Now, the ability to automate workflows so we can further define this data at a more granular level and then feed it into analytics tools to help meet our scientists’ needs is a game changer.” Komprise Smart Data Workflows are relevant across many sectors. Here’s an example from the pharmaceutical industry: 1) Search: Define and execute a custom query across on-prem, edge and cloud data silos to find all data for Project X with Komprise Deep Analytics and the Komprise Global File Index. 2) Execute & Enrich: Execute an external function on Project X data to look for a specific DNA sequence for a mutation and tag such data as "Mutation XYZ". 3) Cull & Mobilize: Move only Project X data tagged with "Mutation XYZ" to the cloud using Komprise Deep Analytics Actions for central processing. 4) Manage Data Lifecycle: Move the data to a lower storage tier for cost savings once the analysis is complete. Other Smart Data Workflow use cases include: Legal Divestiture: Find and tag all files related to a divestiture project and move sensitive data to an object-locked storage bucket and move the rest to a writable bucket. Autonomous Vehicles: Find crash test data related to abrupt stopping of a specific vehicle model and copy this data to the cloud for further analysis. Execute an external function to identify and tag data with Reason = Abrupt Stop and move only the relevant data to the cloud data lakehouse to reduce time and cost associated with moving and analyzing unrelated data. “Whether it’s massive volumes of genomics data, surveillance data, IoT, GDPR or user shares across the enterprise, Komprise Smart Data Workflows orchestrate the information lifecycle of this data in the cloud to efficiently find, enrich and move the data you need for analytics projects. “We are excited to move to this next phase of our product journey, making it much easier to manage and mobilize massive volumes of unstructured data for cost reduction, compliance and business value.” Kumar Goswami, CEO of Komprise About Komprise Komprise is a provider of unstructured data management and mobility software that frees enterprises to easily analyze, mobilize, and monetize the right file and object data across clouds without shackling data to any vendor. With Komprise Intelligent Data Management, you can cut 70% of enterprise storage, backup and cloud costs while making data easily available to cloud-based data lakes and analytics tools.

Read More

BIG DATA MANAGEMENT

J.D. Power Acquires We Predict Data and Predictive Analytics Business

J.D. Power | June 06, 2022

J.D. Power, a global leader in data analytics and customer intelligence, today announced that it has acquired the data and predictive analytics business of We Predict, the UK-based provider of global automobile service and warranty analytics. We Predict’s software, which is used by auto manufacturers and suppliers to project future component failures and future warranty claims and costs, will be leveraged by J.D. Power to enhance its vehicle quality and dependability analytics, expand repair cost forecasting and provide critical valuation data. “Robust data and powerful analytics that help manufacturers, suppliers and consumers better predict future repair costs are a key link in the auto industry value chain that will only become more important as fleets of new electric vehicles start rolling off the assembly line,” said Dave Habiger, president and CEO of J.D. Power. “By augmenting our existing offerings with We Predict’s forecasting software, we will be able to deliver a more complete, detailed view of repair-related costs to better anticipate financial risk exposures.” “As the automobile industry enters a phase of massive transformation in which electric vehicles and ever-more complex technologies are rapidly becoming the norm, warranty claims and repair costs are a critical variable for manufacturers and suppliers to incorporate into their forecasting. “By incorporating We Predict’s comprehensive data and powerful analytics into our vehicle quality, dependability and valuation platforms, we will be able to create the industry’s most robust and accurate view of future warranty claims and repair costs.” Doug Betts, president of the global automotive division at J.D. Power We Predict software uses machine learning and predictive analytics to develop detailed projections of future warranty claims and repair costs for the global automobile industry. Drawing on a database of billions of service records, We Predict can accurately forecast true vehicle ownership costs, residual values, repair and warranty claims costs and more. “J.D. Power invented the idea of using data and analytics to evaluate vehicle quality and dependability, so the opportunity to become a part of that team and bring our software and operational data into the offering is enormously exciting to all of us at We Predict,” said James Davies, We Predict CEO. “The industry and consumers need accurate repair cost forecasting now more than ever and we look forward to being the leader in delivering those solutions.” Davies will become vice president of repair analytics and data at J.D. Power. We Predict will become part of the global automotive division at J.D. Power. About J.D. Power J.D. Power is a global leader in consumer insights, advisory services and data and analytics. A pioneer in the use of big data, artificial intelligence (AI) and algorithmic modeling capabilities to understand consumer behavior, J.D. Power has been delivering incisive industry intelligence on customer interactions with brands and products for more than 50 years. The world's leading businesses across major industries rely on J.D. Power to guide their customer-facing strategies. About We Predict Formed in 2009, We Predict uses machine learning and unique predictive methodologies to assist global blue-chip customers in anticipating and accelerating decisions on product, on market, as well as on financial performance. Our top-notch data scientists, mathematicians, computer scientists and industry experts work together with our clients to explore and gain new insights into where your business is headed, creating the opportunity to course-correct with confidence. Using our service, clients gain insights into huge amounts of data at the touch of a button so they can take action—fast. Some guess, we know.

Read More

BIG DATA MANAGEMENT

Qlik Expands Real-Time Data Integration and Cloud Analytics Services for Snowflake

Qlik | June 16, 2022

Qlik® today announced multiple new and enhanced capabilities that will help customers maximize the value of their investment in Snowflake Data Cloud. These services expand the ability to both seamlessly feed Snowflake with near real-time data and more easily access data in real-time and action it for decision making across the enterprise. “Customers are looking to augment their investment in Snowflake with services that accelerate the access and availability of near real-time data for modern analytics. “We are excited about Qlik’s latest SaaS platform integrations with Snowflake, which can make it easier for customers to leverage near real-time data through Snowflake to improve decision-making across the organization with up-to-date insights.” Tarik Dwiek, Head of Technology Alliances of Snowflake “Since the start of our collaboration with Qlik and Snowflake, we’ve seen some immense results. By moving the database to the cloud and having it work with Qlik's automated solutions, we can unlock new data sources in our data warehouse within five days, instead of 20, and create new incremental data marts in days rather than weeks. We also achieved a 75% cost reduction on ETL development,” said Maikel Jaspers, BI Engineer at Ewals Cargo Care. “Now not only can we run reports more efficiently, but we can also fulfil more requests. This has given us more agility, and ultimately makes the entire company much more effective, something we've been striving to do for a very long time.” Qlik enhanced its Cloud Analytics Services for Snowflake with two new features that help customers drive more value from near real-time data when deploying Qlik’s cloud platform with Snowflake. Direct Query enables users to automatically generate pushdown SQL to query Snowflake on demand from within Qlik Sense. This combines the ability to optimize Snowflake queries with immediate access to the most recent data, while allowing for the creation of best-in-class visualizations and dashboards in Qlik Sense. Qlik’s FinOps and query optimization analytic applications expand on Qlik’s existing Snowflake usage dashboards and provide CDOs and data leaders with a comprehensive understanding of what is driving Snowflake usage and how to best optimize Snowflake workloads to improve the user experience. Qlik also released new and enhanced Qlik Cloud Data Services capabilities for Snowflake, including: Real-time change data capture and movement to Snowflake including major databases, SAP, mainframe and SaaS applications. Data warehouse automation for model-driven code generation, which dramatically reduces the time, cost, and risk to realize the full potential of Snowflake. Reverse ETL to replicate enriched data from the Snowflake platform back to the operational systems of record. At QlikWorld, Qlik’s recent customer and partner event, industry leaders such as ABB, Best Buy Canada, CSS, Harman, Novartis, SDI and Urban Outfitters showcased how they leverage Qlik solutions with Snowflake to activate data for insights and action. ABB demonstrated how they combine Qlik Data Integration to feed Snowflake with SAP and other data sources to unlock the hidden value of data at scale and help create deeper insights faster. Best Buy Canada showed how they partnered with Accenture, Qlik and Snowflake to accelerate the delivery of the initial phase of a multi-phased data ecosystem modernization journey in the cloud. CSS outlined how they built a modern cloud data lakehouse with near real-time data ingestion and fully automated creation of analytics structures for rapid business insights by using Qlik Data Integration with Snowflake. SDI showcased ZEUS, their MRO technology platform, which digitizes a portion of the supply chain by leveraging Qlik and Snowflake to uniquely summarize activity for any supply chain manager. “We’re seeing continued customer success and growth in demand to leverage Qlik and Snowflake together to advance cloud data analytics strategies,” said Itamar Ankorion, SVP of Technology Alliances at Qlik. “These recent new features and enhancements, including Direct Query capabilities and Cloud Data Integration Services, are part of our continued investments to innovate and help customers accelerate time to value and drive more insights and action from their data.” About Qlik Qlik’s vision is a data-literate world, where everyone can use data and analytics to improve decision-making and solve their most challenging problems. A private company, Qlik offers real-time data integration and analytics solutions, powered by Qlik Cloud, to close the gaps between data, insights and action. By transforming data into Active Intelligence, businesses can drive better decisions, improve revenue and profitability, and optimize customer relationships. Qlik serves more than 38,000 active customers in over 100 countries.

Read More

DATA ARCHITECTURE

Skyflow Launches Integration to Build Privacy and Data Protection into the Snowflake Data Cloud

Skyflow | June 17, 2022

Skyflow, the Data Privacy Vault company, announced a new integration with Snowflake, the Data Cloud company, at Snowflake Summit 2022. Now, Snowflake customers can quickly and easily integrate Skyflow to isolate sensitive information being shared in the Snowflake Data Cloud and secure it using Skyflow’s Data Privacy Vault. Customers can still query and share sensitive data while it remains protected using the vault, which insulates the application stack and reduces the overall compliance scope. What if privacy had an API? Building data privacy infrastructure from scratch or pulling together piecemeal solutions can take a significant amount of time and resources. Skyflow’s API was built so that companies can be up and running with world-class data privacy infrastructure in hours. “Companies that depend on data often handle PII, but building infrastructure to protect that sensitive data is too often an afterthought. “With Skyflow and Snowflake, teams can unlock the power of data while reducing the time, money, and resources historically spent on privacy.” Tarik Dwiek, Head of Technology Alliances at Snowflake Every company should prioritize privacy as they build to keep sensitive data out of unnecessary workflows and data streams. The risk of a security breach and the cost of breaking customer trust becomes amplified in highly regulated industries, like fintech and digital health. Skyflow radically simplifies how companies manage, access and govern sensitive PII data, and with dedicated fintech and healthtech data vaults, PHI and PCI-regulated data can be protected as well. Global Data Residency and Data Protection for Customer Data Both startups and enterprises across verticals can benefit from Skyflow’s scalable and customizable approach to privacy. The zero-trust vaults with a simple and elegant API can be deployed anywhere in the world, allowing developers to quickly build applications and workflows without worrying about data privacy, compliance or residency. Sensitive information can be stored in a specific geolocation to help teams achieve data residency requirements related to GDPR, DCIA, LGPD, PDPA, and Skyflow’s solution can drastically reduce the amount of time and resources needed to achieve compliance with standards like PCI DSS and HIPAA. “Skyflow is partnering with Snowflake to simplify how developers and CIOs solve for data protection. This is key in a world where privacy is becoming a top priority for users and regulators globally,” says Anshu Sharma, CEO of Skyflow. “Together, Snowflake and Skyflow can help customers put privacy first so they can focus on their core products.” About Skyflow Founded in 2019, Skyflow is a data privacy vault for sensitive data. Our founders wanted to radically transform how businesses handle their users’ financial, healthcare and other personal data -- the data that powers the digital economy. Inspired by the data vaults that leaders like Apple and Netflix built to handle customer data, our vision was to deliver the same kind of data privacy vault as a simple and elegant API, something any developer could easily build into their application, the same way they use Stripe, Twilio, or Okta. Skyflow is based in Palo Alto, California, with offices in Bangalore, India

Read More

Spotlight

In this week’s Whiteboard Walkthrough, Dale Kim, Sr. Director of Industry Solutions at MapR, describes how MapR addresses the challenge of providing a persistence tier to containers in big data settings. Dale describes a new technology to support Docker containers, the MapR Persistent Application Client Container, or PACC. This lets you deploy containers anywhere, with security enabled, while also providing access to the MapR Converged Data Platform, which includes NoSQL database and streaming message transport as well as files for the persistence layer.

Resources