Business Wire | November 03, 2023
Snowflake (NYSE: SNOW), the Data Cloud company, today announced at its Snowday 2023 event new advancements that make it easier for developers to build machine learning (ML) models and full-stack apps in the Data Cloud. Snowflake is enhancing its Python capabilities through Snowpark to boost productivity, increase collaboration, and ultimately speed up end-to-end AI and ML workflows. In addition, with support for containerized workloads and expanded DevOps capabilities, developers can now accelerate development and run apps — all within Snowflake's secure and fully managed infrastructure.
“The rise of generative AI has made organizations’ most valuable asset, their data, even more indispensable. Snowflake is making it easier for developers to put that data to work so they can build powerful end-to-end machine learning models and full-stack apps natively in the Data Cloud,” said Prasanna Krishnan, Senior Director of Product Management, Snowflake. “With Snowflake Marketplace as the first cross-cloud marketplace for data and apps in the industry, customers can quickly and securely productionize what they’ve built to global end users, unlocking increased monetization, discoverability, and usage.”
Developers Gain Robust and Familiar Functionality for End-to-End Machine Learning
Snowflake is continuing to invest in Snowpark as its secure deployment and processing of non-SQL code, with over 35% of Snowflake customers using Snowpark on a weekly basis (as of September 2023). Developers increasingly look to Snowpark for complex ML model development and deployment, and Snowflake is introducing expanded functionality that makes Snowpark even more accessible and powerful for all Python developers. New advancements include:
Snowflake Notebooks (private preview): Snowflake Notebooks are a new development interface that offers an interactive, cell-based programming environment for Python and SQL users to explore, process, and experiment with data in Snowpark. Snowflake’s built-in notebooks allow developers to write and execute code, train and deploy models using Snowpark ML, visualize results with Streamlit chart elements, and much more — all within Snowflake’s unified, secure platform.
Snowpark ML Modeling API (general availability soon): Snowflake’s Snowpark ML Modeling API empowers developers and data scientists to scale out feature engineering and simplify model training for faster and more intuitive model development in Snowflake. Users can implement popular AI and ML frameworks natively on data in Snowflake, without having to create stored procedures.
Snowpark ML Operations Enhancements: The Snowpark Model Registry (public preview soon) now builds on a native Snowflake model entity and enables the scalable, secure deployment and management of models in Snowflake, including expanded support for deep learning models and open source large language models (LLMs) from Hugging Face. Snowflake is also providing developers with an integrated Snowflake Feature Store (private preview) that creates, stores, manages, and serves ML features for model training and inference.
Endeavor, the global sports and entertainment company that includes the WME Agency, IMG & On Location, UFC, and more, relies on Snowflake’s Snowpark for Python capabilities to build and deploy ML models that create highly personalized experiences and apps for fan engagement.
Snowpark serves as the driving force behind our end-to-end machine learning development, powering how we centralize and process data across our various entities, and then securely build and train models using that data to create hyper-personalized fan experiences at scale, said Saad Zaheer, VP of Data Science and Engineering, Endeavor. With Snowflake as our central data foundation bringing all of this development directly to our enterprise data, we can unlock even more ways to predict and forecast customer behavior to fuel our targeted sales and marketing engines.
Snowflake Advances Developer Capabilities Across the App Lifecycle
The Snowflake Native App Framework (general availability soon on AWS, public preview soon on Azure) now provides every organization with the necessary building blocks for app development, including distribution, operation, and monetization within Snowflake’s platform. Leading organizations are monetizing their Snowflake Native Apps through Snowflake Marketplace, with app listings more than doubling since Snowflake Summit 2023. This number is only growing as Snowflake continues to advance its developer capabilities across the app lifecycle so more organizations can unlock business impact.
For example, Cybersyn, a data-service provider, is developing Snowflake Native Apps exclusively for Snowflake Marketplace, with more than 40 customers running over 5,000 queries with its Financial & Economic Essentials Native App since June 2022. In addition, LiveRamp, a data collaboration platform, has seen the number of customers deploying its Identity Resolution and Transcoding Snowflake Native App through Snowflake Marketplace increase by more than 80% since June 2022. Lastly, SNP has been able to provide its customers with a 10x cost reduction in Snowflake data processing associated with SAP data ingestion, empowering them to drastically reduce data latency while improving SAP data availability in Snowflake through SNP’s Data Streaming for SAP - Snowflake Native App.
With Snowpark Container Services (public preview soon in select AWS regions), developers can run any component of their app — from ML training, to LLMs, to an API, and more — without needing to move data or manage complex container-based infrastructure.
Snowflake Automates DevOps for Apps, Data Pipelines, and Other Development
Snowflake is giving developers new ways to automate key DevOps and observability capabilities across testing, deploying, monitoring, and operating their apps and data pipelines — so they can take them from idea to production faster. With Snowflake’s new Database Change Management (private preview soon) features, developers can code declaratively and easily templatize their work to manage Snowflake objects across multiple environments. The Database Change Management features serve as a single source of truth for object creation across various environments, using the common “configuration as code” pattern in DevOps to automatically provision and update Snowflake objects.
Snowflake also unveiled a new Powered by Snowflake Funding Program, innovations that enable all users to securely tap into the power of generative AI with their enterprise data, enhancements to further eliminate data silos and strengthen Snowflake’s leading compliance and governance capabilities through Snowflake Horizon, and more at Snowday 2023.
Big Data Management
PR Newswire | October 31, 2023
Immuta, a data security leader, today announced the release of Immuta Discover, a new product for automated tagging and classification on cloud data platforms. Immuta Discover enables data teams to establish and maintain highly accurate metadata for the primary purpose of data access control, monitoring and regulatory compliance.
Immuta Discover automatically and continuously discovers structured data in cloud data platforms. It can also leverage existing metadata pulled from enterprise data catalogs like Alation. Leveraging all of this metadata, Immuta Discover provides visibility of all sensitive data, which is critical for building data policies to protect the data and analyzing its usage. As a core pillar of Immuta's comprehensive Data Security Platform, Immuta Discover eliminates manual, error-prone processes and helps organizations improve data security, gain full visibility into their data and unlock its value.
Discovering, tagging and classifying sensitive data with highly accurate and descriptive metadata is a critical component of a successful data security strategy. However, today's organizations are burdened with increasingly dispersed data as the number of data sources and users continues to grow. Existing solutions are not designed to tag and classify data across all of these sources with the accuracy and granularity required for security and governance. The lack of accurate metadata creates security gaps and blind spots, making it difficult to meet stringent compliance regulations.
Immuta Discover allows data teams to easily and accurately scan, classify and tag data so they can apply data control policies and monitor data access. This allows teams to gain full visibility and context into all of their data assets, and better protect and monitor their sensitive data for enhanced data security posture management. Immuta offers 60+ pre-built and domain-specific classifiers, providing organizations with the flexibility to tailor data classifications to their unique business needs and based on their desired confidence levels.
Immuta Discover is the foundational component to making any data security program work within your organization and to remain compliant, said Mo Plassnig, Chief Product Officer at Immuta. It's the first step that must happen in order to protect your data. Data is constantly changing in today's digital age. Organizations must fully understand what data they have – with accurate classification – and maintain a trustworthy inventory of sensitive data across cloud platforms in order to meet growing data security and access demands. And Immuta Discover helps our customers accomplish just this.
With Immuta Discover, customers can automatically identify and classify sensitive data by leveraging the following new capabilities:
Accurate and actionable metadata for data security – Immuta Discover provides accurate, granular metadata and actionable tags on sensitive data so users can seamlessly secure data across cloud platforms at scale. The product enables full metadata visibility into what data requires access controls and auditing. The metadata can be leveraged directly in Immuta Secure to govern the data and in Immuta Detect to monitor data access.
Agentless, multi-cloud data discovery – Immuta Discover scans and classifies data natively, with no software to install and no agent running next to the cloud data platform. The data never leaves the data platform. This approach simplifies operations and is secure and compliant, enabling data teams to be more efficient with an always up-to-date data inventory.
Out-of-the-box and customizable regulatory frameworks – Immuta Discover automatically categorizes data that is subject to leading regulatory frameworks such as CCPA, GDPR, HIPAA, or PCI, to implement compliant access control policies. These frameworks are created and maintained by Immuta's in-house Legal Engineering Team, and additionally enable customers to customize frameworks based on their interpretations of specific regulations for accelerated compliance.
"I am thrilled to see the addition and announcement of Immuta Discover to Immuta's Data Security Platform," said Sanjeev Mohan, former Gartner analyst and founder of SanjMo. "Efficiently tagging and classifying data is a critical first step in protecting it against the growing number of threats in today's data management landscape. Being able to scan data natively in the cloud data platform is an innovation that enables data discovery at scale."
Immuta offers a comprehensive Data Security Platform that enables sensitive data discovery, security and access control and activity monitoring. Immuta Discover automatically discovers and classifies sensitive data relevant to the leading regulatory frameworks. Immuta Detect adds critical user and data access behavior monitoring and auditing. And, Immuta Secure provides scalable data access control and enforcement across cloud data platforms. Together, these capabilities give customers comprehensive data security and governance for analytic workloads.
Immuta enables organizations to unlock value from their cloud data by protecting it and providing secure access. The Immuta Data Security Platform provides sensitive data discovery, security and access control, data activity monitoring, and has deep integrations with the leading cloud data platforms. Immuta is now trusted by Fortune 500 companies and government agencies around the world to secure their data. Founded in 2015, Immuta is headquartered in Boston, MA. To learn more about Immuta, click here.
Business Wire | November 02, 2023
Airbyte, creators of the fastest-growing open-source data integration platform, today announced its "Powered by Airbyte" version that enables makers of software to embed over 100 integrations into their applications – accelerating their time-to-market while increasing the focus on their core product value.
“Powered by Airbyte” removes the time-consuming task of building data integrations from scratch. Instead, using Airbyte's extensive library of connectors enables rapid data movement and synchronization between various sources and destinations. This novel approach liberates engineering teams from the burdensome task of integration development, letting them redirect their resources to building out their product's features and capabilities.
Engineering teams shouldn't need to build everything themselves, said Michel Tricot, co-founder and CEO, Airbyte. They are wasting time on integration work when they don't need to do that. Now, their data movement and integration needs are covered with Powered by Airbyte so that they can re-focus their engineering time on their product's core value proposition.
Early users of Powered by Airbyte report high satisfaction and excellent results.
Cart.com is a fast-growing provider to 6,000 brands helping them get their products in the hands of their buyers. Last year, the company helped move over $5 billion in gross merchandise value with a total of 140 million product listings. Cart utilizes Powered by Airbyte in its Unified Analytics product that helps its merchant customers to predict demand, allocate inventory and adjust advertising spending by pulling in the merchant's data from sources such as Facebook, Google Ads, Google Analytics, Hubspot, Mailchimp, Shopify, and more. The data is then consolidated in Cart’s Snowflake data warehouse with all of the integration and data movement done with Powered by Airbyte. Cart is able to offer its merchants self-service to sign up for an account, connect their data sources, connect their integrations, and begin using the product on their own.
“With Airbyte, we don’t need to worry about connectors and focus on creating value for our users instead of building infrastructure. That’s priceless,” said Chase Zieman, chief data officer, Cart. “The time and energy saved allows us to disrupt and grow faster.”
Digital marketing firm, KORTX, delivers personalized experiences for clients and custom reporting built on BigQuery and Looker. That requires centralizing all of their clients’ data from Facebook Marketing, Google Ads, Google Analytics, Hubspot and more into BigQuery so it can be analyzed. Prior to using Powered by Airbyte, data was pulled manually and put into spreadsheets and, of course, clients did not have real-time access to the data.
“Without Airbyte’s ease-of-use and library of API connectors, we would have either had to lean heavily on valuable engineering resources to build out custom connections to power our custom reporting dashboard solutions or continue with time-consuming manual reporting,” said Jeff Isreal, director of analytics at KORTX.
Damon Henry, KORTX founder and CEO, said, “With Airbyte, our team of data engineers could easily develop new connectors or customize existing ones to meet our clients' needs. The platform’s resilience and reliability mean that we can now focus more on deriving insights and less on managing data pipelines. With Airbyte as our ally, KORTX is not just meeting but exceeding client expectations, ensuring that advertising campaigns are not just effective but are also backed by data that is as robust as it is reliable.”
Airbyte makes moving data easy and affordable across almost any source and destination, helping enterprises provide their users with access to the right data for analysis and decision-making. Airbyte has the largest data engineering contributor community – with more than 800 contributors – and the best tooling to build and maintain connectors.
Pricing for Powered by Airbyte is based primarily on the number of customers syncing data through Airbyte. This makes pricing easier to forecast and more predictable than alternative solutions. Additional pricing details, and a pricing estimator can be found here.
Airbyte is the open-source data movement leader running in the safety of your cloud and syncing data from applications, APIs, and databases to data warehouses, lakes, and other destinations. Airbyte offers four products: Airbyte Open Source, Airbyte Enterprise, Airbyte Cloud, and Powered by Airbyte. Airbyte was co-founded by Michel Tricot (former director of engineering and head of integrations at Liveramp and RideOS) and John Lafleur (serial entrepreneur of dev tools and B2B). The company is headquartered in San Francisco with a distributed team around the world. To learn more, visit airbyte.com.