Big Data Management
PR Newswire | October 31, 2023
Immuta, a data security leader, today announced the release of Immuta Discover, a new product for automated tagging and classification on cloud data platforms. Immuta Discover enables data teams to establish and maintain highly accurate metadata for the primary purpose of data access control, monitoring and regulatory compliance.
Immuta Discover automatically and continuously discovers structured data in cloud data platforms. It can also leverage existing metadata pulled from enterprise data catalogs like Alation. Leveraging all of this metadata, Immuta Discover provides visibility of all sensitive data, which is critical for building data policies to protect the data and analyzing its usage. As a core pillar of Immuta's comprehensive Data Security Platform, Immuta Discover eliminates manual, error-prone processes and helps organizations improve data security, gain full visibility into their data and unlock its value.
Discovering, tagging and classifying sensitive data with highly accurate and descriptive metadata is a critical component of a successful data security strategy. However, today's organizations are burdened with increasingly dispersed data as the number of data sources and users continues to grow. Existing solutions are not designed to tag and classify data across all of these sources with the accuracy and granularity required for security and governance. The lack of accurate metadata creates security gaps and blind spots, making it difficult to meet stringent compliance regulations.
Immuta Discover allows data teams to easily and accurately scan, classify and tag data so they can apply data control policies and monitor data access. This allows teams to gain full visibility and context into all of their data assets, and better protect and monitor their sensitive data for enhanced data security posture management. Immuta offers 60+ pre-built and domain-specific classifiers, providing organizations with the flexibility to tailor data classifications to their unique business needs and based on their desired confidence levels.
Immuta Discover is the foundational component to making any data security program work within your organization and to remain compliant, said Mo Plassnig, Chief Product Officer at Immuta. It's the first step that must happen in order to protect your data. Data is constantly changing in today's digital age. Organizations must fully understand what data they have – with accurate classification – and maintain a trustworthy inventory of sensitive data across cloud platforms in order to meet growing data security and access demands. And Immuta Discover helps our customers accomplish just this.
With Immuta Discover, customers can automatically identify and classify sensitive data by leveraging the following new capabilities:
Accurate and actionable metadata for data security – Immuta Discover provides accurate, granular metadata and actionable tags on sensitive data so users can seamlessly secure data across cloud platforms at scale. The product enables full metadata visibility into what data requires access controls and auditing. The metadata can be leveraged directly in Immuta Secure to govern the data and in Immuta Detect to monitor data access.
Agentless, multi-cloud data discovery – Immuta Discover scans and classifies data natively, with no software to install and no agent running next to the cloud data platform. The data never leaves the data platform. This approach simplifies operations and is secure and compliant, enabling data teams to be more efficient with an always up-to-date data inventory.
Out-of-the-box and customizable regulatory frameworks – Immuta Discover automatically categorizes data that is subject to leading regulatory frameworks such as CCPA, GDPR, HIPAA, or PCI, to implement compliant access control policies. These frameworks are created and maintained by Immuta's in-house Legal Engineering Team, and additionally enable customers to customize frameworks based on their interpretations of specific regulations for accelerated compliance.
"I am thrilled to see the addition and announcement of Immuta Discover to Immuta's Data Security Platform," said Sanjeev Mohan, former Gartner analyst and founder of SanjMo. "Efficiently tagging and classifying data is a critical first step in protecting it against the growing number of threats in today's data management landscape. Being able to scan data natively in the cloud data platform is an innovation that enables data discovery at scale."
Immuta offers a comprehensive Data Security Platform that enables sensitive data discovery, security and access control and activity monitoring. Immuta Discover automatically discovers and classifies sensitive data relevant to the leading regulatory frameworks. Immuta Detect adds critical user and data access behavior monitoring and auditing. And, Immuta Secure provides scalable data access control and enforcement across cloud data platforms. Together, these capabilities give customers comprehensive data security and governance for analytic workloads.
Immuta enables organizations to unlock value from their cloud data by protecting it and providing secure access. The Immuta Data Security Platform provides sensitive data discovery, security and access control, data activity monitoring, and has deep integrations with the leading cloud data platforms. Immuta is now trusted by Fortune 500 companies and government agencies around the world to secure their data. Founded in 2015, Immuta is headquartered in Boston, MA. To learn more about Immuta, click here.
Business Wire | November 03, 2023
Snowflake (NYSE: SNOW), the Data Cloud company, today announced at its Snowday 2023 event new advancements that make it easier for developers to build machine learning (ML) models and full-stack apps in the Data Cloud. Snowflake is enhancing its Python capabilities through Snowpark to boost productivity, increase collaboration, and ultimately speed up end-to-end AI and ML workflows. In addition, with support for containerized workloads and expanded DevOps capabilities, developers can now accelerate development and run apps — all within Snowflake's secure and fully managed infrastructure.
“The rise of generative AI has made organizations’ most valuable asset, their data, even more indispensable. Snowflake is making it easier for developers to put that data to work so they can build powerful end-to-end machine learning models and full-stack apps natively in the Data Cloud,” said Prasanna Krishnan, Senior Director of Product Management, Snowflake. “With Snowflake Marketplace as the first cross-cloud marketplace for data and apps in the industry, customers can quickly and securely productionize what they’ve built to global end users, unlocking increased monetization, discoverability, and usage.”
Developers Gain Robust and Familiar Functionality for End-to-End Machine Learning
Snowflake is continuing to invest in Snowpark as its secure deployment and processing of non-SQL code, with over 35% of Snowflake customers using Snowpark on a weekly basis (as of September 2023). Developers increasingly look to Snowpark for complex ML model development and deployment, and Snowflake is introducing expanded functionality that makes Snowpark even more accessible and powerful for all Python developers. New advancements include:
Snowflake Notebooks (private preview): Snowflake Notebooks are a new development interface that offers an interactive, cell-based programming environment for Python and SQL users to explore, process, and experiment with data in Snowpark. Snowflake’s built-in notebooks allow developers to write and execute code, train and deploy models using Snowpark ML, visualize results with Streamlit chart elements, and much more — all within Snowflake’s unified, secure platform.
Snowpark ML Modeling API (general availability soon): Snowflake’s Snowpark ML Modeling API empowers developers and data scientists to scale out feature engineering and simplify model training for faster and more intuitive model development in Snowflake. Users can implement popular AI and ML frameworks natively on data in Snowflake, without having to create stored procedures.
Snowpark ML Operations Enhancements: The Snowpark Model Registry (public preview soon) now builds on a native Snowflake model entity and enables the scalable, secure deployment and management of models in Snowflake, including expanded support for deep learning models and open source large language models (LLMs) from Hugging Face. Snowflake is also providing developers with an integrated Snowflake Feature Store (private preview) that creates, stores, manages, and serves ML features for model training and inference.
Endeavor, the global sports and entertainment company that includes the WME Agency, IMG & On Location, UFC, and more, relies on Snowflake’s Snowpark for Python capabilities to build and deploy ML models that create highly personalized experiences and apps for fan engagement.
Snowpark serves as the driving force behind our end-to-end machine learning development, powering how we centralize and process data across our various entities, and then securely build and train models using that data to create hyper-personalized fan experiences at scale, said Saad Zaheer, VP of Data Science and Engineering, Endeavor. With Snowflake as our central data foundation bringing all of this development directly to our enterprise data, we can unlock even more ways to predict and forecast customer behavior to fuel our targeted sales and marketing engines.
Snowflake Advances Developer Capabilities Across the App Lifecycle
The Snowflake Native App Framework (general availability soon on AWS, public preview soon on Azure) now provides every organization with the necessary building blocks for app development, including distribution, operation, and monetization within Snowflake’s platform. Leading organizations are monetizing their Snowflake Native Apps through Snowflake Marketplace, with app listings more than doubling since Snowflake Summit 2023. This number is only growing as Snowflake continues to advance its developer capabilities across the app lifecycle so more organizations can unlock business impact.
For example, Cybersyn, a data-service provider, is developing Snowflake Native Apps exclusively for Snowflake Marketplace, with more than 40 customers running over 5,000 queries with its Financial & Economic Essentials Native App since June 2022. In addition, LiveRamp, a data collaboration platform, has seen the number of customers deploying its Identity Resolution and Transcoding Snowflake Native App through Snowflake Marketplace increase by more than 80% since June 2022. Lastly, SNP has been able to provide its customers with a 10x cost reduction in Snowflake data processing associated with SAP data ingestion, empowering them to drastically reduce data latency while improving SAP data availability in Snowflake through SNP’s Data Streaming for SAP - Snowflake Native App.
With Snowpark Container Services (public preview soon in select AWS regions), developers can run any component of their app — from ML training, to LLMs, to an API, and more — without needing to move data or manage complex container-based infrastructure.
Snowflake Automates DevOps for Apps, Data Pipelines, and Other Development
Snowflake is giving developers new ways to automate key DevOps and observability capabilities across testing, deploying, monitoring, and operating their apps and data pipelines — so they can take them from idea to production faster. With Snowflake’s new Database Change Management (private preview soon) features, developers can code declaratively and easily templatize their work to manage Snowflake objects across multiple environments. The Database Change Management features serve as a single source of truth for object creation across various environments, using the common “configuration as code” pattern in DevOps to automatically provision and update Snowflake objects.
Snowflake also unveiled a new Powered by Snowflake Funding Program, innovations that enable all users to securely tap into the power of generative AI with their enterprise data, enhancements to further eliminate data silos and strengthen Snowflake’s leading compliance and governance capabilities through Snowflake Horizon, and more at Snowday 2023.
Big Data Management
iTWire | October 30, 2023
AVEVA, is a global leader in industrial software, driving digital transformation and sustainability, has launched AVEVA PI Data Infrastructure, a fully-integrated hybrid data solution providing easy scalability, centralised management, and the ability to share data collaboratively via the cloud.
AVEVA PI Data Infrastructure is the latest offering in the market leading AVEVA PI System portfolio, which helps companies collect, enrich, analyse and visualise operations data to achieve deeper insight and operational excellence. Moving to hybrid infrastructure gives industrial companies the flexibility, scalability and security needed to deliver valuable, high-fidelity data to authorised users and applications in any location. The initial release also gives customers the option to use the OpenID Connect protocol for user authentication, enabling enterprise-wide single sign on. Other enterprise-class data management features will be delivered over several releases.
AVEVA PI Data Infrastructure makes it easier for companies to collect and use real-time operations data in industrial environments that increasingly include sensor-enabled legacy systems, remote assets and IIoT devices. The hybrid architecture gives data access to more decision makers who rely on operations data to resolve problems and develop business insights, thereby reducing the total cost and effort of operations data management. By achieving seamless data sharing with any trusted collaborator, companies can overcome costly data silos, modernise and streamline user access and aggregate real-time and historical data for wider use and consumption. AVEVA PI Data Infrastructure is available via subscription using AVEVA Flex credits.
Harpreet Gulati, SVP - Head of PI System Business at AVEVA, said, No other industrial software company offers a fully-integrated, seamless data infrastructure that enables the fast, secure flow of real-time, high-fidelity data to anywhere it is needed – across multiple plants, at the edge, or in a trusted community over the cloud – with complete data integrity. We want to provide our customers with the flexibility to deploy across any of these areas, enabling them to increase sustainability, operating efficiency, asset reliability, and organisational agility.
Customers are embracing the new offering. Giovanna Ruggieri, Head of ICT at Italy’s EP Produzione, a subsidiary of the European energy giant, EPH, commented: "EP Produzione is actively pursuing digital transformation to maximise operational excellence and improve processes to support the business. To continue the journey, and better embrace the digital transformation, we need greater flexibility and integration at all levels, a data infrastructure that can give us full visibility across our multi-site operating environment that always keeps cyber security as high priority.
"We appreciate AVEVA PI Data Infrastructure’s aggregate tag subscription model because it allows us to better manage our current and future needs in a smart way, with AVEVA currently proposing, for us, one of the best solutions on the market."