Big Data Management

Factored Partners With Databricks to Enhance Data-Informed Decision Making With Unified Data Analytics

Factored, a leader in data-centric AI helping tech unicorns and other high-profile tech companies select, upskill and build high-caliber data engineering, machine learning and data analytics teams, announced today that it has partnered with Databricks, the data and AI company, to drive business value for clients by unifying all data and artificial intelligence processes and workflows in a single platform. Thanks to Databricks' technology, including Delta Lake, Structured Streaming and the integration with MLflow, Factored engineers and analysts are providing innovative businesses with easier access to critical data driving key business decisions and strategy.

As a result of the partnership, Factored engineers and analysts can integrate all data-related processes in one platform to carry out tasks such as request parallelization, distance calculation and model interpretability. The partnership enhances cross-functional collaboration, visibility and efficiency in decision making and solution implementation for Factored's clients.

Databricks' Lakehouse Platform helps organizations accelerate innovation by unifying data teams with an open, scalable platform for all of their data-driven use cases. From streaming analytics and AI to BI, Databricks provides a modern lakehouse architecture that unifies data engineering, data science, machine learning and analytics within a single collaborative platform.

"We're delighted to be recognized as a Databricks Consulting Partner and to continue helping businesses make sense of their data using the industry's most cutting-edge tools. At Factored, we're dedicated to implementing the most effective data and AI solutions for our clients and Databricks' Lakehouse Platform plays a significant role in helping us achieve this."

Israel Niezen, Factored CEO

Since its founding in 2019, Factored has seen fast-paced growth and today is one of the biggest data science companies in Latin America.

About Factored
Factored helps leading tech companies select, upskill and build world-class data science, machine learning and AI engineering teams much faster and more cost-effectively. Factored engineers have been personally vetted, educated and mentored by some of the most talented and recognized AI educators and engineers from Silicon Valley, Stanford University and deeplearning.ai.

Spotlight

Other News
Big Data Management

Congruity360 Delivers Intelligent Data Migrations and Storage Tiering

PR Newswire | September 27, 2023

Congruity360, a leading unstructured data management and risk mitigation provider, announces the addition of data mobility in Enterprise Insights. As unstructured data grows at the annual rate of 55% to 65% and accounts for more than 80% of all enterprise data, businesses must find a way to identify, classify and move data intelligently and automatically during its lifecycle. As enterprises grow, their valuable data must mature with their business. This may require a journey to the cloud, SLA changes which optimize storage costs, classification to mitigate risk, and moving the right data to additional key AI platform initiatives. A simple, scalable, high-performance data classification engine, Enterprise Insights delivers next-generation data lifecycle management for storage optimization, security and risk optimization, and IT business optimization. Enterprise Insights Approach to Successful Data Optimization: Identify – Securely analyze PBs of unstructured data across on premises (NAS & object) and cloud (files/objects & SaaS) sources by harnessing the power of the platform's rapid insights and auto-discover technologies, which can reduce data identification times by 1,000%. Classify – Quickly identify key client data attributes for cost savings, risk mitigation, and business impact with simple to consume dashboards and drill down capabilities. Review – Confidently create and take actions by leveraging the comprehensive search engine to quickly find and preview data for movement without ever leaving the platform. Remediate – Seamlessly take action (migrate and tier) on classified data to ensure it's properly protected, optimally stored, and most effectively serving the business. Enterprise Insights offers three use case-driven insight analysis modules: Storage and Migration Optimization – Insights into over 35 file data attributes including systems' aged, stale, obsolete, redundant, trivial, and types of systems files. Business Optimization – Insight into and classification by business units' or cost centers' aged, stale, obsolete, redundant, trivial, and types of files. Data Security and Risk Optimization – Insights into files containing PII and SPII, financial, legal, security, and risk data, as well as open shares and other network & storage security vulnerabilities. By leveraging Enterprise Insights, clients can classify data for simple and secure migration both on premise and in the cloud. Equally important is Insights data tiering capabilities, enabling users to match data storage costs to data usage. Powered by the Classify360 Platform, Enterprise Insights' secure hybrid approach to data analysis scales capabilities to exabyte levels at unmatched speed. Enterprise Insights is the industry's most powerful weapon to tackle the costs, time, and complexity of cloud migration projects, backup modernization, storage tiering, hardware refresh, and security posture management. By providing users with dashboards highlighting their existing storage costs and risks, Enterprise Insights frees clients from hidden, legacy, CapEx and OpEx expenditures, performance, and scalability bottlenecks while discovering and acting on sensitive and risk data. Unstructured data insanity is treating all data equally with zero insights into its business impact, said Brian Davidson, Chief Executive Officer and Managing Partner of Congruity360. Enterprise Insights is the first step in implementing optimized data lifecycle management. With historically high data growth and new business uses for unstructured data, it is essential to attack the costs and risks inherent in unmanaged data. Our customers have realized 7-10x returns on their data lifecycle management implementations while reducing risk in an auditable compliance framework. As AI continues to gain steam, don't overpay by moving useless data to your expensive AI platforms. The Classify360 Platform is comprehensive, simple to implement, scale, and operate. Businesses leverage the Classify360 Platform for unstructured data discovery, classification, business workflows, remediation actions, and insightful reporting. Congruity360 continues to tackle additional data governance challenges through innovations to the Classify360 Platform to continue delivering revolutionary data governance and classification, at scale, to the enterprise world. ABOUT CONGRUITY360 Congruity360 delivers the only data life cycle management solution built on a foundation of classification, by expert data storage engineers alongside expert data privacy consultants. The Classify360 Platform is easy to implement, requires no outside consultants, and quickly analyzes your data at the petabyte scale in days, not weeks or months.

Read More

Big Data Management

Immuta Launches Immuta Discover for Enhanced Data Security and Compliance

PR Newswire | October 31, 2023

Immuta, a data security leader, today announced the release of Immuta Discover, a new product for automated tagging and classification on cloud data platforms. Immuta Discover enables data teams to establish and maintain highly accurate metadata for the primary purpose of data access control, monitoring and regulatory compliance. Immuta Discover automatically and continuously discovers structured data in cloud data platforms. It can also leverage existing metadata pulled from enterprise data catalogs like Alation. Leveraging all of this metadata, Immuta Discover provides visibility of all sensitive data, which is critical for building data policies to protect the data and analyzing its usage. As a core pillar of Immuta's comprehensive Data Security Platform, Immuta Discover eliminates manual, error-prone processes and helps organizations improve data security, gain full visibility into their data and unlock its value. Discovering, tagging and classifying sensitive data with highly accurate and descriptive metadata is a critical component of a successful data security strategy. However, today's organizations are burdened with increasingly dispersed data as the number of data sources and users continues to grow. Existing solutions are not designed to tag and classify data across all of these sources with the accuracy and granularity required for security and governance. The lack of accurate metadata creates security gaps and blind spots, making it difficult to meet stringent compliance regulations. Immuta Discover allows data teams to easily and accurately scan, classify and tag data so they can apply data control policies and monitor data access. This allows teams to gain full visibility and context into all of their data assets, and better protect and monitor their sensitive data for enhanced data security posture management. Immuta offers 60+ pre-built and domain-specific classifiers, providing organizations with the flexibility to tailor data classifications to their unique business needs and based on their desired confidence levels. Immuta Discover is the foundational component to making any data security program work within your organization and to remain compliant, said Mo Plassnig, Chief Product Officer at Immuta. It's the first step that must happen in order to protect your data. Data is constantly changing in today's digital age. Organizations must fully understand what data they have – with accurate classification – and maintain a trustworthy inventory of sensitive data across cloud platforms in order to meet growing data security and access demands. And Immuta Discover helps our customers accomplish just this. With Immuta Discover, customers can automatically identify and classify sensitive data by leveraging the following new capabilities: Accurate and actionable metadata for data security – Immuta Discover provides accurate, granular metadata and actionable tags on sensitive data so users can seamlessly secure data across cloud platforms at scale. The product enables full metadata visibility into what data requires access controls and auditing. The metadata can be leveraged directly in Immuta Secure to govern the data and in Immuta Detect to monitor data access. Agentless, multi-cloud data discovery – Immuta Discover scans and classifies data natively, with no software to install and no agent running next to the cloud data platform. The data never leaves the data platform. This approach simplifies operations and is secure and compliant, enabling data teams to be more efficient with an always up-to-date data inventory. Out-of-the-box and customizable regulatory frameworks – Immuta Discover automatically categorizes data that is subject to leading regulatory frameworks such as CCPA, GDPR, HIPAA, or PCI, to implement compliant access control policies. These frameworks are created and maintained by Immuta's in-house Legal Engineering Team, and additionally enable customers to customize frameworks based on their interpretations of specific regulations for accelerated compliance. "I am thrilled to see the addition and announcement of Immuta Discover to Immuta's Data Security Platform," said Sanjeev Mohan, former Gartner analyst and founder of SanjMo. "Efficiently tagging and classifying data is a critical first step in protecting it against the growing number of threats in today's data management landscape. Being able to scan data natively in the cloud data platform is an innovation that enables data discovery at scale." Immuta offers a comprehensive Data Security Platform that enables sensitive data discovery, security and access control and activity monitoring. Immuta Discover automatically discovers and classifies sensitive data relevant to the leading regulatory frameworks. Immuta Detect adds critical user and data access behavior monitoring and auditing. And, Immuta Secure provides scalable data access control and enforcement across cloud data platforms. Together, these capabilities give customers comprehensive data security and governance for analytic workloads. About Immuta Immuta enables organizations to unlock value from their cloud data by protecting it and providing secure access. The Immuta Data Security Platform provides sensitive data discovery, security and access control, data activity monitoring, and has deep integrations with the leading cloud data platforms. Immuta is now trusted by Fortune 500 companies and government agencies around the world to secure their data. Founded in 2015, Immuta is headquartered in Boston, MA. To learn more about Immuta, click here.

Read More

Business Intelligence

Dremio Launches Next-gen Reflections Redefining SQL Query Acceleration

Dremio | September 15, 2023

Dremio, a renowned easy and open data lakehouse solution provider, has recently introduced its next-gen Reflections technology, marking a transformative milestone in SQL query acceleration. Dremio Reflections facilitate sub-second analytics performance across an organization's entire data ecosystem, irrespective of data location. This groundbreaking technology is redefining data access and analysis, ensuring that valuable insights are derived efficiently and swiftly, all while reducing costs to merely one-third of a typical cloud data warehouse. Reflections represent Dremio's innovative SQL query acceleration technology. Queries that leverage Reflections exhibit performance gains ranging from 10 to 100 times faster than their non-accelerated counterparts. This latest release introduces the Dremio Reflection Recommender, a pioneering feature that empowers users to accelerate Business Intelligence workloads in a matter of seconds. The Reflection Recommender automatically evaluates an organization's SQL queries and generates recommended Reflections to accelerate them. Tomer Shiran, founder of Dremio, commented, Dremio Reflections accelerate SQL queries by orders of magnitude, eliminating the need for BI extracts/imports and enabling companies to run their most mission-critical BI workloads directly on a lakehouse. With automatic recommendations and next-generation incremental updates, we've made it even easier for organizations to take advantage of this innovative technology. [Source: Business Wire] Reflection Recommender eliminates the need for labor-intensive manual data and workload analysis, making the process of obtaining the fastest and most intelligent query results effortless, requiring only a few simple actions. The user-friendly nature of the Reflection Recommender puts advanced query acceleration capabilities within the reach of all users, significantly saving both time and expenses. Dremio has also refined the process of refreshing Reflections to further bolster query performance and drive cost efficiencies. It now intelligently refreshes Reflections on Apache Iceberg tables, promptly capturing incremental data changes. This innovative approach obviates the requirement for complete data refreshes, resulting in speedier updates and reduced compute expenses. Dremio Reflections eliminates the need for data teams to export data from the data lakehouse into BI extracts or imports for analytical reasons and overcomes performance bottlenecks for BI dashboards and reports. In addition, Reflections negate the necessity of creating precomputed tables within the data lake or data warehouse to achieve sub-second performance for BI workloads, reducing the workload and complexity for data teams. About Dremio Dremio is a leading, easy and open data lakehouse solution provider, offering organizations the versatility of self-service analytics coupled with the functionality of a data warehouse and the flexibility of a data lake. Dremio's platform empowers users to harness the lightning-fast SQL query service alongside various processing engines, all on the same dataset. The company distinguishes itself through a pioneering data-as-code methodology akin to Git, which facilitates data experimentation, version control, and governance. This innovative approach enhances agility and empowers organizations to explore and manage their data resources with unprecedented efficiency. Furthermore, Dremio offers a fully managed service that expedites organizations' entry into analytics, allowing them to commence their data-driven journey within minutes.

Read More

Big Data Management

Arity Launches Arity IQ on Google Cloud's Analytics Hub

Business Wire | October 19, 2023

Arity, a leading mobility and data analytics company, today announces that the Arity IQ network and attributes dataset are now available in Google Cloud’s data exchange, Analytics Hub. Google Cloud’s auto insurance customers can now more accurately price insurance policies at time of quote by using driving behavior history. By having access to this data, insurers are able to increase pricing sophistication, improve profitability, and grow their book of business. With access to the Arity IQ network in Google Cloud’s Analytics Hub, insurance carriers can: Enhance owned datasets with comprehensive driving behavior data through Arity’s DrivesightScore or specific driving attributes within Google Cloud’s privacy-safe environment. Analyze and segment customers at time of quote to increase pricing sophistication. Deliver personalized experiences with more accurate quotes to customers at new and renewed business. We’re excited to bring the Arity IQ network to Google Cloud's insurance customers, said Gary Hallgren, Arity’s president. We’re not only expanding the reach of one of the world’s largest driving behavior databases tied to claims, but we’re helping insurers price more competitively at time of quote. Arity uses privacy forward methods for secure and safe data storage, including encrypting data at rest and in transit and by making the data available within Google Cloud’s Analytics Hub, carriers can access the data in a privacy-safe environment. “Google Cloud Analytics Hub provides Arity’s customers with an efficient, secure platform to exchange data and combine their business data with third-party insights,” said Yolande Piazza, Vice President of Financial Services at Google Cloud. “With the addition of the Arity IQ network, our insurance customers can increase value for their business while providing more accurate prices based on how their customers behave behind the wheel.” About Arity Arity is a mobility data and analytics company that provides data-driven solutions to companies invested in transportation, enabling them to deliver mobility services that are smarter, safer, and more economical. Arity collects and analyzes over a trillion of miles of driving data to create a greater understanding of how people move. With the world’s largest driving dataset tied to insurance claims collected through mobile devices, in-car devices, and vehicles themselves, Arity derives unique insights that help insurers, developers, marketers, and communities understand and predict driving behavior at scale.

Read More