Databricks launches new features for data analytics platform

Databricks has released new features for its platform for greater security, proactive administration and automation across the data and machine learning lifecycle.
According to Databricks, its Unified Data Analytics Platform is designed to enable data teams to access analytics and ML applications within their company through securely leveraging data at large scales.The solution aims to simplify the complexities that come with a multi-cloud environment, focusing on security, administration and devops processes like user management or cluster provisioning.Databrick’s Unified Data Analytics Platform helps organisations to bring user’s and data together in a scalable and secure service that can leverage the native capabilities of multiple clouds, the company states.New features within the platform includes: cloud native security, proactive administration and automation at scale.Security At present enterprises can run Databrick’s clusters inside their account, meaning they can leverage a fully-managed SaaS service without losing control over their data. The new features adds customer-owned revocable data encryption keys and customised private networks to run these clusters allows customers to further tailor the service to their enterprise and compliance requirements, Databricks says.

Spotlight

Other News
Big Data Management

Immuta Launches Immuta Discover for Enhanced Data Security and Compliance

PR Newswire | October 31, 2023

Immuta, a data security leader, today announced the release of Immuta Discover, a new product for automated tagging and classification on cloud data platforms. Immuta Discover enables data teams to establish and maintain highly accurate metadata for the primary purpose of data access control, monitoring and regulatory compliance. Immuta Discover automatically and continuously discovers structured data in cloud data platforms. It can also leverage existing metadata pulled from enterprise data catalogs like Alation. Leveraging all of this metadata, Immuta Discover provides visibility of all sensitive data, which is critical for building data policies to protect the data and analyzing its usage. As a core pillar of Immuta's comprehensive Data Security Platform, Immuta Discover eliminates manual, error-prone processes and helps organizations improve data security, gain full visibility into their data and unlock its value. Discovering, tagging and classifying sensitive data with highly accurate and descriptive metadata is a critical component of a successful data security strategy. However, today's organizations are burdened with increasingly dispersed data as the number of data sources and users continues to grow. Existing solutions are not designed to tag and classify data across all of these sources with the accuracy and granularity required for security and governance. The lack of accurate metadata creates security gaps and blind spots, making it difficult to meet stringent compliance regulations. Immuta Discover allows data teams to easily and accurately scan, classify and tag data so they can apply data control policies and monitor data access. This allows teams to gain full visibility and context into all of their data assets, and better protect and monitor their sensitive data for enhanced data security posture management. Immuta offers 60+ pre-built and domain-specific classifiers, providing organizations with the flexibility to tailor data classifications to their unique business needs and based on their desired confidence levels. Immuta Discover is the foundational component to making any data security program work within your organization and to remain compliant, said Mo Plassnig, Chief Product Officer at Immuta. It's the first step that must happen in order to protect your data. Data is constantly changing in today's digital age. Organizations must fully understand what data they have – with accurate classification – and maintain a trustworthy inventory of sensitive data across cloud platforms in order to meet growing data security and access demands. And Immuta Discover helps our customers accomplish just this. With Immuta Discover, customers can automatically identify and classify sensitive data by leveraging the following new capabilities: Accurate and actionable metadata for data security – Immuta Discover provides accurate, granular metadata and actionable tags on sensitive data so users can seamlessly secure data across cloud platforms at scale. The product enables full metadata visibility into what data requires access controls and auditing. The metadata can be leveraged directly in Immuta Secure to govern the data and in Immuta Detect to monitor data access. Agentless, multi-cloud data discovery – Immuta Discover scans and classifies data natively, with no software to install and no agent running next to the cloud data platform. The data never leaves the data platform. This approach simplifies operations and is secure and compliant, enabling data teams to be more efficient with an always up-to-date data inventory. Out-of-the-box and customizable regulatory frameworks – Immuta Discover automatically categorizes data that is subject to leading regulatory frameworks such as CCPA, GDPR, HIPAA, or PCI, to implement compliant access control policies. These frameworks are created and maintained by Immuta's in-house Legal Engineering Team, and additionally enable customers to customize frameworks based on their interpretations of specific regulations for accelerated compliance. "I am thrilled to see the addition and announcement of Immuta Discover to Immuta's Data Security Platform," said Sanjeev Mohan, former Gartner analyst and founder of SanjMo. "Efficiently tagging and classifying data is a critical first step in protecting it against the growing number of threats in today's data management landscape. Being able to scan data natively in the cloud data platform is an innovation that enables data discovery at scale." Immuta offers a comprehensive Data Security Platform that enables sensitive data discovery, security and access control and activity monitoring. Immuta Discover automatically discovers and classifies sensitive data relevant to the leading regulatory frameworks. Immuta Detect adds critical user and data access behavior monitoring and auditing. And, Immuta Secure provides scalable data access control and enforcement across cloud data platforms. Together, these capabilities give customers comprehensive data security and governance for analytic workloads. About Immuta Immuta enables organizations to unlock value from their cloud data by protecting it and providing secure access. The Immuta Data Security Platform provides sensitive data discovery, security and access control, data activity monitoring, and has deep integrations with the leading cloud data platforms. Immuta is now trusted by Fortune 500 companies and government agencies around the world to secure their data. Founded in 2015, Immuta is headquartered in Boston, MA. To learn more about Immuta, click here.

Read More

Business Strategy

Powered by Airbyte Offers Software Makers More than 100 Data Integrations

Business Wire | November 02, 2023

Airbyte, creators of the fastest-growing open-source data integration platform, today announced its "Powered by Airbyte" version that enables makers of software to embed over 100 integrations into their applications – accelerating their time-to-market while increasing the focus on their core product value. “Powered by Airbyte” removes the time-consuming task of building data integrations from scratch. Instead, using Airbyte's extensive library of connectors enables rapid data movement and synchronization between various sources and destinations. This novel approach liberates engineering teams from the burdensome task of integration development, letting them redirect their resources to building out their product's features and capabilities. Engineering teams shouldn't need to build everything themselves, said Michel Tricot, co-founder and CEO, Airbyte. They are wasting time on integration work when they don't need to do that. Now, their data movement and integration needs are covered with Powered by Airbyte so that they can re-focus their engineering time on their product's core value proposition. Early users of Powered by Airbyte report high satisfaction and excellent results. Cart.com is a fast-growing provider to 6,000 brands helping them get their products in the hands of their buyers. Last year, the company helped move over $5 billion in gross merchandise value with a total of 140 million product listings. Cart utilizes Powered by Airbyte in its Unified Analytics product that helps its merchant customers to predict demand, allocate inventory and adjust advertising spending by pulling in the merchant's data from sources such as Facebook, Google Ads, Google Analytics, Hubspot, Mailchimp, Shopify, and more. The data is then consolidated in Cart’s Snowflake data warehouse with all of the integration and data movement done with Powered by Airbyte. Cart is able to offer its merchants self-service to sign up for an account, connect their data sources, connect their integrations, and begin using the product on their own. “With Airbyte, we don’t need to worry about connectors and focus on creating value for our users instead of building infrastructure. That’s priceless,” said Chase Zieman, chief data officer, Cart. “The time and energy saved allows us to disrupt and grow faster.” Digital marketing firm, KORTX, delivers personalized experiences for clients and custom reporting built on BigQuery and Looker. That requires centralizing all of their clients’ data from Facebook Marketing, Google Ads, Google Analytics, Hubspot and more into BigQuery so it can be analyzed. Prior to using Powered by Airbyte, data was pulled manually and put into spreadsheets and, of course, clients did not have real-time access to the data. “Without Airbyte’s ease-of-use and library of API connectors, we would have either had to lean heavily on valuable engineering resources to build out custom connections to power our custom reporting dashboard solutions or continue with time-consuming manual reporting,” said Jeff Isreal, director of analytics at KORTX. Damon Henry, KORTX founder and CEO, said, “With Airbyte, our team of data engineers could easily develop new connectors or customize existing ones to meet our clients' needs. The platform’s resilience and reliability mean that we can now focus more on deriving insights and less on managing data pipelines. With Airbyte as our ally, KORTX is not just meeting but exceeding client expectations, ensuring that advertising campaigns are not just effective but are also backed by data that is as robust as it is reliable.” Airbyte makes moving data easy and affordable across almost any source and destination, helping enterprises provide their users with access to the right data for analysis and decision-making. Airbyte has the largest data engineering contributor community – with more than 800 contributors – and the best tooling to build and maintain connectors. Pricing for Powered by Airbyte is based primarily on the number of customers syncing data through Airbyte. This makes pricing easier to forecast and more predictable than alternative solutions. Additional pricing details, and a pricing estimator can be found here. About Airbyte Airbyte is the open-source data movement leader running in the safety of your cloud and syncing data from applications, APIs, and databases to data warehouses, lakes, and other destinations. Airbyte offers four products: Airbyte Open Source, Airbyte Enterprise, Airbyte Cloud, and Powered by Airbyte. Airbyte was co-founded by Michel Tricot (former director of engineering and head of integrations at Liveramp and RideOS) and John Lafleur (serial entrepreneur of dev tools and B2B). The company is headquartered in San Francisco with a distributed team around the world. To learn more, visit airbyte.com.

Read More

Data Architecture

Neo4j Enhances Cloud Database Performance Enabling up to 100X Faster Analytics and Real-Time Decision Making

Cision | October 27, 2023

Neo4j, the world's leading graph database and analytics company, announced major new capabilities enabling cloud or self managed customers to increase analytical queries by up to 100x faster, run both transactional and analytical processing within one database, and automatically track data changes in real time for faster mission-critical decision making. Neo4j's integration of operational and analytical workloads within a single database is now enhanced by the power of parallel runtime and change data capture, empowering our customers with real-time insights, cost-efficient data management, and simplified architecture, said Sudhir Hasbe, Chief Product Officer, Neo4j. The results foster quicker decision-making, superior customer experiences, and a competitive edge in the market at a magnitude of speed, performance and agility that is far greater than ever before. New capabilities and benefits include: Up to 100X faster performance of analytical queries via Parallel Runtime capability, which adds concurrent threads across multiple CPU cores to run analytical graph queries. Neo4j also leverages a technique called morsel-based parallelism to optimize this capability, for greater scalability, better resource utilization, and seamless multitasking. Faster mission-critical decisions now enabled by native Change Data Capture (CDC), which automates the real-time tracking and notification of data changes in the database. CDC is also integrated with Neo4j Connector for Kafka and Confluent, which streams these changes for easier consumption across other data platforms and applications. Easier Knowledge Graph creation via new embedding models that predict and find missing relationships and infer new connections within an organization's knowledge graph for greater semantic understanding. New pathfinding algorithms that make complex workflows more efficient by identifying the best sequence and critical paths between nodes on a graph. "Neo4j's Change Data Capture capability enables us to synchronize the latest changes happening in our customers' various data sources simultaneously – and helps us guarantee that when they use Dropbox Dash, they can search and find their content accurately," said Anil Masakal, Engineering Leader, Dropbox. "Neo4j's new capabilities enable modern law enforcement agencies to react with greater agility to mission-critical events, empowering them to fight more crimes and solve them faster," said Christophe Willemsen, CTO, GraphAware. "For example, we can trigger alerts and send them to front-line officers when the phone number of a Person of Interest pings from a cellular tower near a high-risk event where a VIP is present, bodycam footage shows the image of a child at risk, and other events." These advancements follow a series of milestones for Neo4j. The company recently integrated native vector search into its core database capabilities, enabling more accurate, explainable, and transparent outcomes for LLMs and other generative AI applications. It earlier won Google Cloud's 2023 Technology Partner of the Year award in the data management category, and placement in CRN's 2023 Big Data 100. Neo4j was recognized for the first time in the 2022 Gartner Magic Quadrant for Cloud Database Management Systems, the first time that any native graph vendor was included in the report. About Neo4j Neo4j, the Graph Database & Analytics leader, helps organizations find hidden relationships and patterns across billions of data connections deeply, easily, and quickly. Customers leverage the structure of their connected data to reveal new ways of solving their most pressing business problems, from fraud detection, customer 360, knowledge graphs, supply chain, personalization, IoT, network management, and more – even as their data grows. Neo4j's full graph stack delivers powerful native graph storage with native vector search capability, data science, advanced analytics, and visualization, with enterprise-grade security controls, scalable architecture, and ACID compliance. Neo4j's community of data leaders comprises a vibrant, open-source community of more than 250,000 developers, data scientists, and architects across hundreds of Fortune 500 companies, government agencies, and NGOs. Visit neo4j.com

Read More

Big Data Management

EDB Acquires Splitgraph for Data Lake and Data Warehousing Capabilities

GlobeNewswire | October 25, 2023

EnterpriseDB (“EDB”), the leader in accelerating Postgres in the enterprise, today announced its acquisition of Splitgraph, an early-stage disruptor that provides a Postgres compatible serverless SQL API for building data driven applications from hundreds of datasources. This move is seen as a meaningful step in EDB's evolution, underscoring its commitment to delivering Postgres solutions to the ever evolving challenges customers face across a diverse data landscape. Acquiring Splitgraph advances our capabilities within the realm of analytics and AI, said Kevin Dallas, CEO, EDB. With Splitgraph's technology and deep expertise, we're taking a leap in making data lake and data warehousing operations more efficient, streamlined, and collaborative. Unifying our shared commitment to customer-driven product development, we can accelerate our progress and better address the intricate data challenges that our customers encounter. Miles Richardson, Co-Founder of Splitgraph, echoed Dallas’s sentiments, "We are pleased to share EDB’s vision to transform the way organizations engage with data using Postgres, especially for analytics workloads and AI-driven use cases. Becoming a part of EDB unlocks exciting new possibilities for our technology, further advancing the ways in which companies look to Postgres to solve their data ecosystem challenges.” With the acquisition of Splitgraph, EDB underscores its dedication to innovating within the Postgres ecosystem, directly addressing the needs of users who want to seamlessly run analytical queries across diverse data sets. Splitgraph enhances this core capability by enriching data integration, cataloging, and governance, streamlining the management of both in-house data and information sourced from open publishers through a single Postgres interface. This strategic move firmly establishes EDB's commitment to continually elevate the value it delivers to its customers throughout the data landscape. About EDB EDB provides enterprise-grade software and services that enable organizations to harness the full power of Postgres, the world’s leading open source database. EDB provides unmatched Postgres database expertise, and enables the same Postgres everywhere, including solutions for hybrid, self-managed private clouds, and EDB BigAnimal, a fully managed cloud database-as-a-service. EDB serves more than 1,500 customers globally, including leading government agencies, financial services, media and information technology companies. As the leading contributor to the vibrant and fast-growing Postgres community, EDB is committed to driving technology innovation. Through its solutions for high availability, reliability, security, 24x7 global support and advanced professional services, EDB empowers enterprises to control risk, manage costs and scale efficiently. For more information, visit www.enterprisedb.com. EnterpriseDB and EDB are registered trademarks and BigAnimal is a trademark of EnterpriseDB Corporation; Oracle is a registered trademark of Oracle Corporation. Postgres and PostgreSQL are registered trademarks of the PostgreSQL Community Association of Canada and used with their permission. All other trademarks are owned by their respective owners. About Splitgraph Splitgraph is a serverless data platform where you can query, upload, connect and share tables of data. It's built on Postgres and optimized for analytical queries over versioned snapshots and external data tables. Splitgraph develops Seafowl, an open source serverless OLAP database optimized for building data-driven Web apps, and also recently released a ChatGPT plugin for querying its catalog of open data with natural language.

Read More