Business Intelligence, Big Data Management, Machine Learning

Deepens Integrations with Databricks Unity Catalog and dbt Cloud to Power Data Intelligence Across the Modern Data Stack

Deepens Integrations with Databricks Unity Catalog

Alation Inc., the leader in enterprise data intelligence solutions, today announced expanded partnerships with Databricks, the lakehouse company, and dbt Labs, the pioneer in analytics engineering, to extend knowledge, collaboration, and trust across the modern data stack. Joint customers can now easily integrate rich metadata from Databricks Unity Catalog and leverage a new connector that provides support for dbt Core and dbt Cloud in Alation. As a result, users have a better understanding of their data landscape and can view underlying data changes and transformations to power data intelligence.

In the modern data stack, data lives in a variety of source systems and formats in preparation for transformation and analysis. To find, understand, and trust data that spans multiple technologies across an organization, users need a single-pane-of-glass view of the most valuable data within their ecosystem. With these recent integrations, metadata is visible within Alation, enabling users to better understand the data being leveraged, as well as its historical use, to ensure business decisions are made on high-quality and trusted data.

“The combination of Alation plus Databricks Unity Catalog, and Alation plus dbt Cloud, brings much-needed data intelligence with critical components of the modern data stack,” said Diby Malakar, VP of product management, Alation. “Metadata offers invaluable context to data users seeking to better understand their data’s path and collaborate across the organization. We’re looking forward to growing our partnerships with Databricks and dbt Labs to help data teams stay on track, work together, and increase confidence in data-driven decisions.”

Power Self-Discovery with Databricks Unity Catalog

Alation connects to more than 100 data sources, including Databricks, dbt Labs, Snowflake, AWS, and Tableau. The expanded connector with Databricks Unity Catalog empowers joint customers to better understand data that lives in their cloud-based technology stack. Organizations that leverage Databricks, which is specifically optimized for cloud environments, process and transform massive quantities of data that span multiple workspaces and systems.

Now, with the expanded connector to Databricks Unity Catalog, joint customers can sample and profile data, and compose queries on data from the Databricks Lakehouse, directly in Alation.

  • Sampling provides a preview of a small slice of data, its structure, and how it can be used.
  • Profiling provides a high-level view on the statistics of the data, such as minimum, maximum, median, and null, enabling users to observe potential quality and fit at a glance.
  • Compose, Alation’s SQL query tool, enables users to search data sources with real-time warnings and lowers the barrier to entry with its autocomplete function that generates suggestions as users write queries.

Data engineers and data scientists will now benefit from increased self-service at scale, faster migration, and the ability to collaborate inside Alation with enhanced context around the systems being used.

“Whether you’re a data owner or user, you need to understand the context around the data being used to accelerate time to value and garner trusted insights,” said Ariel Amster, Director of Strategic Technology Partners at Databricks. “By integrating Unity Catalog with Alation, data teams can easily search across multiple sources and workplaces to power self-discovery and streamline governance. This is a critical step before leveraging any data set, to improve the accuracy of their predictive models, and we’re thrilled to further strengthen our partnership with Alation.”

Gain Visibility into Data Changes with dbt Labs

Metadata plays a key role in enabling data users to quickly search, discover, and understand their data within Alation – an especially important feature for data engineers as they prepare increasing quantities of data for analysis.

The new connector for dbt Core and dbt Cloud extracts dbt descriptions for curated data in Alation, as well as dbt lineage for data warehouses, such as Snowflake, Redshift, and PostgreSQL. As a result, business users can fully understand the changes and transformations made to underlying data. Now, users can navigate, search, curate, flag, tag, and view lineage for data assets built with dbt in one location, increasing productivity and producing higher-quality results. The integration builds upon Alation’s extensive partner network, which utilizes the Open Connector Framework (OCF), and further cements the company’s ongoing commitment to open extensibility.

Alation is a Platinum Sponsor at the Fivetran Modern Data Stack Conference, scheduled for April 4-5 in San Francisco, California. To learn more about how Alation enables the modern data stack, visit Alation’s booth (#4) to schedule a demo with the Databricks Unity Catalog and new dbt Labs connector.

Also, attend the “Look Before You Leap” session on April 4 at 2:30 p.m. presented by Mitesh Shah, vice president of market strategy at Alation, which will explore how to avoid clogged pipelines with data intelligence.

About Alation

Alation is the leader in enterprise data intelligence solutions, including data search & discovery, data governance, data stewardship, analytics, and digital transformation. Alation’s initial offering dominates the data catalog market. Thanks to its powerful Behavioral Analysis Engine, inbuilt collaboration capabilities, and open interfaces, Alation combines machine learning with human insight to successfully tackle even the most demanding challenges in data and metadata management. More than 450 enterprises drive data culture, improve decision-making, and realize business outcomes with Alation, including AbbVie, American Family Insurance, Autozone, Cisco, Draft Kings, Exelon, Fifth Third Bank, Finnair, Nasdaq, Parexel, Pfizer, Salesforce, Virgin Australia, and Vista. Headquartered in Silicon Valley, Alation has been named to Inc. Magazine’s Best Workplaces list three times, is a 2022 UK’s Best Workplaces™ for Women, and recognized as a 2022 UK’s Best Workplaces™ in Tech. The company is backed by leading venture capitalists, including Blackstone, Costanoa, Databricks Ventures, DCVC, Dell Technologies Capital, Hewlett Packard Enterprise, Icon, ISAI Cap, Riverwood Capital, Salesforce Ventures, Sanabil Investments, Sapphire, Snowflake Ventures, Thoma Bravo, and Union Grove.

Spotlight

Spotlight

Related News

Big Data

Airbyte Racks Up Awards from InfoWorld, BigDATAwire, Built In; Builds Largest and Fastest-Growing User Community

Airbyte | January 30, 2024

Airbyte, creators of the leading open-source data movement infrastructure, today announced a series of accomplishments and awards reinforcing its standing as the largest and fastest-growing data movement community. With a focus on innovation, community engagement, and performance enhancement, Airbyte continues to revolutionize the way data is handled and processed across industries. “Airbyte proudly stands as the front-runner in the data movement landscape with the largest community of more than 5,000 daily users and over 125,000 deployments, with monthly data synchronizations of over 2 petabytes,” said Michel Tricot, co-founder and CEO, Airbyte. “This unparalleled growth is a testament to Airbyte's widespread adoption by users and the trust placed in its capabilities.” The Airbyte community has more than 800 code contributors and 12,000 stars on GitHub. Recently, the company held its second annual virtual conference called move(data), which attracted over 5,000 attendees. Airbyte was named an InfoWorld Technology of the Year Award finalist: Data Management – Integration (in October) for cutting-edge products that are changing how IT organizations work and how companies do business. And, at the start of this year, was named to the Built In 2024 Best Places To Work Award in San Francisco – Best Startups to Work For, recognizing the company's commitment to fostering a positive work environment, remote and flexible work opportunities, and programs for diversity, equity, and inclusion. Today, the company received the BigDATAwire Readers/Editors Choice Award – Big Data and AI Startup, which recognizes companies and products that have made a difference. Other key milestones in 2023 include the following. Availability of more than 350 data connectors, making Airbyte the platform with the most connectors in the industry. The company aims to increase that to 500 high-quality connectors supported by the end of this year. More than 2,000 custom connectors were created with the Airbyte No-Code Connector Builder, which enables data connectors to be made in minutes. Significant performance improvement with database replication speed increased by 10 times to support larger datasets. Added support for five vector databases, in addition to unstructured data sources, as the first company to build a bridge between data movement platforms and artificial intelligence (AI). Looking ahead, Airbyte will introduce data lakehouse destinations, as well as a new Publish feature to push data to API destinations. About Airbyte Airbyte is the open-source data movement infrastructure leader running in the safety of your cloud and syncing data from applications, APIs, and databases to data warehouses, lakes, and other destinations. Airbyte offers four products: Airbyte Open Source, Airbyte Self-Managed, Airbyte Cloud, and Powered by Airbyte. Airbyte was co-founded by Michel Tricot (former director of engineering and head of integrations at Liveramp and RideOS) and John Lafleur (serial entrepreneur of dev tools and B2B). The company is headquartered in San Francisco with a distributed team around the world. To learn more, visit airbyte.com.

Read More