Business Intelligence, Big Data Management, Big Data

Census Launches dbt_census_utils, the First dbt Macros for Data Activation

Census Launches dbt_census_utils, the First dbt Macros for Data

Census, the leading Data Activation platform that syncs customer data from data warehouses to key business tools, has released a new dbt macro package called dbt_census_utils. This package is designed to provide the building blocks for data management and activation, making user data normalization simpler and more efficient for dbt users.

As businesses strive to provide better personalization, making data in the warehouse actionable in business applications has become imperative. However, challenges often arise in the form of data mismatches, format inconsistencies, and pipeline failures. The dbt_census_utils package, containing six macros, helps analytics engineers eliminate the need for extensive custom SQL. Data teams can now confidently and rapidly deliver large volumes of data to downstream tools, and focus more on advanced analysis and less on mundane data management tasks.

The package was built by Stephen Ebrey, founder of data consultancy Sawtelle Analytics. In addition to being an active member of the dbt Community, Stephen acts as a Data Champion for Census's Operational Analytics Club, aimed at helping data practitioners build successful careers. The dbt_census_utils package can be used by Census and non-Census users alike to make their data activation workflows more efficient.

“dbt is a powerful tool for many data professionals,” Ebrey said. “I built the census_utils package to make it easy for analytics engineers to identify and normalize users, and send the right customer data to their customer-facing tools. As an activation platform that connects sources and destinations, I believe Census is uniquely suited to publish dbt packages that combine the best practices of how top data teams organize users and how APIs like Facebook's and Google's require user data to be sent."

These macros are specially designed for unique data activation challenges that traditional Business Intelligence (BI) tools do not solve, such as:

  • Identifying personal emails vs business emails
  • Cleaning names for advertising destinations
  • Standardizing country codes.

“dbt packages help analytics engineers with battle-tested macros for common use cases,” Census CEO Boris Jabes said. “This new package features a lot of the macros we’ve seen people need when putting their data into action in SaaS applications. We’re excited to share these with the community to make data insights actionable.”

Census will host a webinar with Ebrey June 5 at 10 am PT on the lessons learned from building the first dbt package for data activation. You can register here.

For more information about dbt_census_utils, read the full write-up here. You can find the dbt_census_utils package itself here.

About Census

Census turns data warehouses into a hub for marketing and business operations, empowering everyone with trustworthy and actionable data from a single source of truth. With its Data Activation platform, powered by reverse ETL (extract, transfer, and load), data teams can validate and publish analytics directly into all their applications in real time. Hundreds of companies like Canva, Figma, Loom, and Notion use Census to sync billions of records to empower their customer success, sales, and marketing teams. Census is backed by Andreessen Horowitz, Insight Partners, Sequoia, and Tiger Global. For more information, visit www.getcensus.com or follow @census on Twitter.

Spotlight

Spotlight

Related News

Big Data

Airbyte Racks Up Awards from InfoWorld, BigDATAwire, Built In; Builds Largest and Fastest-Growing User Community

Airbyte | January 30, 2024

Airbyte, creators of the leading open-source data movement infrastructure, today announced a series of accomplishments and awards reinforcing its standing as the largest and fastest-growing data movement community. With a focus on innovation, community engagement, and performance enhancement, Airbyte continues to revolutionize the way data is handled and processed across industries. “Airbyte proudly stands as the front-runner in the data movement landscape with the largest community of more than 5,000 daily users and over 125,000 deployments, with monthly data synchronizations of over 2 petabytes,” said Michel Tricot, co-founder and CEO, Airbyte. “This unparalleled growth is a testament to Airbyte's widespread adoption by users and the trust placed in its capabilities.” The Airbyte community has more than 800 code contributors and 12,000 stars on GitHub. Recently, the company held its second annual virtual conference called move(data), which attracted over 5,000 attendees. Airbyte was named an InfoWorld Technology of the Year Award finalist: Data Management – Integration (in October) for cutting-edge products that are changing how IT organizations work and how companies do business. And, at the start of this year, was named to the Built In 2024 Best Places To Work Award in San Francisco – Best Startups to Work For, recognizing the company's commitment to fostering a positive work environment, remote and flexible work opportunities, and programs for diversity, equity, and inclusion. Today, the company received the BigDATAwire Readers/Editors Choice Award – Big Data and AI Startup, which recognizes companies and products that have made a difference. Other key milestones in 2023 include the following. Availability of more than 350 data connectors, making Airbyte the platform with the most connectors in the industry. The company aims to increase that to 500 high-quality connectors supported by the end of this year. More than 2,000 custom connectors were created with the Airbyte No-Code Connector Builder, which enables data connectors to be made in minutes. Significant performance improvement with database replication speed increased by 10 times to support larger datasets. Added support for five vector databases, in addition to unstructured data sources, as the first company to build a bridge between data movement platforms and artificial intelligence (AI). Looking ahead, Airbyte will introduce data lakehouse destinations, as well as a new Publish feature to push data to API destinations. About Airbyte Airbyte is the open-source data movement infrastructure leader running in the safety of your cloud and syncing data from applications, APIs, and databases to data warehouses, lakes, and other destinations. Airbyte offers four products: Airbyte Open Source, Airbyte Self-Managed, Airbyte Cloud, and Powered by Airbyte. Airbyte was co-founded by Michel Tricot (former director of engineering and head of integrations at Liveramp and RideOS) and John Lafleur (serial entrepreneur of dev tools and B2B). The company is headquartered in San Francisco with a distributed team around the world. To learn more, visit airbyte.com.

Read More