Business Intelligence, Big Data Management, Big Data

Census Launches dbt_census_utils, the First dbt Macros for Data Activation

Businesswire | May 25, 2023 | Read time : 05:00 min

Census Launches dbt_census_utils, the First dbt Macros for Data

Census, the leading Data Activation platform that syncs customer data from data warehouses to key business tools, has released a new dbt macro package called dbt_census_utils. This package is designed to provide the building blocks for data management and activation, making user data normalization simpler and more efficient for dbt users.

As businesses strive to provide better personalization, making data in the warehouse actionable in business applications has become imperative. However, challenges often arise in the form of data mismatches, format inconsistencies, and pipeline failures. The dbt_census_utils package, containing six macros, helps analytics engineers eliminate the need for extensive custom SQL. Data teams can now confidently and rapidly deliver large volumes of data to downstream tools, and focus more on advanced analysis and less on mundane data management tasks.

The package was built by Stephen Ebrey, founder of data consultancy Sawtelle Analytics. In addition to being an active member of the dbt Community, Stephen acts as a Data Champion for Census's Operational Analytics Club, aimed at helping data practitioners build successful careers. The dbt_census_utils package can be used by Census and non-Census users alike to make their data activation workflows more efficient.

“dbt is a powerful tool for many data professionals,” Ebrey said. “I built the census_utils package to make it easy for analytics engineers to identify and normalize users, and send the right customer data to their customer-facing tools. As an activation platform that connects sources and destinations, I believe Census is uniquely suited to publish dbt packages that combine the best practices of how top data teams organize users and how APIs like Facebook's and Google's require user data to be sent."

These macros are specially designed for unique data activation challenges that traditional Business Intelligence (BI) tools do not solve, such as:

  • Identifying personal emails vs business emails
  • Cleaning names for advertising destinations
  • Standardizing country codes.

“dbt packages help analytics engineers with battle-tested macros for common use cases,” Census CEO Boris Jabes said. “This new package features a lot of the macros we’ve seen people need when putting their data into action in SaaS applications. We’re excited to share these with the community to make data insights actionable.”

Census will host a webinar with Ebrey June 5 at 10 am PT on the lessons learned from building the first dbt package for data activation. You can register here.

For more information about dbt_census_utils, read the full write-up here. You can find the dbt_census_utils package itself here.

About Census

Census turns data warehouses into a hub for marketing and business operations, empowering everyone with trustworthy and actionable data from a single source of truth. With its Data Activation platform, powered by reverse ETL (extract, transfer, and load), data teams can validate and publish analytics directly into all their applications in real time. Hundreds of companies like Canva, Figma, Loom, and Notion use Census to sync billions of records to empower their customer success, sales, and marketing teams. Census is backed by Andreessen Horowitz, Insight Partners, Sequoia, and Tiger Global. For more information, visit www.getcensus.com or follow @census on Twitter.

Spotlight

Are you looking for a solution to break down data silos, democratize access, and unleash the true power of data within your enterprise? Check out how Modak has brought automation of the data life cycle within an organization leading toward innovation.

Modak is a leading provider of data engineering solutions, empowering organizations to harness the power of their data with a focus on simplicity, automation, and scalability. Modak offers innovative products and services that streamline data processes and drive actionable insights.


Other News
Big Data Management

Reltio Set to Transform Data Management with AI-Powered MDM Solution

Reltio | September 20, 2023

Reltio, a leading modern data management solutions provider, has introduced an innovative AI-powered Master Data Management (MDM) solution. For over a decade, Reltio has been a pioneer in data management, offering a leading cloud-native SaaS MDM solution. The firm is poised to preview novel AI-driven capabilities tailored to meet the growing demand for delivering customers more insightful and timely intelligence powered by reliable data. Participants at the upcoming DataDriven23 conference, taking place from October 3 to 5 in Dallas, TX, will have the opportunity to directly engage with Reltio's innovations and witness how AI is poised to revolutionize MDM, enhancing the quality of data that shapes business outcomes. During the event, experts will showcase three pivotal AI-driven solution capabilities designed to drive remarkable 10X enhancements: Generative AI-driven Search and Data Visualizations: Powered by Reltio's AI-powered MDM platform, enterprises can swiftly pinpoint critical data segments and data visualizations to the Reltio UI, facilitated by a conversational interface powered by GenAI. This simplifies the process of data analysis within Reltio. Increased Data Steward Productivity: Harnessing the power of Machine Learning, Reltio's latest capabilities aim to further automate entity resolution and data quality management processes and enhance data precision while boosting data steward efficiency by 10X. Automated Predictions: Reltio's new AI-driven MDM platform empowers businesses to effortlessly anticipate key insights using propensity models. This aids in identifying crucial customer segments, thereby fostering higher customer acquisition and retention rates. Reltio remains committed to continuous investment in machine learning-based automation within Reltio's Connected Data Platform 2023.3. This includes the introduction of new features in entity resolution and data quality anomaly detection designed to expedite MDM implementations, fortify data unification, and elevate the productivity of data teams. About Reltio Reltio, a renowned leader in modern data management, believes steadfastly in the critical role of data in driving business achievements. The firm is well-known for its cutting-edge data management platform, which effortlessly integrates vital data from different sources into a unified repository of reliable information. This combination of pristine, interconnected, and actionable data empowers Reltio's esteemed clientele to enhance operational efficiency, mitigate risk, and foster sustainable growth. The solution has received praise and is utilized by prominent corporate brands across a wide range of sectors in over 140 countries.

Read More

Business Intelligence

Dremio Launches Next-gen Reflections Redefining SQL Query Acceleration

Dremio | September 15, 2023

Dremio, a renowned easy and open data lakehouse solution provider, has recently introduced its next-gen Reflections technology, marking a transformative milestone in SQL query acceleration. Dremio Reflections facilitate sub-second analytics performance across an organization's entire data ecosystem, irrespective of data location. This groundbreaking technology is redefining data access and analysis, ensuring that valuable insights are derived efficiently and swiftly, all while reducing costs to merely one-third of a typical cloud data warehouse. Reflections represent Dremio's innovative SQL query acceleration technology. Queries that leverage Reflections exhibit performance gains ranging from 10 to 100 times faster than their non-accelerated counterparts. This latest release introduces the Dremio Reflection Recommender, a pioneering feature that empowers users to accelerate Business Intelligence workloads in a matter of seconds. The Reflection Recommender automatically evaluates an organization's SQL queries and generates recommended Reflections to accelerate them. Tomer Shiran, founder of Dremio, commented, Dremio Reflections accelerate SQL queries by orders of magnitude, eliminating the need for BI extracts/imports and enabling companies to run their most mission-critical BI workloads directly on a lakehouse. With automatic recommendations and next-generation incremental updates, we've made it even easier for organizations to take advantage of this innovative technology. [Source: Business Wire] Reflection Recommender eliminates the need for labor-intensive manual data and workload analysis, making the process of obtaining the fastest and most intelligent query results effortless, requiring only a few simple actions. The user-friendly nature of the Reflection Recommender puts advanced query acceleration capabilities within the reach of all users, significantly saving both time and expenses. Dremio has also refined the process of refreshing Reflections to further bolster query performance and drive cost efficiencies. It now intelligently refreshes Reflections on Apache Iceberg tables, promptly capturing incremental data changes. This innovative approach obviates the requirement for complete data refreshes, resulting in speedier updates and reduced compute expenses. Dremio Reflections eliminates the need for data teams to export data from the data lakehouse into BI extracts or imports for analytical reasons and overcomes performance bottlenecks for BI dashboards and reports. In addition, Reflections negate the necessity of creating precomputed tables within the data lake or data warehouse to achieve sub-second performance for BI workloads, reducing the workload and complexity for data teams. About Dremio Dremio is a leading, easy and open data lakehouse solution provider, offering organizations the versatility of self-service analytics coupled with the functionality of a data warehouse and the flexibility of a data lake. Dremio's platform empowers users to harness the lightning-fast SQL query service alongside various processing engines, all on the same dataset. The company distinguishes itself through a pioneering data-as-code methodology akin to Git, which facilitates data experimentation, version control, and governance. This innovative approach enhances agility and empowers organizations to explore and manage their data resources with unprecedented efficiency. Furthermore, Dremio offers a fully managed service that expedites organizations' entry into analytics, allowing them to commence their data-driven journey within minutes.

Read More

Data Science

PingCAP Attains Coveted AWS Data and Analytics Competency Status

PingCAP | September 13, 2023

On September 12, 2023, PingCAP, a prominent distributed SQL database provider, announced its attainment of the coveted Amazon Web Services (AWS) Data and Analytics Competency status. This prestigious designation underscores PingCAP's track record of successfully assisting customers in collecting, storing, governing, and analyzing data at any scale. The achievement of AWS Data and Analytics Competency signifies PingCAP as a distinguished member of the AWS Partner Network (APN), specializing in software solutions tailored to assist enterprises in embracing, developing, and deploying intricate projects on the AWS platform. This designation is reserved for APN members with extensive AWS proficiency who deliver solutions seamlessly within the AWS environment. Moreover, PingCAP has also secured AWS Service Ready designations for both AWS PrivateLink and Amazon Linux 2. The AWS Service Ready Program rigorously assesses AWS partner solutions for compatibility with specific AWS services. To obtain these accolades, PingCAP underwent meticulous technical evaluations of its product architecture, received references from customers, and provided product documentation. By harnessing AWS PrivateLink, customers gain access to a streamlined experience for connecting PingCAP TiDB Cloud with other AWS services and applications, ensuring heightened security and adaptable network configuration. AWS empowers organizations of all sizes with scalable, flexible, and cost-effective solutions, ranging from startups to global enterprises. In support of seamless integration and deployment of these solutions, AWS has instituted the AWS Competency Program, enabling customers to identify AWS Partners with profound industry acumen and expertise. Eddie Xu, Director of Cloud Alliances at PingCAP, commented, We are thrilled to achieve the AWS Data and Analytics Competency. Many of our customers have made long-term strategic investments to build their digital businesses on AWS. Being a part of this program reflects PingCAP's commitment to delivering a solution that meets security, compliance, and efficiency standards in support of our customers scaling their transactional workloads on AWS. [Source: Globe Newswire] About PingCAP PingCAP, headquartered in Silicon Valley, is the visionary behind TiDB, an advanced, open-source, distributed SQL database. This database powers modern applications, boasting a streamlined tech stack, elastic scalability, real-time analytics, and uninterrupted access to data—all unified within a singular database solution. These innovative capabilities liberate emerging enterprises from the complexities of data infrastructure management, allowing them to set their sights firmly on the future. Some of the world's leading businesses across the travel, technology, financial services, web3, and gaming sectors trust TiDB to manage their mission-critical workloads.

Read More

Big Data Management

iMerit Unveils Innovative Solution for Radiology AI Data Challenges

iMerit | September 07, 2023

iMerit, a prominent player in the field of artificial intelligence (AI) data solutions, has unveiled its latest offering, the Radiology Annotation Product Suite. This innovative suite is designed to cater to the needs of medical AI developers by providing advanced automation, annotation, and analytics capabilities. This new product suite is firmly rooted in iMerit's Ango Hub platform, an end-to-end enterprise-grade technology platform that is specifically tailored to deliver top-notch data annotation tools for AI development teams. Within this suite, a comprehensive range of solutions awaits, including data sourcing, workflow design, cutting-edge data annotation tools, and the invaluable input of human experts, all seamlessly integrated into a single platform. This unique fusion of iMerit's technological prowess and radiology expertise ensures a smooth journey from training data all the way to regulatory benchmarking. A significant hurdle in radiology AI applications is the demand for specialized tools and insights from domain experts to ensure the necessary accuracy and precision in training data. For developers, the Radiology Annotation Product Suite offers a one-stop solution, combining automation, annotation tools, and analytics within a single platform, facilitating the creation of precise data pipelines essential for quick scaling radiology AI solutions into production. Sina Bari MD, Senior Director of Medical AI at iMerit, explained that their suite aims to combine human expertise, data management, and automation in a single solution. Notable features include Customized workflows designed for Radiologists with consensus and multistep capabilities. Diagnostic-level annotation accuracy with multiplanar functionality and 3D volume rendering. Efficient annotation facilitated by smart automation tools and model integration. Stringent data security and regulatory compliance, including CFR 21 Part 11, HIPAA, and SOC2. This solution seamlessly integrates U.S. and offshore experts, including board-certified radiologists, all within a highly secure end-to-end platform, ensuring cost-effective scaling of annotation efforts. Radha Basu, Founder and CEO of iMerit, emphasized the importance of their work, stating that they understand the challenges of developing AI applications and that their suite was built to scale data annotation efforts with high quality, accuracy, and speed. About iMerit iMerit is a prominent AI data solutions company specializing in data services such as dataset creation, image tagging, sentiment analysis, data verification, and content aggregation. It serves Fortune 500 enterprises in various industries and have a global presence, with headquarters in the United States and teams in India, the US, Bhutan, and Europe. iMerit's investors include Omidyar Network, Dell.org, Khosla Ventures, and British International Investment.

Read More

Spotlight

Are you looking for a solution to break down data silos, democratize access, and unleash the true power of data within your enterprise? Check out how Modak has brought automation of the data life cycle within an organization leading toward innovation.

Modak is a leading provider of data engineering solutions, empowering organizations to harness the power of their data with a focus on simplicity, automation, and scalability. Modak offers innovative products and services that streamline data processes and drive actionable insights.

Resources