Big Data Management

Breakthrough for Database Replication Introduced by Fivetran

Fivetran, a global leader in data integration, announced the acquisition of Teleport Data, bringing breakthrough innovation to the challenges of database replication.

It can be difficult to track changes and ensure data quality and consistency when trying to transfer data from the source location to a data warehouse with the ever-changing source location. Solutions like snapshots- which take a picture of that data from one static point in time- are slow and not in real-time, while log-based change data capture solutions are difficult to configure and set up. Fivetran Teleport Sync makes database replication simple like snapshots, which deliver performances that in few cases approach the speed of log-based systems while being less intrusive- making access to data easier throughout the organization.

There has been an explosion of data and enterprises and organizations of all sizes are finding it difficult to access insights. Organizations have accelerated their digital transformations, particularly due to Covid-19, new insights from data have become critically important. However, to most quickly and accurately discover them, access to secure database binary log files was required to ship database changes to another target system. This method has proven hard for users to configure, requires specialized security access, and is error-prone. Fivetran Teleport Sync avoids these challenges completely by moving only the changed data, without requiring access to secure binary log files. The new capability will be available later this year.

Additional benefits of Teleport Sync include:

• Less database overhead typically associated with logs, timestamp columns to specify changes or primary keys on illogical tables.

• A code-free method to set up historical analysis. Teleport Sync captures all data without highly customized scripts.

• Improvement on throughput without needing network engineers or extra/load query analysis.

Fivetran has introduced several other database replication enhancements that make centralizing data easier for data systems, including history mode, a code-free approach to historical analysis that records every version of each record in the source table to the corresponding table in a destination. Fivetran also continuously delivers speed improvements like the end-to-end replication process. From data extraction improvements to processing and load optimizations, Fivetran has improved its speed throughout the board.

About Fivetran
Fivetran is a leader in automated data integration which delivers ready-to-use connectors that automatically adapt as schemas and APIs change, ensuring consistent, reliable access to data. Fivetran increases the accuracy of data-driven decisions by continuously synchronizing data from source applications to any destination, which allows analysts to work with the freshest possible data. To accelerate analytics, Fivetran automates in-warehouse transformations and programmatically manages ready-to-query schemas. Fivetran is headquartered in Oakland, California, with offices around the globe.

Spotlight

Other News
Big Data

Airbyte Racks Up Awards from InfoWorld, BigDATAwire, Built In; Builds Largest and Fastest-Growing User Community

Airbyte | January 30, 2024

Airbyte, creators of the leading open-source data movement infrastructure, today announced a series of accomplishments and awards reinforcing its standing as the largest and fastest-growing data movement community. With a focus on innovation, community engagement, and performance enhancement, Airbyte continues to revolutionize the way data is handled and processed across industries. “Airbyte proudly stands as the front-runner in the data movement landscape with the largest community of more than 5,000 daily users and over 125,000 deployments, with monthly data synchronizations of over 2 petabytes,” said Michel Tricot, co-founder and CEO, Airbyte. “This unparalleled growth is a testament to Airbyte's widespread adoption by users and the trust placed in its capabilities.” The Airbyte community has more than 800 code contributors and 12,000 stars on GitHub. Recently, the company held its second annual virtual conference called move(data), which attracted over 5,000 attendees. Airbyte was named an InfoWorld Technology of the Year Award finalist: Data Management – Integration (in October) for cutting-edge products that are changing how IT organizations work and how companies do business. And, at the start of this year, was named to the Built In 2024 Best Places To Work Award in San Francisco – Best Startups to Work For, recognizing the company's commitment to fostering a positive work environment, remote and flexible work opportunities, and programs for diversity, equity, and inclusion. Today, the company received the BigDATAwire Readers/Editors Choice Award – Big Data and AI Startup, which recognizes companies and products that have made a difference. Other key milestones in 2023 include the following. Availability of more than 350 data connectors, making Airbyte the platform with the most connectors in the industry. The company aims to increase that to 500 high-quality connectors supported by the end of this year. More than 2,000 custom connectors were created with the Airbyte No-Code Connector Builder, which enables data connectors to be made in minutes. Significant performance improvement with database replication speed increased by 10 times to support larger datasets. Added support for five vector databases, in addition to unstructured data sources, as the first company to build a bridge between data movement platforms and artificial intelligence (AI). Looking ahead, Airbyte will introduce data lakehouse destinations, as well as a new Publish feature to push data to API destinations. About Airbyte Airbyte is the open-source data movement infrastructure leader running in the safety of your cloud and syncing data from applications, APIs, and databases to data warehouses, lakes, and other destinations. Airbyte offers four products: Airbyte Open Source, Airbyte Self-Managed, Airbyte Cloud, and Powered by Airbyte. Airbyte was co-founded by Michel Tricot (former director of engineering and head of integrations at Liveramp and RideOS) and John Lafleur (serial entrepreneur of dev tools and B2B). The company is headquartered in San Francisco with a distributed team around the world. To learn more, visit airbyte.com.

Read More