Big Data Management, Data Architecture, Business Strategy

Airbyte No-Code Builder Revolutionizes Data Integrations, Creates Connectors in Just Minutes

Businesswire | May 19, 2023 | Read time : 06:00 min

Airbyte No-Code Builder Revolutionizes Data Integrations

Airbyte, creators of the fastest-growing open-source data integration platform, today announced availability of its new no-code connector builder that makes it possible to easily and quickly create new connectors for data integrations.

The builder enables non-engineers, such as data analysts, to create an extract, load, transform (ELT) connector within just five minutes – a process that traditionally could take more than a week.

This announcement comes as an expansion of Airbyte's efforts to democratize data integration. Last year, Airbyte released a low-code, YAML-based Connector Development Kit, which facilitated faster and easier connector development. Now, with the no-code connector builder, Airbyte is reshaping the paradigm of data pipeline development.

An Airbyte user survey showed 60% of respondents are having to build custom connectors at least every three months because of the need to pull in data from so many diverse sources. The new tool is a game changer for companies struggling to address their long tail of connector needs. With the no-code connector builder, companies no longer need to rely solely on off-the-shelf, existing connectors when considering an ELT solution. Instead, they can now easily build their own connectors to meet their unique data integration needs.

“With businesses adding more data from increasingly diverse sources for analysis and decision-making, we’re making it easy to create custom connectors to serve every possible need,” said John Lafleur, co-founder and chief operating officer, Airbyte. “The combination of our new builder along with our open-source model means more data connectors for our user community of more than 10,000.”

This video has more information on the Airbyte no-code connector builder, including these benefits.

  • User-friendly Interface: The no-code connector builder is designed to be intuitive and easy to use, enabling individuals without a technical background to navigate and build connectors with ease.
  • Rapid Connector Development: The tool drastically reduces the time needed to create an ELT connector, from over a week to just five minutes.
  • Flexibility: By allowing companies to build their own connectors, Airbyte empowers them to address their unique data integration needs without having to rely solely on pre-existing connectors.
  • Wide Availability: The no-code connector builder is available on both Airbyte Open Source and Airbyte Cloud, allowing for broad access and usage.

Airbyte's no-code connector builder is a testament to the company's commitment to making data integration more accessible, flexible, and efficient for companies of all sizes and individuals of varying technical abilities. With more than 300 connectors, Airbyte is already the platform with the most connectors in the market. But there are still thousands of connectors needed. By removing the need for complex coding and significantly reducing the time required to build an ELT connector, this tool is set to revolutionize the way companies approach their long tail of connector needs.

Since the beta release of the Airbyte connector builder two months ago, more than 100 connectors have been built and deployed to production by users to support critical data movement workloads for long-tail connectors. Here are comments from two users of the beta version about their experience with the new Airbyte connector builder.

"The Airbyte no-code connector builder UI is border-line magic. A common data warehouse might have 10 to several hundred APIs integrated. Most, if not all of them, are HTTPS REST APIs meaning historically you'll have a lot of boilerplate code written for each and any integration. Furthermore, a good and stable integration not only needs to transfer data, it needs to implement retries, stream slices, checkpoints and many more – again resulting in copy/paste boilerplate code. Using the no-code connector builder, all of that is provided out of the box. Simply add your API details in a user-friendly point-and-click interface and the Airbyte builder automatically creates a fully-fledged, feature-rich data integration. Where a custom integration normally required days and weeks of work, with the connector builder I'm able to integrate new tools in hours! And all the production-requirements are covered – even Unit- and Integration-Tests are created for you." Andreas Nigg, a Data Architect at DataScienceEngineer

“The connector builder has been a true unlock for our backend piping across many dimensions: speed, efficiency, reliability and ease of use. It has enabled us to convert endless lines of self-build Python ETL scripts, that carried a lot of technical debt, and was tedious to update at the same pace as our operations clock-rate, into beautiful Airbyte connectors that just work. We've had a blast building them and enjoyed swift and highly-qualified support from the Airbyte team.” Tobias Troelsen, Chief Analytics Officer at Capturi

Airbyte makes moving data easy and affordable across almost any source and destination, helping enterprises provide their users with access to the right data for analysis and decision-making. Airbyte has the largest data engineering contributor community – with more than 800 contributors – and the best tooling to build and maintain connectors with its latest Connector builder.

About Airbyte

Airbyte is the open-source data integration leader running in the safety of your cloud and syncing data from applications, APIs, and databases to data warehouses, lakes, and other destinations. Airbyte was co-founded by Michel Tricot (former director of engineering and head of integrations at Liveramp and RideOS) and John Lafleur (serial entrepreneur of dev tools and B2B). The company is headquartered in San Francisco with a distributed team around the world. To learn more, visit airbyte.com.

Spotlight

Integrating analytics into UX work helps to make data-based decisions and focus efforts on projects with the most significant impact.

Spotlight

Integrating analytics into UX work helps to make data-based decisions and focus efforts on projects with the most significant impact.

Related News

Data Architecture

IQVIA Earns Healthcare Leader Recognition in Data Stack Awards

IQVIA | September 18, 2023

Snowflake recognizes IQVIA as a Global Healthcare Leader in the Measurement and Attribution category as part of its annual Modern Marketing Data Stack awards. The Modern Marketing Data Stack report comprehensively analyzes data tools, applications, technologies, and processes in marketing data stacks. Orchestrated Analytics GM Tanveer Nasir expressed his gratitude for the recognition and emphasized the company's commitment to improving brand performance and patient lives through data-driven insights and solutions. Snowflake, a leading data cloud platform, has recognized IQVIA as a Global Healthcare Leader in the prestigious Measurement and Attribution category. This recognition comes as part of Snowflake's annual Modern Marketing Data Stack awards. The Modern Marketing Data Stack report is the outcome of a comprehensive year-long analysis focusing on data tools, applications, technologies, and processes employed by organizations in their marketing data stacks. This exhaustive assessment, encompassing approximately 8,100 Snowflake customers, employs a weighted scoring algorithm to discern "marketplace leaders" across diverse data-driven business functions and technology categories. The report underscores IQVIA's proficiency in aiding healthcare and life sciences organizations in the compliant utilization of extensive data resources. This enables swift and precise measurement and reporting, ultimately leading to actionable insights that facilitate informed decision-making and the formulation of effective sales and marketing strategies. In recent years, life sciences firms have significantly increased their investments in business intelligence (BI) solutions to enhance their competitiveness and performance. However, this growth has also brought forth challenges, such as analytics failing to address essential business questions, the absence of a "single source of truth" for dependable insights, and the inability to prioritize personalized prescriptive insights. IQVIA's Orchestrated Analytics platform has emerged as a preeminent solution in the industry due to its comprehensive consulting and change management approach. This approach guarantees that solutions align with specific business requirements, irrespective of the market while minimizing initial investment risks. Furthermore, the platform offers an array of self-service applications empowering business stakeholders to customize insights and extract reliable and actionable intelligence. An exceptional feature of IQVIA's Orchestrated Analytics is its extensive library of algorithms, featuring over 200 algorithms and a multitude of Key Performance Indicators (KPIs) exceeding 400, all aimed at elevating commercial impact through personalized insights for each user. The platform's user-friendly interface is complemented by embedded smart assistants, ensuring effortless access to personalized intelligence across a spectrum of business intelligence tools. IQVIA's global presence is another hallmark, with a team of over 86,000 experts operating in more than 100 countries. This expansive network accelerates the commercial impact of life sciences companies by furnishing market-relevant insights. In addition, Orchestrated Analytics is entrusted by seven out of the top ten pharmaceutical companies worldwide as they expand their brand portfolios. Tanveer Nasir, General Manager, Orchestrated Analytics, commented We are honored to be selected by Snowflake as the global leader in Measurement and Attribution in their Modern Marketing Data Stack report. [Source: IQVIA] He further explains that their insight recommendations and user adoption framework worked together effectively to enhance the sales force's efficiency and increase productivity. They had exhibited a significant ROI just by demonstrating Rx uplift for a top 10 pharmaceutical brand. Nasir conveyed that their commitment to enhancing brand performance and improving patients' lives worldwide by identifying the right customer at the right time through the correct channel and messaging continues to drive their passion.

Read More

Big Data Management, Data Science, Big Data

McLaren Applied's ATLAS software adds powerful new analytics capabilities with KX partnership

PR Newswire | August 04, 2023

Engineering and technology pioneer McLaren Applied has announced a new data and analytics partnership with leading technology company KX, maker of kdb+ the industry's most trusted Data Timehouse™ and the KDB.AI vector database. The integration will see McLaren Applied's already industry-leading ATLAS platform benefit from integration with KX's advanced kdb+ vector native, time series database, giving motorsport teams the ability to monitor race data, run complex AI and ML queries, and make real-time decisions in the garage for maximum benefit. McLaren Applied's ATLAS (Advanced Telemetry Linked Acquisition System) software package captures, distributes, displays and analyses data from control and data logging systems. Typically used in Motorsport and Automotive applications to date, the addition of KX's third-party software brings the power of ATLAS to other industries and use cases, such as Condition Monitoring, offering better prediction and detection of anomalies, and enabling operators to take preventative action before problems arise. ATLAS users can now leverage cutting-edge data analysis and visualisation enhanced by KX's extreme scalability and market-leading performance. Both powerful and efficient, with a memory footprint of only 800kb, kdb+ can process workloads up to one hundred times faster than traditional stores and at a fraction of the cost. Using this power to augment the insights provided by ATLAS, complex analyses of large datasets in real-time become simpler and easier than ever. Conversely, existing KX customers can also now leverage ATLAS's capability to better understand the behaviour of multiple systems and subsystems via forensic data examination of high frequency data. This not only offers a better way of visualising higher rate data, but allows users to manipulate and process data for more in-depth analysis. Speaking of the announcement, Richard Saxby, Director, Motorsport at McLaren Applied said: "The integration of KX's kdb+ software with our already industry-leading ATLAS platform is fantastic news for both McLaren Applied and our customers. This partnership demonstrates our continued determination to deliver ever greater power, speed and agility to race teams on the pit wall, enabling them to do the same on track. It also opens opportunities for us to bring the power of ATLAS to customers in new markets. "We look forward to seeing how kdb+ compatibility enhances our customers' capability and experience, demonstrating the full potential of ATLAS that can be realised through further in-house and third-party development." Ashok Reddy, CEO at KX, added: "KDB.AI, the industry's number one vector database, handles both structured time series and unstructured data with unparalleled proficiency - a critical function in the fast-paced world of automotive racing. With McLaren Applied, an industry pace-setter renowned for its cutting-edge technology and high-performance solutions, we can bolster the capabilities of the ATLAS platform, already one of the fastest data management and analytics platforms. We are thrilled to further fortify ATLAS's leading position in the industry, while supporting its expansion into new sectors" About McLaren Applied More than three decades in F1 and other cutting-edge global motorsport has given McLaren Applied world-leading expertise in electrification, connectivity, control and sensing. This expertise is also applied to automotive, transport and mining sectors, delivering technologies at scale with a performance advantage. Our peoples' expertise, coupled with our technology and agility, is pioneering a more sustainable, intelligent and connected future. Learn more at https://mclarenapplied.com/ About KX KX is a leading provider of vector database technology for time-series, real-time, and embedded data that provides context and insights at the speed of thought. Its mission is to accelerate the speed of data and AI-driven business innovation enabling customers to transform into real-time, intelligent enterprises. Built for the most demanding data environments, our Data Timehouse™ platform is trusted by the world's top investment banks and hedge funds, and leading companies in the life and health sciences, semiconductor, telecommunications, and manufacturing industries. At the heart of our technology is the kdb+ time series and vector database, independently benchmarked as the fastest on the market. It can process and analyze time series, historical and vector data at unmatched speed and scale, empowering developers, data scientists, and data engineers to build high-performance data-driven applications and turbo-charge their favorite analytics tools in the cloud, on-premise, or at the edge. Ultimately, our technology enables the discovery of richer, actionable insights for faster decision making which drives competitive advantage and transformative growth for our customers. KX operates from more than 15 offices across North America, Europe and Asia Pacific.

Read More

Data Visualization, Data Architecture

Trianz Launches Extrica Data Mesh Platform on AWS Marketplace, Accelerating Governed Data Access and Usage of Analytics & AI for Global Enterprises

PR Newswire | July 13, 2023

Digital transformation software and technology services firm Trianz is thrilled to announce the launch of its configurable data mesh platform Extrica on the AWS Marketplace, offering global enterprises advanced data management capabilities. As the only data mesh born in the cloud, Extrica empowers businesses and IT to harness data 'as-is and where-is'; thus bypassing large data migration and management efforts to deliver analytics 50% faster and more cost effectively. The platform revolutionizes data management by enabling businesses to easily create, maintain, and share data products across their ecosystem, regardless of data location or technology. What sets Extrica apart is that it takes a business approach rather than a technical approach enabling non-technical users – all business roles and personas, human or automated – to have different conversations with the organization's data. Built on world-leading AWS infrastructure and AWS Athena, Extrica allows businesses and their data-teams to source data from any on-prem or cloud source; productize it for repeatable and personalize use by different users; publish it in a unique "Netflix of enterprise data" marketplace experience and consume in visualization platforms such as AWS Quicksight, Power BI, Tableau, Qlikview, or AI and ML channels such as AWS SageMaker. "Extrica Datamesh is the result of two years of disruptive innovation in collaboration with the AWS Athena team. We are now making it available worldwide to customers. Regardless of which cloud they use, any business can harness the power and acceleration of the Extrica Datamesh," said Sri Manchala, CEO of Trianz and author of Crossing the Digital Faultline. "By combining Extrica's innovative data management and analytics capabilities with the scale, security, and reliability of the AWS Marketplace, we are empowering enterprises to securely unlock the value of their data assets—faster and more cost effectively." Trianz Extrica is now available here on the AWS Marketplace, providing organizations with a streamlined and secure pathway to leverage the platform's capabilities. Or find Extrica by visiting the AWS Marketplace https://aws.amazon.com/marketplace and searching for Extrica. About Trianz Trianz simplifies the digital evolution of companies from strategy through execution. With a unique, multi-disciplinary and collaborative model, Trianz works with clients to transition to new business models, digitalized processes and deliver great experiences utilizing analytics, digital, cloud, infrastructure, and cyber security technologies. Leveraging a portfolio of digital platforms covering digital workplaces, cloud and infrastructure, and analytics, Trianz helps clients accelerate their transformations.

Read More