Business Intelligence, Big Data Management

InfluxData Brings Native Data Collection to InfluxDB

InfluxData
InfluxData, creator of the leading time series platform InfluxDB, today announced new serverless capabilities to expedite time series data collection, processing, and storage in InfluxDB Cloud. InfluxDB Native Collectors enable developers building with InfluxDB Cloud to subscribe to, process, transform, and store real-time data from messaging and other public and private brokers and queues with a click of a button. Currently available for MQTT, Native Collectors introduce the fastest way to get data from third-party brokers into InfluxDB Cloud without the need for additional software or new code.

Time series data comes from many different sources and widely distributed assets and applications. To make sense of all this data, developers need to consolidate time series data in a central location. However, the pipelines from data sources to the database are complex and require resource-intensive customizations, creating additional challenges for developers. Other systems require an intermediary layer to transfer and transform data from external systems to the cloud. InfluxDB Native Collectors expedites this process by removing that intermediary layer, allowing cloud data sources to connect directly to InfluxDB Cloud so developers can collect, transform, and store time series data in cloud environments directly and without writing new code.

“Data is born in the cloud at an exponential rate, but existing data pipeline tools that integrate multi-vendor cloud services are expensive, complex, and a burden for developers to manage. “With Native Collectors, we’re expediting device to cloud data transfers so developers can focus on building and scaling applications with their time series data. These updates enable InfluxDB Cloud to become a serverless consumer of data through easily configured topic subscriptions, greatly simplifying time series data pipelines and applications alike.”

Rick Spencer, Vice President of Products, InfluxData

According to Gartner®, “Organizations want to make decisions faster and with more confidence. Data and analytics (D&A) leaders are under pressure to support these decisions with high-quality data governed across a range of users, use cases, architectures and deployment options. Data management teams are often too busy responding to requests (execution focused) to ensure data availability. This leaves them little time to focus on enablement and innovation. Many D&A leaders expect cloud migration/modernization to solve the above challenges and bring additional cost and time savings.”

Expedite Time Series Cloud Ingestion with InfluxDB Native Collectors

InfluxData’s Native Collectors gives teams a faster way to ingest time series data in the cloud in one step and without customization, orchestration, or additional hosting services. After setting up service-to-service integrations between third-party brokers and InfluxDB Cloud with a few simple steps, users can:
  • Ingest data with simple low code setup: Ingest data into InfluxDB Cloud with a click of a button and without writing any code for immediate processing.
  • Contextualize data across distributed architectures: Plug Native Collectors into device-to-cloud data streams to enhance application operations, performance, and security.
  • Reduce complexity through platform consolidation: Consume data directly into InfluxDB Cloud through standard subscriptions with no additional agents or coding. Removes the need to run InfluxDB-specific processing in third-party platforms or code.
  • Deliver real-time data ingestion: Faster data onboarding and ingestion with unprecedented simplicity, speed, and scale, directly from the InfluxDB Cloud user interface.
  • Out-of-the-box data filtering and processing: Enrich, format, and process data before it’s ingested into InfluxDB Cloud for analysis. Reduce storage costs through automatic data filtering.

“We are seeing new and fast-growing workloads within our cloud-native MQTT service, but most developers have difficulty in efficiently offloading this data into a time series database,” said Ian Skerrett, Vice President of Marketing, HiveMQ. “InfluxData’s Native Collectors eliminate this challenge, move the database integration workloads back to the database, and turn InfluxDB Cloud into a simple MQTT client – a model that IoT and application developers understand and use regularly.”

Native MQTT is available immediately for InfluxDB Cloud users. Additional Native Collectors for Apache Kafka and AMQP are planned for late 2022, with new collectors to be rolled out in the future.

About InfluxData
InfluxData is the creator of InfluxDB, the leading time series platform. We empower developers and organizations, such as Cisco, IBM, Siemens and Tesla, to build real-time IoT, analytics and cloud applications with time-stamped data. Our technology is purpose-built to handle the massive volumes of data produced by sensors, systems or applications that change over time. Easy to start and scale, InfluxDB gives developers time to focus on the features and functionalities that give their apps a competitive edge. InfluxData is headquartered in San Francisco, with a workforce distributed worldwide.

Spotlight

Other News
Big Data

Airbyte Racks Up Awards from InfoWorld, BigDATAwire, Built In; Builds Largest and Fastest-Growing User Community

Airbyte | January 30, 2024

Airbyte, creators of the leading open-source data movement infrastructure, today announced a series of accomplishments and awards reinforcing its standing as the largest and fastest-growing data movement community. With a focus on innovation, community engagement, and performance enhancement, Airbyte continues to revolutionize the way data is handled and processed across industries. “Airbyte proudly stands as the front-runner in the data movement landscape with the largest community of more than 5,000 daily users and over 125,000 deployments, with monthly data synchronizations of over 2 petabytes,” said Michel Tricot, co-founder and CEO, Airbyte. “This unparalleled growth is a testament to Airbyte's widespread adoption by users and the trust placed in its capabilities.” The Airbyte community has more than 800 code contributors and 12,000 stars on GitHub. Recently, the company held its second annual virtual conference called move(data), which attracted over 5,000 attendees. Airbyte was named an InfoWorld Technology of the Year Award finalist: Data Management – Integration (in October) for cutting-edge products that are changing how IT organizations work and how companies do business. And, at the start of this year, was named to the Built In 2024 Best Places To Work Award in San Francisco – Best Startups to Work For, recognizing the company's commitment to fostering a positive work environment, remote and flexible work opportunities, and programs for diversity, equity, and inclusion. Today, the company received the BigDATAwire Readers/Editors Choice Award – Big Data and AI Startup, which recognizes companies and products that have made a difference. Other key milestones in 2023 include the following. Availability of more than 350 data connectors, making Airbyte the platform with the most connectors in the industry. The company aims to increase that to 500 high-quality connectors supported by the end of this year. More than 2,000 custom connectors were created with the Airbyte No-Code Connector Builder, which enables data connectors to be made in minutes. Significant performance improvement with database replication speed increased by 10 times to support larger datasets. Added support for five vector databases, in addition to unstructured data sources, as the first company to build a bridge between data movement platforms and artificial intelligence (AI). Looking ahead, Airbyte will introduce data lakehouse destinations, as well as a new Publish feature to push data to API destinations. About Airbyte Airbyte is the open-source data movement infrastructure leader running in the safety of your cloud and syncing data from applications, APIs, and databases to data warehouses, lakes, and other destinations. Airbyte offers four products: Airbyte Open Source, Airbyte Self-Managed, Airbyte Cloud, and Powered by Airbyte. Airbyte was co-founded by Michel Tricot (former director of engineering and head of integrations at Liveramp and RideOS) and John Lafleur (serial entrepreneur of dev tools and B2B). The company is headquartered in San Francisco with a distributed team around the world. To learn more, visit airbyte.com.

Read More