Big Data
Airbyte | January 30, 2024
Airbyte, creators of the leading open-source data movement infrastructure, today announced a series of accomplishments and awards reinforcing its standing as the largest and fastest-growing data movement community. With a focus on innovation, community engagement, and performance enhancement, Airbyte continues to revolutionize the way data is handled and processed across industries.
“Airbyte proudly stands as the front-runner in the data movement landscape with the largest community of more than 5,000 daily users and over 125,000 deployments, with monthly data synchronizations of over 2 petabytes,” said Michel Tricot, co-founder and CEO, Airbyte. “This unparalleled growth is a testament to Airbyte's widespread adoption by users and the trust placed in its capabilities.”
The Airbyte community has more than 800 code contributors and 12,000 stars on GitHub. Recently, the company held its second annual virtual conference called move(data), which attracted over 5,000 attendees.
Airbyte was named an InfoWorld Technology of the Year Award finalist: Data Management – Integration (in October) for cutting-edge products that are changing how IT organizations work and how companies do business. And, at the start of this year, was named to the Built In 2024 Best Places To Work Award in San Francisco – Best Startups to Work For, recognizing the company's commitment to fostering a positive work environment, remote and flexible work opportunities, and programs for diversity, equity, and inclusion. Today, the company received the BigDATAwire Readers/Editors Choice Award – Big Data and AI Startup, which recognizes companies and products that have made a difference.
Other key milestones in 2023 include the following.
Availability of more than 350 data connectors, making Airbyte the platform with the most connectors in the industry. The company aims to increase that to 500 high-quality connectors supported by the end of this year.
More than 2,000 custom connectors were created with the Airbyte No-Code Connector Builder, which enables data connectors to be made in minutes.
Significant performance improvement with database replication speed increased by 10 times to support larger datasets.
Added support for five vector databases, in addition to unstructured data sources, as the first company to build a bridge between data movement platforms and artificial intelligence (AI).
Looking ahead, Airbyte will introduce data lakehouse destinations, as well as a new Publish feature to push data to API destinations.
About Airbyte
Airbyte is the open-source data movement infrastructure leader running in the safety of your cloud and syncing data from applications, APIs, and databases to data warehouses, lakes, and other destinations. Airbyte offers four products: Airbyte Open Source, Airbyte Self-Managed, Airbyte Cloud, and Powered by Airbyte. Airbyte was co-founded by Michel Tricot (former director of engineering and head of integrations at Liveramp and RideOS) and John Lafleur (serial entrepreneur of dev tools and B2B). The company is headquartered in San Francisco with a distributed team around the world. To learn more, visit airbyte.com.
Read More
Big Data Management
Dremio | January 05, 2024
Dremio, the easy and open data lakehouse, and Carahsoft Technology Corp., The Trusted Government IT Solutions Provider, today announced a partnership. Under the agreement, Carahsoft will serve as Dremio’s Master Government Aggregator®, making the company’s complete cloud and software portfolio for Government, Defense, Intelligence and Education available through Carahsoft’s reseller partners and NASA Solutions for Enterprise-Wide Procurement (SEWP) V, Information Technology Enterprise Solutions – Software 2 (ITES-SW2), National Association of State Procurement Officials (NASPO) ValuePoint, National Cooperative Purchasing Alliance (NCPA) and OMNIA Partners contracts.
This collaboration paves the way for Public Sector organizations to harness cutting-edge data analytics capabilities which empower them to make smarter decisions and significantly enhance operational efficiency through lightning-fast data access. Dremio propels agencies into the future by embracing a state-of-the-art data lakehouse architecture in Public Sector organizations. By transitioning to Dremio's solutions, organizations can enjoy sub-second query performance and a remarkable 10-fold improvement in price performance. The new environment eliminates costly and complex legacy data lake solutions and implements a flexible, highly modern architecture.
Dremio provides cost-effective self-service analytics and data management, simplifying data pipelines and ETL complexity while accelerating insights across diverse storage locations. With a proven track record of modernizing legacy Hadoop environments and implementing the modern data lakehouse solution, Dremio and Carahsoft aim to transform Public Sector data management by breaking down data silos. Embracing a data mesh concept enables efficient handling of various data sources, fostering cross- collaboration and decentralized data control. Dremio’s expertise supports Public Sector agencies in implementing these principles, eradicating data silos for a more collaborative and efficient approach to data analytics.
"Public sector organizations face a range of data infrastructure challenges, many of which are common to both Government and non-government entities. These issues often hinder effective data management, analysis, and decision-making,” said Roger Frey, Vice President of Alliances at Dremio. “Dremio's mission is to make data easily accessible and analyzable for all users, regardless of where it resides. We are excited to partner with Carahsoft to bring our state-of-the-art data analytics solutions to the Public Sector."
“Within the Public Sector’s intricate data landscape, complexities often impede efficient data management and decision making,” said Laura Howton, Sales Director who leads the Analytics and Data Management Team at Carahsoft. “By adding Dremio to our AI and Machine Learning portfolio, our reseller partners can now provide modern, cost-effective and easily accessible data analytics tools to Government customers, bolstering their modernization efforts.”
Dremio’s solutions are available through Carahsoft’s SEWP V contracts NNG15SC03B and NNG15SC27B, ITES-SW2 Contract W52P1J-20-D-0042, NASPO ValuePoint Master Agreement #AR2472, NCPA Contract NCPA01-86 and OMNIA Partners Contract #R191902. For more information, contact the Carahsoft team at 571-591-6430 or Dremio@carahsoft.com; or register for a complimentary webcast, “The Key Steps in Decreasing Costs and Improving Performance Through Data Lake Modernization,” Thursday, January 25, at 2p.m.
About Dremio
Dremio is the easy and open data lakehouse, providing self-service analytics with data warehouse functionality and data lake flexibility across all of your data. Use Dremio's lightning-fast SQL query service and any other processing engine on the same data. Dremio increases agility with a revolutionary data-as-code approach that enables Git-like data experimentation, version control, and governance. In addition, Dremio eliminates data silos by enabling queries across data lakes, databases, and data warehouses, and by simplifying ingestion into the lakehouse. Dremio's fully managed service helps organizations get started with analytics in minutes, and automatically optimizes data for every workload. As the original creator of Apache Arrow and committed to Arrow and Iceberg’s community-driven standards, Dremio is on a mission to reinvent SQL for data lakes and meet customers where they are on their lakehouse journey.
Read More
Big Data Management
The Modern Data Company | January 23, 2024
The Modern Data Company, recognized for its expertise in developing and managing advanced data products, is delighted to announce its distinction as an honorable mention in Gartner's 'Magic Quadrant for Data Integration Tools,' powered by our leading product, DataOS.
“This accolade underscores our commitment to productizing data and revolutionizing data management technologies. Our focus extends beyond traditional data management, guiding companies on their journey to effectively utilize data, realize tangible ROI on their data investments, and harness advanced technologies such as AI, ML, and Large Language Models (LLMs). This recognition is a testament to Modern Data’s alignment with the latest industry trends and our dedication to setting new standards in data integration and utilization.” – Srujan Akula, CEO of The Modern Data Company
The inclusion in the Gartner report highlights The Modern Data Company's pivotal role in shaping the future of data integration. Our innovative approach, embodied in DataOS, enables businesses to navigate the complexities of data management, transforming data into a strategic asset. By simplifying data access and integration, we empower organizations to unlock the full potential of their data, driving insights and innovation without disruption.
"Modern Data's recognition as an Honorable Mention in the Gartner MQ for Data Integration is a testament to the transformative impact their solutions have on businesses like ours. DataOS has been pivotal in allowing us to integrate multiple data sources, enabling our teams to have access to the data needed to make data driven decisions." – Emma Spight, SVP Technology, MIND 24-7
The Modern Data Company simplifies how organizations manage, access, and interact with data using its DataOS (data operating system) that unifies data silos, at scale. It provides ontology support, graph modeling, and a virtual data tier (e.g. a customer 360 model). From a technical point of view, it closes the gap from conceptual to physical data model. Users can define conceptually what they want and its software traverses and integrates data. DataOS provides a structured, repeatable approach to data integration that enhances agility and ensures high-quality outputs. This shift from traditional pipeline management to data products allows for more efficient data operations, as each 'product' is designed with a specific purpose and standardized interfaces, ensuring consistency across different uses and applications. With DataOS, businesses can expect a transformative impact on their data strategies, marked by increased efficiency and a robust framework for handling complex data ecosystems, allowing for more and faster iterations of conceptual models.
About The Modern Data Company
The Modern Data Company, with its flagship product DataOS, revolutionizes the creation of data products. DataOS® is engineered to build and manage comprehensive data products to foster data mesh adoption, propelling organizations towards a data-driven future. DataOS directly addresses key AI/ML and LLM challenges: ensuring quality data, scaling computational resources, and integrating seamlessly into business processes. In our commitment to provide open systems, we have created an open data developer platform specification that is gaining wide industry support.
Read More