Big Data Management
data.world | January 24, 2024
data.world, the data catalog platform company, today announced an integration with Snowflake, the Data Cloud company, that brings new data quality metrics and measurement capabilities to enterprises. The data.world Snowflake Collector now empowers enterprise data teams to measure data quality across their organization on-demand, unifying data quality and analytics. Customers can now achieve greater trust in their data quality and downstream analytics to support mission-critical applications, confident data-driven decision-making, and AI initiatives.
Data quality remains one of the top concerns for chief data officers and a critical barrier to creating a data-driven culture. Traditionally, data quality assurance has relied on manual oversight – a process that’s tedious and fraught with inefficacy. The data.world Data Catalog Platform now delivers Snowflake data quality metrics directly to customers, streamlining quality assurance timelines and accelerating data-first initiatives.
Data consumers can access contextual information in the catalog or directly within tools such as Tableau and PowerBI via Hoots – data.world’s embedded trust badges – that broadcast data health status and catalog context, bolstering transparency and trust. Additionally, teams can link certification and DataOps workflows to Snowflake's data quality metrics to automate manual workflows and quality alerts. Backed by a knowledge graph architecture, data.world provides greater insight into data quality scores via intelligence on data provenance, usage, and context – all of which support DataOps and governance workflows.
“Data trust is increasingly crucial to every facet of business and data teams are struggling to verify the quality of their data, facing increased scrutiny from developers and decision-makers alike on the downstream impacts of their work, including analytics – and soon enough, AI applications,” said Jeff Hollan, Director, Product Management at Snowflake. “Our collaboration with data.world enables data teams and decision-makers to verify and trust their data’s quality to use in mission-critical applications and analytics across their business.”
“High-quality data has always been a priority among enterprise data teams and decision-makers. As enterprise AI ambitions grow, the number one priority is ensuring the data powering generative AI is clean, consistent, and contextual,” said Bryon Jacob, CTO at data.world. “Alongside Snowflake, we’re taking steps to ensure data scientists, analysts, and leaders can confidently feed AI and analytics applications data that delivers high-quality insights, and supports the type of decision-making that drives their business forward.”
The integration builds on the robust collaboration between data.world and Snowflake. Most recently, the companies announced an exclusive offering for joint customers, streamlining adoption timelines and offering a new attractive price point. The data.world's knowledge graph-powered data catalog already offers unique benefits for Snowflake customers, including support for Snowpark.
This offering is now available to all data.world enterprise customers using the Snowflake Collector, as well as customers taking advantage of the Snowflake-only offering. To learn more about the data quality integration or the data.world data catalog platform, visit data.world.
About data.world
data.world is the data catalog platform built for your AI future. Its cloud-native SaaS (software-as-a-service) platform combines a consumer-grade user experience with a powerful Knowledge Graph to deliver enhanced data discovery, agile data governance, and actionable insights. data.world is a Certified B Corporation and public benefit corporation and home to the world’s largest collaborative open data community with more than two million members, including ninety percent of the Fortune 500. Our company has 76 patents and has been named one of Austin’s Best Places to Work seven years in a row.
Read More
Data Visualization
SensiML | December 20, 2023
SensiML Corporation, a leader in AI software for IoT and a subsidiary of QuickLogic, announced the launch of Data Studio, a ground-breaking platform designed to redefine the landscape of sensor data management. With a focus on practicality and efficiency, Data Studio empowers engineers and data scientists by offering an integrated solution that addresses the most time-consuming tasks in AI engineering projects - creating high-quality datasets for evaluating and developing ML models.
According to Cognilytica, a well-respected AI / ML consulting firm, approximately 80% of the total time for machine learning (ML) projects is allocated to data preparation. These tasks include data identification, aggregation, cleansing, labeling, and augmentation – all of which are supported in SensiML's collaborative development environment.
SensiML Data Studio significantly improves productivity and simplifies dataset management for anyone working on sensor data ML projects. With real-time connectivity, intuitive visualization tools, sensor data video synchronization, and robust support for large-scale collaborative projects, it offers a seamless experience for developers on edge devices, gateways, PCs, and cloud platforms.
A comprehensive overview of all the features of Data Studio can be found on the SensiML website. The primary features are highlighted below:
Effortless Data Capture and Import - Capture live sensor data, analyze it instantly, and label any data for seamless insights.
Collaboratively Label Sensor Data - Employ flexible labeling methodologies for sensor data, including manual, AI-assisted, and custom – and sync video for effortless complex labeling. Store and analyze data locally on your computer or remotely.
Data Analysis and Model Evaluation - Visually compare ML models, filter, transform, and fuse sensor data – all with built-in tools and your own Python expertise.
Label and Data Versioning – Keep track of your labels and model results with versioned labels. Easily export your project to an open format.
"SensiML Data Studio makes sensor data management and analysis more accessible and efficient, empowering developers to build better, more impactful applications using sensor data across a wide range of industries," said Chris Knorowski, CTO of SensiML.
SensiML Data Studio is poised to transform sensor data analysis, offering a valuable resource for researchers, engineers, and data scientists across diverse sectors from agriculture and consumer wearables to medical devices, smart buildings, and factory maintenance.
About SensiML
SensiML, a subsidiary of QuickLogic (NASDAQ: QUIK), offers cutting-edge software that enables ultra-low power IoT endpoints that implement AI to transform raw sensor data into meaningful insight at the device itself. The company's flagship solution, the SensiML Analytics Toolkit, provides an end-to-end development platform spanning data collection, labeling, algorithm and firmware auto-generation, and testing. The SensiML Toolkit supports Arm® Cortex®-M class and higher microcontroller cores, Intel® x86 instruction set processors, and heterogeneous core QuickLogic SoCs and QuickAI platforms with FPGA optimizations.
Read More
Big Data Management
Dremio | January 05, 2024
Dremio, the easy and open data lakehouse, and Carahsoft Technology Corp., The Trusted Government IT Solutions Provider, today announced a partnership. Under the agreement, Carahsoft will serve as Dremio’s Master Government Aggregator®, making the company’s complete cloud and software portfolio for Government, Defense, Intelligence and Education available through Carahsoft’s reseller partners and NASA Solutions for Enterprise-Wide Procurement (SEWP) V, Information Technology Enterprise Solutions – Software 2 (ITES-SW2), National Association of State Procurement Officials (NASPO) ValuePoint, National Cooperative Purchasing Alliance (NCPA) and OMNIA Partners contracts.
This collaboration paves the way for Public Sector organizations to harness cutting-edge data analytics capabilities which empower them to make smarter decisions and significantly enhance operational efficiency through lightning-fast data access. Dremio propels agencies into the future by embracing a state-of-the-art data lakehouse architecture in Public Sector organizations. By transitioning to Dremio's solutions, organizations can enjoy sub-second query performance and a remarkable 10-fold improvement in price performance. The new environment eliminates costly and complex legacy data lake solutions and implements a flexible, highly modern architecture.
Dremio provides cost-effective self-service analytics and data management, simplifying data pipelines and ETL complexity while accelerating insights across diverse storage locations. With a proven track record of modernizing legacy Hadoop environments and implementing the modern data lakehouse solution, Dremio and Carahsoft aim to transform Public Sector data management by breaking down data silos. Embracing a data mesh concept enables efficient handling of various data sources, fostering cross- collaboration and decentralized data control. Dremio’s expertise supports Public Sector agencies in implementing these principles, eradicating data silos for a more collaborative and efficient approach to data analytics.
"Public sector organizations face a range of data infrastructure challenges, many of which are common to both Government and non-government entities. These issues often hinder effective data management, analysis, and decision-making,” said Roger Frey, Vice President of Alliances at Dremio. “Dremio's mission is to make data easily accessible and analyzable for all users, regardless of where it resides. We are excited to partner with Carahsoft to bring our state-of-the-art data analytics solutions to the Public Sector."
“Within the Public Sector’s intricate data landscape, complexities often impede efficient data management and decision making,” said Laura Howton, Sales Director who leads the Analytics and Data Management Team at Carahsoft. “By adding Dremio to our AI and Machine Learning portfolio, our reseller partners can now provide modern, cost-effective and easily accessible data analytics tools to Government customers, bolstering their modernization efforts.”
Dremio’s solutions are available through Carahsoft’s SEWP V contracts NNG15SC03B and NNG15SC27B, ITES-SW2 Contract W52P1J-20-D-0042, NASPO ValuePoint Master Agreement #AR2472, NCPA Contract NCPA01-86 and OMNIA Partners Contract #R191902. For more information, contact the Carahsoft team at 571-591-6430 or Dremio@carahsoft.com; or register for a complimentary webcast, “The Key Steps in Decreasing Costs and Improving Performance Through Data Lake Modernization,” Thursday, January 25, at 2p.m.
About Dremio
Dremio is the easy and open data lakehouse, providing self-service analytics with data warehouse functionality and data lake flexibility across all of your data. Use Dremio's lightning-fast SQL query service and any other processing engine on the same data. Dremio increases agility with a revolutionary data-as-code approach that enables Git-like data experimentation, version control, and governance. In addition, Dremio eliminates data silos by enabling queries across data lakes, databases, and data warehouses, and by simplifying ingestion into the lakehouse. Dremio's fully managed service helps organizations get started with analytics in minutes, and automatically optimizes data for every workload. As the original creator of Apache Arrow and committed to Arrow and Iceberg’s community-driven standards, Dremio is on a mission to reinvent SQL for data lakes and meet customers where they are on their lakehouse journey.
Read More