Big Data Management

Cloudian Partners with WEKA to Deliver High-Performance, Exabyte-Scalable Storage for AI, Machine Learning and Other Advanced Analytics

Cloudian® today announced the integration of its HyperStore® object storage with the WEKA Data Platform for AI, providing high-performance, exabyte-scalable private cloud storage for processing iterative analytical workloads. The combined solution unifies and simplifies the data pipeline for performance-intensive workloads and accelerated DataOps, all easily managed under a single namespace. In addition, the new solution reduces the storage TCO associated with data analytics by a third, compared to traditional storage systems.

Advanced Analytics Workloads Create Data Storage Challenges
Organizations are consuming and creating more data than ever before, and many are applying AI, machine learning (ML) and other advanced analytics on these large data sets to make better decisions in real-time and unlock new revenue streams. These analytics workloads create and use massive data sets that pose significant storage challenges, most importantly the ability to manage the data growth and enable users to extract timely insights from that data. Traditional storage systems simply can’t handle the processing needs or the scalability required for iterative analytics workloads and introduce bottlenecks to productivity and data-driven decision making.

Cloudian-WEKA Next Generation Storage Platform
Together, Cloudian and WEKA enable organizations to overcome the challenges of accelerating and scaling their data pipelines while lowering data analytics storage costs. WEKA’s data platform, built on WekaFS, addresses the storage challenges posed by today’s enterprise AI workloads and other high-performance applications running on-premises, in the cloud or bursting between platforms. The joint solution offers the simplicity of NAS, the performance of SAN or DAS and the scale of object storage, along with accelerating every stage of the data pipeline from data ingestion to cleansing to modeled results.

Integrated through WEKA’s tiering function, Cloudian’s enterprise-grade, software-defined object storage provides the following key benefits:

  • High Performance – Run concurrent workloads while eliminating compute cluster bottlenecks and reducing processing times.
  • Exabyte Scalability – Grow deployments on demand, from terabytes to an exabyte without disruption, achieving the flexibility and elasticity of the public cloud within a private data center or hybrid cloud model.
  • Enterprise-grade Security – Protect data with encryption in flight and at rest, integrated firewall, RBAC/IAM and SAML access controls, and certification with the most rigorous regulatory requirements, such as Common Criteria, FIPS and SEC Rule 17a-4(f).
  • Resiliency – Achieve high data durability with the option to protect and distribute data using replication or erasure coding, thereby eliminating the need for a separate data backup process.
  • Multi-tenancy – Provision multiple users on shared infrastructure without compromising security.
  • Cost-effective – Save on storage costs, as the solution runs on standard x86 hardware with local NVMe SSDs.
“As organizations increasingly employ AI, ML and other advanced analytics to extract greater value from their data, they need a modern storage platform that enables fast, easy data processing and management,” said Jonathan Martin, president, WEKA. “The combination of the WEKA Data Platform and Cloudian object storage provides an ideal solution that can seamlessly and cost-effectively scale to meet growing demands.”

“When it comes to supporting advanced analytics applications, users shouldn’t have to make tradeoffs between storage performance and capacity,” said Jon Toor, chief marketing officer, Cloudian. “By eliminating any need to compromise, the integration of our HyperStore software with the WEKA Data Platform gives customers a storage foundation that enables them to fully leverage these applications so they can gain new insights from their data and drive greater business and operational success.”

About Cloudian
Cloudian is the most widely deployed independent provider of object storage. With a native S3 API, it brings the scalability and flexibility of public cloud storage into the data center while providing ransomware protection and reducing TCO by up to 70% compared to traditional SAN/NAS and public cloud. The geo-distributed architecture enables users to manage and protect object and file data across sites—on-premises and in the cloud—from a single platform.

Spotlight

Other News
Data Visualization, Data Science

DAS42 Announces Subscriber Analytics Solution on the Snowflake Data Cloud

DAS42 | December 12, 2023

DAS42, a leading data consultancy, today announced a new solution, Subscriber Analytics. By bringing together the data experts at DAS42 and the power of Snowflake’s Media Data Cloud, Subscriber Analytics is built to solve the myriad of challenges subscriber-driven businesses face when digesting and analyzing the millions of data points collected daily. “We are thrilled to announce our Subscriber Analytics solution, in collaboration with Snowflake,” said Tom Stentiford, Chief Delivery Officer at DAS42. “We’ve created a solution that’s instrumental in driving descriptive and predictive insights into business-critical subscriber-based metrics around customer churn and retention, financial performance and modeling, acquisition, and other areas. In a competitive market, we’re setting our customers up for success when it comes to analyzing user and subscriber data, which cannot be easily leveraged without the right tools.” Whether it’s a lack of consumer data for the product team or the abundance of data from various marketing channels, subscription-driven businesses are overwhelmed and need a way to bring disparate data sources into one holistic data platform and a single source of truth. With the Subscriber Analytics solution, leveraging the Snowflake Data Cloud, leaders can drive faster, more informed business decisions, resulting in an increase in subscriber engagement and, ultimately, improved subscriber retention. “Subscriber Analytics from DAS42 and Snowflake is instrumental in customer churn prevention, revenue forecasting, and financial modeling,” said Frank Cittadino, Former CTO of Zayo. “By partnering with DAS42, everyone from our executive team to our engineers experienced measurable efficiency improvements, leveraging data insights for impactful business decisions. Our collective team saves hours weekly by implementing DAS42’s holistic data governance strategy for our first-, second-, and third-party data.” With Subscriber Analytics, businesses will also be able to: Personalize the customer experience by aggregating subscriber behavior and engagement metrics, helping business intelligence and marketing teams save time, create bespoke campaigns and improve customer relationships. Predict trends with transactional data to inform business strategy and accurately forecast revenue, helping business leaders to make faster and better-informed decisions Prevent customer churn allowing for the organization to keep the subscriber base they have, as well as focus on cross-sell and up-sell opportunities "DAS42's Subscriber Analytics solution leverages the value of Snowflake’s Media Data Cloud to innovate and accelerate data-driven insights,” said Adrian Bolosan, Industry Principal, Media, Entertainment & Advertising at Snowflake. “By seamlessly integrating with Snowflake's unified platform, DAS42's Subscriber Analytics solution empowers customers to unlock the full potential of their data. Together, we are not just providing a solution; we are helping to modernize organizations' approach to data intelligence to help them overcome challenges and achieve success in the initiatives that are most important to their business.” Subscriber Analytics is the latest example of the expertise provided by DAS42 and Snowflake, helping subscriber-driven businesses to unlock the true power of data and create more impactful experiences for subscribers and users alike. ABOUT DAS42 DAS42 is a premier data and analytics consultancy with a modern point of view. We specialize in solving some of the most complex business challenges for the world’s most successful companies. As a Snowflake Elite Partner, DAS42 crafts customized strategies that create a single source of truth and enable enhanced and faster decision-making. DAS42 has a presence across the U.S. with primary offices in New York City and Denver. Connect with us at das42.com and stay updated on LinkedIn. Join us today on our journey to help you realize the possibilities of transforming your business through data and analytics.

Read More

Big Data Management

data.world Integrates with Snowflake Data Quality Metrics to Bolster Data Trust

data.world | January 24, 2024

data.world, the data catalog platform company, today announced an integration with Snowflake, the Data Cloud company, that brings new data quality metrics and measurement capabilities to enterprises. The data.world Snowflake Collector now empowers enterprise data teams to measure data quality across their organization on-demand, unifying data quality and analytics. Customers can now achieve greater trust in their data quality and downstream analytics to support mission-critical applications, confident data-driven decision-making, and AI initiatives. Data quality remains one of the top concerns for chief data officers and a critical barrier to creating a data-driven culture. Traditionally, data quality assurance has relied on manual oversight – a process that’s tedious and fraught with inefficacy. The data.world Data Catalog Platform now delivers Snowflake data quality metrics directly to customers, streamlining quality assurance timelines and accelerating data-first initiatives. Data consumers can access contextual information in the catalog or directly within tools such as Tableau and PowerBI via Hoots – data.world’s embedded trust badges – that broadcast data health status and catalog context, bolstering transparency and trust. Additionally, teams can link certification and DataOps workflows to Snowflake's data quality metrics to automate manual workflows and quality alerts. Backed by a knowledge graph architecture, data.world provides greater insight into data quality scores via intelligence on data provenance, usage, and context – all of which support DataOps and governance workflows. “Data trust is increasingly crucial to every facet of business and data teams are struggling to verify the quality of their data, facing increased scrutiny from developers and decision-makers alike on the downstream impacts of their work, including analytics – and soon enough, AI applications,” said Jeff Hollan, Director, Product Management at Snowflake. “Our collaboration with data.world enables data teams and decision-makers to verify and trust their data’s quality to use in mission-critical applications and analytics across their business.” “High-quality data has always been a priority among enterprise data teams and decision-makers. As enterprise AI ambitions grow, the number one priority is ensuring the data powering generative AI is clean, consistent, and contextual,” said Bryon Jacob, CTO at data.world. “Alongside Snowflake, we’re taking steps to ensure data scientists, analysts, and leaders can confidently feed AI and analytics applications data that delivers high-quality insights, and supports the type of decision-making that drives their business forward.” The integration builds on the robust collaboration between data.world and Snowflake. Most recently, the companies announced an exclusive offering for joint customers, streamlining adoption timelines and offering a new attractive price point. The data.world's knowledge graph-powered data catalog already offers unique benefits for Snowflake customers, including support for Snowpark. This offering is now available to all data.world enterprise customers using the Snowflake Collector, as well as customers taking advantage of the Snowflake-only offering. To learn more about the data quality integration or the data.world data catalog platform, visit data.world. About data.world data.world is the data catalog platform built for your AI future. Its cloud-native SaaS (software-as-a-service) platform combines a consumer-grade user experience with a powerful Knowledge Graph to deliver enhanced data discovery, agile data governance, and actionable insights. data.world is a Certified B Corporation and public benefit corporation and home to the world’s largest collaborative open data community with more than two million members, including ninety percent of the Fortune 500. Our company has 76 patents and has been named one of Austin’s Best Places to Work seven years in a row.

Read More

Data Architecture

SingleStore Announces Real-time Data Platform to Further Accelerate AI, Analytics and Application Development

SingleStore | January 25, 2024

SingleStore, the database that allows you to transact, analyze and contextualize data, today announced powerful new capabilities — making it the industry’s only real-time data platform. With its latest release, dubbed SingleStore Pro Max, the company announced ground-breaking features like indexed vector search, an on-demand compute service for GPUs/ CPUs and a new free shared tier, among several other innovative new products. Together, these capabilities shrink development cycles while providing the performance and scale that customers need for building applications. In an explosive generative AI landscape, companies are looking for a modern data platform that’s ready for enterprise AI use cases — one with best-available tooling to accelerate development, simultaneously allowing them to marry structured or semi-structured data residing in enterprise systems with unstructured data lying in data lakes. “We believe that a data platform should both create new revenue streams while also decreasing technological costs and complexity for customers. And this can only happen with simplicity at the core,” said Raj Verma, CEO, SingleStore. “This isn’t just a product update, it’s a quantum leap… SingleStore is offering truly transformative capabilities in a single platform for customers to build all kinds of real-time applications, AI or otherwise.” “At Adobe, we aim to change the world through digital experiences,” said Matt Newman, Principal Data Architect, Adobe. “SingleStore’s latest release is exciting as it pushes what is possible when it comes to database technology, real-time analytics and building modern applications that support AI workloads. We’re looking forward to these new features as more and more of our customers are seeking ways to take full advantage of generative Al capabilities.” Key new features launched include: Indexed vector search. SingleStore has announced support for vector search using Approximate Nearest Neighbor (ANN) vector indexing algorithms, leading to 800-1,000x faster vector search performance than precise methods (KNN). With both full-text and indexed vector search capabilities, SingleStore offers developers true hybrid search that takes advantage of the full power of SQL for queries, joins, filters and aggregations. These capabilities firmly place SingleStore above vector-only databases that require niche query languages and are not designed to meet enterprise security and resiliency needs. Free shared tier. SingleStore has announced a new cloud-based Free Shared Tier that’s designed for startups and developers to quickly bring their ideas to life — without the need to commit to a paid plan. On-demand compute service for GPUs and CPUs. SingleStore announces a compute service that works alongside SingleStore’s native Notebooks to let developers spin up GPUs and CPUs to run database-adjacent workloads including data preparation, ETL, third-party native application frameworks, etc. This capability brings compute to algorithms, rather than the other way around, enabling developers to build highly performant AI applications safely and securely using SingleStore — without unnecessary data movement. New CDC capabilities for data ingest and egress. To ease the burden and costs of moving data in and out of SingleStore, SingleStore is adding native capabilities for real-time Change Data Capture (CDC) in for MongoDB®, MySQL and ingestion from Apache Iceberg without requiring other third party CDC tools. SingleStore will also support CDC out capabilities that ease migrations and enable the use of SingleStore as a source for other applications and databases like data warehouses and lakehouses. SingleStore Kai™. Now generally available, and ready for both analytical and transactional processing for apps originally built on MongoDB. Announced in public preview in early 2023, SingleStore Kai is an API to deliver over 100x faster analytics on MongoDB® with no query changes or data transformations required. Today, SingleStore Kai supports BSON data format natively, has improved transactional performance, increased performance for arrays and offers industry-leading compatibility with MongoDB query language. Projections: To further advance as the world’s fastest HTAP database, SingleStore has added Projections. Projections allow developers to greatly speed up range filters and group by operations by introducing secondary sort and shard keys. Query performance improvements range from 2-3x or more, depending on the size of the table. With this latest release, SingleStore becomes the industry’s first and only real-time data platform designed for all applications, analytics and AI. SingleStore supports high-throughput ingest performance, ACID transactions and low-latency analytics; and structured, semi-structured (JSON, BSON, text) and unstructured data (vector embeddings of audio, video, images, PDFs, etc.). Finally, SingleStore’s data platform is designed not just with developers in mind, but also ML engineers, data engineers and data scientists. “Our new features and capabilities advance SingleStore’s mission of offering a real-time data platform for the next wave of gen AI and data applications,” said Nadeem Asghar, SVP, Product Management + Strategy at SingleStore. “New features, including vector search, Projections, Apache Iceberg, Scheduled Notebooks, autoscaling, GPU compute services, SingleStore Kai™, and the Free Shared Tier allow startups — as well as global enterprises — to quickly build and scale enterprise-grade real-time AI applications. We make data integration with third-party databases easy with both CDC in and CDC out support.” "Although generative AI, LLM, and vector search capabilities are early stage, they promise to deliver a richer data experience with translytical architecture," states the 2023 report, “Translytical Architecture 2.0 Evolves To Support Distributed, Multimodel, And AI Capabilities,” authored by Noel Yuhanna, Vice President and Principal Analyst at Forrester Research. "Generative AI and LLM can help democratize data through natural language query (NLQ), offering a ChatGPT-like interface. Also, vector storage and index can be leveraged to perform similarity searches to support data intelligence." SingleStore has been on a fast track leading innovation around generative AI. The company’s product evolution has been accompanied by high-momentum growth in customers and surpassing $100M in ARR late last year. SingleStore also recently ranked #2 in the emerging category of vector databases, and was recognized by TrustRadius as a top vector database in 2023. Finally, SingleStore was a winner of InfoWorld’s Technology of the year in the database category. To learn more about SingleStore visit here. About SingleStore SingleStore empowers the world’s leading organizations to build and scale modern applications using the only database that allows you to transact, analyze and contextualize data in real time. With streaming data ingestion, support for both transactions and analytics, horizontal scalability and hybrid vector search capabilities, SingleStore helps deliver 10-100x better performance at 1/3 the costs compared to legacy architectures. Hundreds of customers worldwide — including Fortune 500 companies and global data leaders — use SingleStore to power real-time applications and analytics. Learn more at singlestore.com. Follow us @SingleStoreDB on Twitter or visit www.singlestore.com.

Read More

Business Intelligence

EAGLYS, Mitsui and Quantinuum Collaborate to Build a Quantum-Resistant Data Analytics (AI) Platform Using Quantum Computing Hardened Encryption Keys

Mitsui & Co., Ltd | December 13, 2023

In partnership, EAGLYS, Inc., Mitsui & Co., Ltd., and Quantinuum have integrated Quantum Origin into EAGLYS' secure computation product DataArmor, strengthening the platform against the quantum threat to encrypted data. Mitsui and EAGLYS have used secure computation technology to build a platform that allows research institutes and businesses to securely collaborate using each other's data and AI models. DataArmor uniquely maintains the confidentiality and security of sensitive data and AI models using homomorphic encryption, a technology that allows analysis to be performed on data while still encrypted. This protects encrypted data from being revealed when shared, safeguarding organizations and their Intellectual Property against advanced cyber threats. EAGLYS has now integrated Quantum Origin, the world's only solution that uses the power of quantum computing processes to provably strengthen encryption keys, as part of their Quantum-Resistant Data Analytics (AI) Platform. This integration strengthens the resilience of DataArmor against the threat of a quantum-computing-based attack. Quantum computers are expected to empower significant innovation in the future and create approximately 100 trillion yen in value by 20351. At the same time, the development of quantum computing technology presents a new threat to the cryptographic security measures that protect the confidentiality of encrypted data and communications. RSA, one of the most widely used cryptographic algorithms, may soon be deciphered by cybercriminals to expose confidential data. It is unclear when a quantum computer will be capable of cracking existing encryption, but organizations are increasingly concerned about cyber security attacks called 'Hack now, Decrypt later.' A recent Deloitte survey revealed that over 50%2 of cyber professionals believe their organization is at risk from this attack, where malicious third parties steal and store encrypted data to decrypt it when the quantum computing technology is available. As a countermeasure against such potential threats, organizations must strengthen encryption protection for data and AI models by using post-quantum cryptographic algorithms and hardening cryptographic keys. Research institutes and businesses increasingly need to collaborate using each other's data and AI models to accelerate innovation in chemical materials development, drug discovery, financial analysis, and retail trends. To maintain the confidentiality and security of the data and AI models used in these collaborations, EAGLYS' DataArmor platform combines fully homomorphic encryption based on lattice cryptography and Quantum Origin's quantum-derived entropy for key generation to strengthen protection against a quantum computing based attack. Going forward, the three companies will continue to develop new use cases utilizing this platform. "We are pleased to collaborate on this advanced project with Quantinuum, a world-class quantum computing company, and our valued partner Mitsui & Co. This collaboration is an important initiative for our business and will enhance our Homomorphic Encryption platform, enabling us to create new value for our customers through AI and data in a highly secure environment. By deploying the Quantum-Resilient AI Platform together with the three companies, we hope to further increase customer value through secure data sharing and AI in the chemical, medical, financial, and retail industries.", said Hiroki Imabayashi, Founder and CEO, EAGLYS Inc. "Through this collaboration, we are able to present a quantum-resistant data analytics (AI) platform capable of creating new value using EAGLYS' secure computation technology. We are convinced that by combining EAGLYS' secure computation technology with Quantum Origin, DataArmor will become an increasingly important solution to prepare for potential threats that may accompany the commercialization of quantum computers. We will continue collaborating with both companies and focus on realizing new customer value by combining Secure Computation and Quantum Technology." said Koji Naniwada, Deputy General Manager & Senior Tech Lead, Quantum Innovation Dept., Corporate Development Div., Mitsui & Co., Ltd. Duncan Jones, Head of Cybersecurity, Quantinuum, added, "Hardening encryption keys is critical to protecting sensitive data in the post-quantum era, and Quantum Origin is the world's only technology that provably strengthens key generation. By integrating Quantum Origin, EAGLYS is future-proofing the security and integrity of its customer's data." About Quantinuum Quantinuum is one of the world's largest integrated quantum computing companies, formed by the combination of Honeywell Quantum Solutions' world-leading hardware and Cambridge Quantum's class-leading middleware and applications. Quantinuum accelerates quantum computing and the development of applications across chemistry, cybersecurity, finance, and optimization. The company employs over 480 individuals, including 350 scientists, at nine sites across the United States, Europe, and Japan. About Mitsui & Co., Ltd. Mitsui & Co. is a global trading and investment company with a presence in more than 60 countries and a diverse business portfolio covering a wide range of industries. The company identifies, develops, and grows its businesses in partnership with a global network of trusted partners including world leading companies, combining its geographic and cross-industry strengths to create long-term sustainable value for its stakeholders. Mitsui has set three key strategic initiatives for its current Medium-term Management Plan: supporting industries to grow and evolve with stable supplies of resources and materials, and providing infrastructure; promoting a global transition to low-carbon and renewable energy; and empowering people to lead healthy lives through the delivery of quality healthcare and access to good nutrition. About EAGLYS Inc EAGLYS is a company that provides an AI platform that uses AI and Homomorphic Encryption. The company creates new value by collaborating data from various industries such as chemical, manufacturing, medical, and retail. Particularly in the field of chemistry, EAGLYS provides solutions that significantly change industry practices.

Read More