Data storage quicker than a flash, large enough to make servers think Got DRAM Intel makes this possible

Sponsored Flash memory has given a welcome boost to enterprise storage over the past decade or so, allowing applications to overcome the limitations of spinning disk storage systems. This has enabled common enterprise workloads such as databases, business intelligence, and online transaction processing to get faster access to data and deliver increased productivity.But there are signs that this may not be enough for much longer, as the demands of applications such as big data analytics continue to grow, and new and emerging workloads place further demands on storage infrastructure. Can new technology approaches, such as storage class memory, provide the answer?Workloads are now starting to infuse techniques such as AI and machine learning. These may not be widely used in enterprise applications at the moment, however, their use is projected to grow in future, especially when used in combination with other techniques, such as data analytics.In a report [PDF] from Deloitte Insights in 2018, 82 per cent of early adopters of enterprise AI said they had already seen a return on their investments. Nearly 60 per cent said they were seeking to adopt technologies such as machine learning and natural language processing by embedding them in enterprise software systems, such as CRM or ERP installations.There is uptake sector by sector. For example, healthcare professionals are looking at using machine-learning techniques to offer patients a speedier and more reliable diagnosis of health conditions, by analyzing huge volumes of medical imaging scans, for example. A June 2019 report by Broadbridge Financial Solutions, meanwhile, found growing interest in a range of scenarios with AI for data mining, post-trade processing, market analytics, and trading systems.

Spotlight

Other News
Big Data

Airbyte Racks Up Awards from InfoWorld, BigDATAwire, Built In; Builds Largest and Fastest-Growing User Community

Airbyte | January 30, 2024

Airbyte, creators of the leading open-source data movement infrastructure, today announced a series of accomplishments and awards reinforcing its standing as the largest and fastest-growing data movement community. With a focus on innovation, community engagement, and performance enhancement, Airbyte continues to revolutionize the way data is handled and processed across industries. “Airbyte proudly stands as the front-runner in the data movement landscape with the largest community of more than 5,000 daily users and over 125,000 deployments, with monthly data synchronizations of over 2 petabytes,” said Michel Tricot, co-founder and CEO, Airbyte. “This unparalleled growth is a testament to Airbyte's widespread adoption by users and the trust placed in its capabilities.” The Airbyte community has more than 800 code contributors and 12,000 stars on GitHub. Recently, the company held its second annual virtual conference called move(data), which attracted over 5,000 attendees. Airbyte was named an InfoWorld Technology of the Year Award finalist: Data Management – Integration (in October) for cutting-edge products that are changing how IT organizations work and how companies do business. And, at the start of this year, was named to the Built In 2024 Best Places To Work Award in San Francisco – Best Startups to Work For, recognizing the company's commitment to fostering a positive work environment, remote and flexible work opportunities, and programs for diversity, equity, and inclusion. Today, the company received the BigDATAwire Readers/Editors Choice Award – Big Data and AI Startup, which recognizes companies and products that have made a difference. Other key milestones in 2023 include the following. Availability of more than 350 data connectors, making Airbyte the platform with the most connectors in the industry. The company aims to increase that to 500 high-quality connectors supported by the end of this year. More than 2,000 custom connectors were created with the Airbyte No-Code Connector Builder, which enables data connectors to be made in minutes. Significant performance improvement with database replication speed increased by 10 times to support larger datasets. Added support for five vector databases, in addition to unstructured data sources, as the first company to build a bridge between data movement platforms and artificial intelligence (AI). Looking ahead, Airbyte will introduce data lakehouse destinations, as well as a new Publish feature to push data to API destinations. About Airbyte Airbyte is the open-source data movement infrastructure leader running in the safety of your cloud and syncing data from applications, APIs, and databases to data warehouses, lakes, and other destinations. Airbyte offers four products: Airbyte Open Source, Airbyte Self-Managed, Airbyte Cloud, and Powered by Airbyte. Airbyte was co-founded by Michel Tricot (former director of engineering and head of integrations at Liveramp and RideOS) and John Lafleur (serial entrepreneur of dev tools and B2B). The company is headquartered in San Francisco with a distributed team around the world. To learn more, visit airbyte.com.

Read More