History of big data

verdict.co | January 29, 2020

Big data, and its associated computing and storage needs, has had a significant impact on the data centre industry. The data centre, or bit barn, is an organisation’s brain. It takes in, stores, analyses, and disseminates all the data the organisation needs. As the amount of data generated has exploded in recent years, so data centres have been forced to evolve and grow. History of big data: before 1980, companies used mainframe computers to store and analyse data. Two key technologies were critical to the first formations of data centers as we think of them today. Both occurred in the early 1980s; the first was the advent of personal computers (PCs), which proliferated as Microsoft’s Windows operating software became the global standard. The second was the development of the network system protocol by Sun Microsystems, which enabled PC users to access network files. Thereafter, microcomputers begin to fill out mainframe rooms as servers, and the rooms become known as data centers.
A number of critical milestones since then changed the evolution of the industry, including the emergence of virtualisation software and the shift towards cloud computing. These and other major milestones in the journey of the big data theme are set out in the timeline below.

Spotlight

There is a lot of talk about data, be it first, second or third party data. But no matter what the type of data; Big Data or small data, the best use of data is to drive marketing and business results. So for tips on how to use data to drive better marketing results, start your journey here.


Other News
BIG DATA MANAGEMENT

CQG to Roll Out Newest Trading and Analytics Platform, CQG One

CQG | March 14, 2022

CQG, a leading global provider of high-performance technology solutions for traders, brokers, commercial hedgers and exchanges, announced today the phased roll-out of its newest trading platform, CQG One. Designed for professional traders and institutional investors, the new cloud-based CQG One combines the ease of use of the firm's retail-oriented CQG Desktop platform with many of the popular market data, charting, visualization and advanced analytics features of CQG Integrated Client, its flagship professional trading platform. A multi-asset, multi-broker platform, CQG One will be available through traders' futures commission merchants (FCMs) beginning in April, with new functionality added throughout the year. CQG President Ryan Moroney said: "We're excited to bring CQG One to market after gathering extensive input from our users on what features they most want in our new platform. This will be as intuitive and easy to deploy, configure and use as CQG Desktop but with advanced charting, market analytics and trading functionality, along with the CQG depth and breadth of market data utilized by our largest and most sophisticated institutional clients." "CQG One is an ultra-fast, secure platform that traders will be able to access from anywhere to leverage technical analysis tools and execute transactions with a single click on markets all over the world. We will continuously update it through our HTML5 cloud infrastructure in a way that's seamless to users." Marcus Kwan, CQG Vice President, Product Strategy & Design The new platform will include premium functionality such as: Single-click trade entry Advanced charting and analytics Portfolio sharing Window linking, and drag-and-drop tabs Highly secure, consolidated real-time and life-of-contract historical market data feeds from more than 75 global sources Access to CQG Algos, a comprehensive set of pre-built algorithmic order types New analytics features, custom formulas, price alerts and a spreader later in 2022 Institutional clients will be able to utilize a Windows-installed version of CQG One in the future. About CQG CQG provides the industry's highest performing solutions for traders, brokers, commercial hedgers and exchanges for their market-related activities globally, including trading, market data, advanced technical analysis, risk management, and account administration. The firm partners with the vast majority of futures brokerage and clearing firms and provides Direct Market Access (DMA) to more than 45 exchanges through its global network of co-located Hosted Exchange Gateways. CQG technology serves as the front end for a variety of exchanges and is increasingly employed as the over-the-counter matching engine for important new markets. CQG's server-side order management tools for spreading, market aggregation, and smart orders are unsurpassed for speed and ease of use. Its market data feed consolidates 85 sources, including exchanges worldwide for futures, options, fixed income, foreign exchange, and equities, as well as data on debt securities, industry reports, and financial indices. One of the longest-serving technology solutions providers in the industry, CQG has won numerous awards for its trading software, technical analysis and multi-asset trading platform. CQG is headquartered in Denver, with 16 sales and support offices and data centers in key markets globally.

Read More

DATA ARCHITECTURE

Linq Analytics Extends Master Data Management and FP&A Capabilities

Linq Analytics | January 18, 2022

Linq Analytics, LLC, a provider of software and services for adaptive customer data management and analytics, announced today its acquisition of certain assets of Altius, Inc., a privately-held company with US offices in Sugar Land, TX. Altius' Flex™ suite of planning and Master Data Management (MDM) products give users the ability to augment Microsoft Excel™-based financial models with data enrichment and workflows, providing them a more accurate understanding of their information and enabling management tailored to their business. The addition of the Flex™ suite to the Linq Analytics portfolio will add capabilities that extend both Linq's Account Hierarchy Management Solution and associated analytics and workflows, helping Clients realize additional value across the Customer data chain through more agility in data integration, extensive analytics insights, and decreased redundancy. "Our Clients and Partners have expressed a desire to seamlessly connect their customer data from multiple CRM and ERP instances with existing analytics and finance workflows. We believe that adding the Flex™ capabilities helps us to provide a more complete solution that can drive additional value for our Clients." Brandon Swalve, Linq Analytics' co-founder and CEO As part of this transaction, Linq Analytics will appoint Noel Phillips as Chief Technology Officer. "In addition to the product capabilities, I'm excited to welcome Noel to Linq," continued Swalve. "He adds significant technical knowledge, functional expertise, and strong leadership to our rapidly expanding team, and our Clients will feel his impact quickly." "I'm very excited to join the superb team at Linq Analytics. I know the combination of Linq's innovative CRM and ERP tools - along with the Flex™ Planning Platform - will prove incredibly powerful. It tells a compelling story and will benefit current and future clients alike. I can't wait to see what we will achieve together." The Flex™ product suite will continue to be available from Linq Analytics. Support services for current Flex™ clients will be delivered through Altius, with transition for support expected to occur in Q2 2022.

Read More

BIG DATA MANAGEMENT

Software AG, SAP partner on industry 4.0 data

Software AG | February 24, 2021

Software AG and SAP have partnered to better surface supply chain management data with the aim of improving product quality. The news, which landed as Software AG held its Capital Markets Day, highlights how multiple players are forming partnerships to focus on the industry 4.0 market. Software AG's alliance with SAP will combine SAP's S/4HANA Cloud with Software AG's TrendMiner, which is self-service industrial analytics software for smart factories. According to the companies, the partnership will bring sensor-generated time-series data into the analytics and operational performance fold. Software AG in January reported bookings growth of 31% in the fourth quarter and 24% for 2020. Digital transformation drove demand for Software AG. For 2020, Software AG reported revenue of €834.8 million, down 3.8% from a year ago. Net income (non-IFRS) was €125.4 million. Software AG said that it will "double down on its existing strategy by focusing on five priority areas, namely: continuing to develop its subscription growth engine, fostering product innovation, driving internal simplification to improve productivity, progressing the ongoing cultural transformation driving its success, and taking a more proactive stance towards Mergers & Acquisitions."

Read More

DATA ARCHITECTURE

GlobalData partners with Snowflake to empower seamless access and delivery of its data

GlobalData | February 21, 2022

GlobalData Plc , a leading intelligence platform for the world's largest industries, has announced a partnership with Snowflake, a premier data warehouse built for the cloud, to enable Snowflake customers to access and purchase data from GlobalData's Marketplace via the Snowflake platform. In today's business environment, the need for trustworthy and timely data has never been more important, which is why it's critical for tomorrow's market leaders to access, share, and use data instantly and seamlessly. GlobalData's strategic relationship with Snowflake means customers will have a flexible cloud solution for accessing proven, proprietary datasets efficiently. This will provide customers with immediate and secure access to data, eliminating the need for lengthy and costly extract, transform, and load (ETL) processes; and reduce the time and effort needed to integrate data into their business operations and decision-making processes at scale. Initially, GlobalData will provide access to six authoritative datasets via the Snowflake platform, covering pharmaceuticals, medical devices, and climate risk, as well as alternative datasets spanning patents and job analytics. New datasets will be added over time from GlobalData's Marketplace, which covers 150 productized datasets relied upon by over 4,000 customers. Commenting on the announcement, Jonathan Hardinges, GlobalData's Chief Strategy Officer, said: "GlobalData continues to provide best-in-class data and insights to help our clients solve complex business problems, and Snowflake offers us the opportunity to provide customers with more efficient access to authoritative data and greater value from its use at scale. "We are particularly excited to partner with Snowflake, as this will help us deliver against our customer-obsession agenda by giving customers the flexibility to access and use our intelligence where, when, and how they need to." Kieran Kennedy, Head of Marketplace at Snowflake "GlobalData and Snowflake combine to make a powerful solution for any organization seeking to leverage the power of data sharing. With the ability for customers to access GlobalData's broad data coverage, this marks an exciting and welcome next step in further expanding the coverage of Snowflake's Data Marketplace." About GlobalData In an increasingly fast-moving, complex, and uncertain world, it has never been harder for organizations and decision makers to predict and navigate the future. This is why GlobalData's mission is to help our clients to decode the future and profit from faster, more informed decisions. As a leading information services company, thousands of clients rely on GlobalData for trusted, timely, and actionable intelligence. Our solutions are designed to provide a daily edge to professions within corporations, financial institutions, professional services, and government agencies.

Read More

Spotlight

There is a lot of talk about data, be it first, second or third party data. But no matter what the type of data; Big Data or small data, the best use of data is to drive marketing and business results. So for tips on how to use data to drive better marketing results, start your journey here.

Resources