BIG DATA MANAGEMENT

MayStreet Launches Next Generation of Market Data Analytics Product

MayStreet | March 02, 2022

MayStreet, the industry’s leading market data technology and content provider, today announced the launch of the next generation of Analytics Workbench, the firm’s ready-to-use, cloud-based market data analytics environment. Through Analytics Workbench, data analysts can quickly and efficiently query the MayStreet Market Data Lake to drive mission-critical trading workflows without having to manage data capture, delivery or storage.

Key features of new Analytics Workbench include the ability to:

  • Query and extract data using Python or R for analysis within Workbench or in any other location, whether in the cloud or on-premise
  • Leverage pre-configured Jupyter® notebooks to support out-of-the-box query capabilities
  • Perform ad-hoc analyses or schedule batch jobs to support ongoing reporting requirements
  • Instantly parallelize and scale ad-hoc or scheduled code across the cloud with integrated support for Dask clusters
  • Upload internal order data or other third-party data to leverage in conjunction with MayStreet market data to support TCA, fill analysis and best execution reporting
  • Query results provided in normalized or raw PCAP formats and create reports using powerful visualization tools
  • Flexible deployment options, either fully managed within MayStreet’s cloud environment or integrated within a client’s cloud
  • Achieve performance objectives with optimized cluster parallelization

“The completely revamped Analytics Workbench realizes our goal of letting users bring their queries to our data, freeing them from the difficult and costly work of managing the data themselves. For the first time, our vast repository of ultra-high-quality global market data is accessible in a ready-to-use environment that leverages cloud economics. It’s also highly customizable, letting clients choose the level of performance they desire so that costs can be managed based on their needs. For capital markets data analysts, the new Analytics Workbench is a true gamechanger.”

Naftali Cohen, MayStreet’s Chief Revenue Officer

Dave Thompson, Senior Vice President, Frontend Engineering, added: “In the process of redeveloping Analytics Workbench from the ground up, we identified several tools such as Dremio, Dask and Jupyter that could elevate its performance, functionality and scalability. By integrating these and other technologies, we have been able to create a truly modern data access and analytics tool built for the cloud. We’ve had many conversations with clients over the past 18 months about their hopes for a product like this, and we’re very pleased with the end result.”

The new version of Analytics Workbench is currently being used by multiple clients, including a global investment bank, an exchange and a quantitative hedge fund. MayStreet expects additional clients to begin using the product over the coming weeks. Analytics Workbench was used by market structure researchers Robert Bartlett, Justin McCrary and Maureen O’Hara for their recent paper on the impact of odd lot quotes.

“MayStreet’s comprehensive, high-quality exchange data allowed us to document the vital importance of odd lot quotes in today’s equity markets, especially for higher-priced stocks,” said Bartlett, Faculty Director at the Berkeley Center for Law, Business and the Economy. “Without reliable access to the historical data feeds for all exchanges, such a study would simply not be possible given that these quotes are excluded from the SIP data. Additionally, leveraging MayStreet’s Analytics Workbench gave us the computational capacity we needed to process quickly the vast quantities of data.”

MayStreet’s release of Analytics Workbench is the latest in a series of enhancements to the MayStreet Market Data Lake. Other recent enhancements include access through a new High Performance Query (HPQ) API, the introduction of full-depth-of-book data for all US listed options markets and the round out of its global coverage with the addition of all major equities and futures markets in Asia-Pacific.

About MayStreet
MayStreet delivers the highest-quality, most complete global market data available. The firm’s solutions – which include the highly accessible Market Data Lake feed repository and Bellport Enterprise feed handler – help market participants generate maximum value from exchange data by delivering it when, where and how they want to receive it. With MayStreet, clients are freed from the difficult and costly work of sourcing and processing market data, leading to lower total cost of ownership, improved decision-making and better performance.

Spotlight

Dialogue around value in healthcare has given way to both hope for a brighter future and great consternation about the way it is managed today. Driven by converging forces—growing population health needs, limited resources, and advances in science and data analytics—the focus on how to adapt established systems to drive better patient outcomes and improved cost efficiencies has become paramount but difficult.


Other News
BIG DATA MANAGEMENT, BUSINESS STRATEGY

New Relic Announces Support for Amazon VPC Flow Logs on Amazon Kinesis Data Firehose

New Relic | September 17, 2022

New Relic , the observability company, announced support for Amazon Virtual Private Cloud (Amazon VPC) Flow Logs on Amazon Kinesis Data Firehose to reduce the friction of sending logs to New Relic. Amazon VPC Flow Logs from AWS is a feature that allows customers to capture information about the IP traffic going to and from network interfaces in their Virtual Private Cloud (VPC). With New Relic support for Amazon VPC Flow Logs, both AWS and New Relic customers can quickly gain a clear understanding of a network’s performance and troubleshoot activity without impacting the network throughput or latency Network telemetry is challenging even for network engineers. To unlock cloud-scale observability, engineers need to explore VPC performance and connectivity across multiple accounts and regions to understand if an issue started in the network or somewhere else. To solve this, New Relic has streamlined the delivery of Amazon VPC Flow Logs by allowing engineers to send them to New Relic via Kinesis Data Firehose, which reliably captures, transforms, and delivers streaming data to data lakes, data stores, and analytics services. With New Relic’s simple “add data” interface, it only takes moments to configure Amazon VPC Flow Logs using the AWS Command Line Interface (AWS CLI) or an AWS CloudFormation template. Instead of digging through raw logs across multiple accounts, any engineer can begin with an Amazon Elastic Compute Cloud (Amazon EC2) instance they own and begin to explore the data that matters, regardless of the AWS account or AWS Region. “New Relic continues to invest in our relationship with AWS. Helping customers gain visibility into their cloud networking environment increases their overall application observability. “Our support for Amazon VPC shows our commitment to enhancing our joint customers’ observability experience.” Riya Shanmugam, GVP, Global Alliances and Channels at New Relic “AWS is delighted to continue our strategic collaboration with New Relic to help customers innovate and migrate faster to the cloud,” said Nishant Mehta, Director of PM – EC2 and VPC Networking at AWS. “New Relic’s connected experience for Amazon VPC Flow Logs, paired with the simplicity of using Kinesis Data Firehose, enables our joint customers to easily understand how their networks are performing, troubleshoot networking issues more quickly, and explore their VPC resources more readily.” With the New Relic support for Amazon VPC Flow Logs on Kinesis Data Firehose, customers can: Monitor and alert on network traffic from within New Relic. Visualize network performance metrics such as bytes and packets per second, as well as accepts and rejects per second across every TCP or UDP port. Explore flow log deviations to look for unexpected changes in network volume or health. Diagnose overly restrictive security group rules or potentially malicious traffic issues. ”Our architecture contains above 200 microservices running on AWS. When something goes wrong, we need to find the root cause quickly to put out what we at Gett term as ‘fires,’” said Dani Konstantinovski, Global Support Manager at Gett. “With New Relic capabilities we can identify the problem, understand exactly what services were affected, what’s the reason, and what we need to do to resolve it. New Relic gives us this observability—it helps us to provide better service for our customers.” “Proactively managing customer experience is essential to all businesses that provide part or all of their services through applications. Therefore it’s essential for engineers to have a clear understanding of their network performance and have the data needed to troubleshoot activity before it impacts customers. Also, the quality of the data is fundamental to making good decisions,” said Stephen Elliot, IDC Group Vice President, I&O, Cloud Operations and DevOps. “Solutions that ensure fast delivery of high-quality data provide engineers with the ability to act quickly and decisively with confidence, saving businesses from the costs associated with negative customer experiences.” About New Relic As a leader in observability, New Relic empowers engineers with a data-driven approach to planning, building, deploying, and running great software. New Relic delivers the only unified data platform that empowers engineers to get all telemetry—metrics, events, logs, and traces—paired with powerful full stack analysis tools to help engineers do their best work with data, not opinions. Delivered through the industry’s first usage-based consumption pricing that’s intuitive and predictable, New Relic gives engineers more value for the money by helping improve planning cycle times, change failure rates, release frequency, and mean time to resolution. This helps the world’s leading brands including Adidas Runtastic, American Red Cross, Australia Post, Banco Inter, Chegg, GoTo Group, Ryanair, Sainsbury’s, Signify Health, TopGolf, and World Fuel Services (WFS) improve uptime, reliability, and operational efficiency to deliver exceptional customer experiences that fuel innovation and growth.

Read More

BUSINESS INTELLIGENCE, BIG DATA MANAGEMENT, DATA ARCHITECTURE

Mode Analytics Recognized as a Leader in Snowflake’s Modern Marketing Data Stack Report

Mode Analytics | September 30, 2022

Mode Analytics today announced that it has been recognized as a Business Intelligence Leader in the inaugural Modern Marketing Data Stack Report: Your Technology Guide to Unifying, Analyzing, and Activating the Data that Powers Amazing Customer Experiences, executed and launched by Snowflake, the Data Cloud company. Snowflake’s data-backed report identifies the best of breed solutions used by Snowflake customers to show how marketers can leverage the Snowflake Data Cloud with accompanying partner solutions to best identify, serve, and convert valuable prospects into loyal customers. By analyzing usage patterns from a pool of nearly 6,000 customers, Snowflake identified six technology categories that organizations consider when building their marketing data stacks. These categories include: Analytics Integration & Modeling Identity & Enrichment Activation & Measurement Business Intelligence Data Science & Machine Learning Focusing on companies that are active members of the Snowflake Partner Network (or ones with a comparable agreement in place with Snowflake), as well as Snowflake Marketplace Providers, the report explores each of these categories that comprise the Modern Marketing Data Stack, highlighting technology partners and their solutions as “leaders” or “ones to watch” within each category. The report also details how current Snowflake customers leverage a number of these partner technologies to enable data-driven marketing strategies and informed business decisions. Snowflake’s report provides a concrete overview of the partner solution providers and data providers marketers choose to create their data stacks. “Marketing professionals continue to expand their investment in analytics to improve their organization’s digital marketing activities. “Mode has emerged as a leader in the Modern Marketing Data Stack, with joint customers leveraging their technology to interpret insights that lead to informed business decisions.” Denise Persson, Chief Marketing Officer at Snowflake Mode was identified in Snowflake’s report as a Leader in the Business Intelligence category for its particular success with Visual Explorer, Mode’s flexible visualization system that helps analysts explore data faster and provides easy-to-interpret insights to business stakeholders. Additionally, Mode and Snowflake have partnered in the past couple of years tocreate a modern data analytics stack, mobilizing the world’s data with the Snowflake Data Cloud to help joint customers quickly execute queries and perform analysis. “Mode combines the best elements of business analytics and data science into a single platform, unlocking new ways for marketers to accelerate data-driven outcomes,” said Gaurav Rewari, CEO, Mode Analytics. “Our partnership with Snowflake makes it possible for marketing and other departments across an organization to truly centralize and interact directly with their data. With Snowflake’s single, integrated data platform, built to fully leverage the speed and flexibility of the cloud, organizations can mobilize their data in near-real time.” About Mode Analytics Mode’s advanced analytics platform is designed by data experts for data experts. It allows data scientists and analysts to visualize, analyze, and share data using a powerful end-to-end workflow that covers everything from early data exploration stages to presentation-ready shareable products. Unlike traditional business intelligence tools that produce static dashboards and reports, Mode brings the best of BI and data science together in a single platform, empowering everyone at your organization to use data to make high quality, high velocity decisions. Mode also supports the analytics community with free learning resources such as SQL School, open source SQL queries, and free tools for anyone analyzing public data.

Read More

BUSINESS INTELLIGENCE, BIG DATA MANAGEMENT, BUSINESS STRATEGY

Anonos Acquires Award-Winning Synthetic Data Company Statice

Anonos | November 02, 2022

Anonos, provider of the only technology that protects data in use with 100% accuracy, today announced the acquisition of Berlin-based Statice GmbH, a synthetic data software provider. With the addition of the Statice solution, which generates new privacy-preserving data points that reflect the statistical properties of the original data, Anonos expands its ability to provide a comprehensive platform that powers speed to data insights for use cases while enhancing the protection and utilization of data. The Statice synthetic data technology will be integrated with the Anonos Data Embassy platform and available later this quarter. This acquisition follows Anonos’ recent announcement of $50 million in new growth financing backed by its intellectual property portfolio, facilitated by Aon and led by GT Investment Partners (“Ghost Tree Partners”). Statice was recently honored with the Handelsblatt Diamond Award in the best innovation in banking and fintech category, named in Gartner “Emerging Tech: Top Use Cases for Tabular Synthetic Data, September 2022,” and recognized in two 2022 Gartner Hype Cycle™ reports: Artificial Intelligence and Data Science and Machine Learning (ML). As noted in the latter report, Gartner predicts an increase in synthetic data adoption and growing buyers' interest across all industries notably due to the multiple benefits of the technology, for example, how synthetic data can "reduce cost and save time in ML development as it is cheaper and faster to obtain." The same report mentions that "synthetic data applications have expanded beyond automotive and computer vision use cases to include data monetization, external analytics support, platform evaluation and the development of test data." “Statice and Anonos share the goal of helping enterprises use more of their data assets, minus the usual conflicts and compromises. “Now organizations have the benefits of high-privacy, high-utility statutory pseudonymization combined with those of a proven synthetic data product for granular control throughout the data lifecycle.” Anonos Co-CEO and President Ted Myerson Enterprises have the option of using synthetic data whenever possible, and then combining it with Anonos’ non-identifiable yet 100% accurate Variant Twins® when there are privacy variables and risks – for example, to ensure compliance with Schrems II and the U.S. CLOUD Act for compliant data transfers across international borders. “From non-production use cases to full-production processing, more data control, privacy and accuracy aren’t just possibilities but actual realities,” Myerson added. Anonos was named as a Cool Vendor by Gartner because of its Variant Twin technology and recognized in August for data security as a service in the “Gartner Hype Cycle for Data Security, 2022.” Data Embassy delinks data from both direct and indirect identifiers to obscure identity while enabling organizations to use more of their data for lawful analytics, artificial intelligence, machine learning, data sharing and data transfer. It works by transforming source data into statutorily pseudonymized and 100% accurate Variant Twins authorized for specific purposes. They are embedded with multi-level data privacy and security controls that are technologically enforced, so they can travel anywhere. Controlled relinking to the original data accelerates speed to insights, but that process can only occur with the addition of other data held separately by the data controller or an authorized party. Statice’s co-founders Omar Ali Fdal and Mikhail Dyakov join the Anonos leadership team, and all 23 Statice employees become Anonos employees for a total of 65, with a majority located in Europe. “We are thrilled to join Anonos to accelerate the development of an entire range of modern data protection solutions, helping organizations across industries be more confident in data privacy and security so they can gain more business value from their data,” said Omar Ali Fdal, co-founder of Statice. “Our visions and strengths are aligned in de-risking data so our customers can responsibly pursue data-driven initiatives to accomplish their business goals.” “We recognized the great potential of privacy-enhancing technologies in the market early on. Especially in Germany and Europe, data protection law is strict, privacy concerns are manifold and our clients, as well as their customers' demand for the protection of private data is very high. PwC incubated the capabilities of Statice’s synthetic data solution to support internal operations and external advisory requirements. Statice’s vision for data agility combined with privacy reliability changed how we drive digital transformation for our clients, and we are convinced that such technologies are poised to have a wide impact on global enterprise data strategies,” said Marcus Hartmann, Chief Data Officer at PwC Germany and PwC Europe. Now, it's time to take the next step to industrialize the solutions. “The resulting joint capabilities of Statice with Anonos will offer privacy protection across the entire spectrum of data operations. That combination of privacy-enhancing techniques opens new possibilities for our clients in using more of their sensitive data to fuel innovation and modernization while eliminating the potential for data misuse.” The terms of the transaction will not be disclosed. PwC is no longer a stockholder of Statice; Anonos is now the 100% stockholder of Statice. About Anonos Anonos is a global software company that provides the only technology capable of protecting data in use with 100% accuracy, even in untrusted environments, making otherwise restricted assets accessible to expand and expedite data-driven initiatives. Its patented Data Embassy platform transforms source data into Variant Twins: non-identifiable yet 100% accurate data assets for specific use cases. Because multi-level data privacy and security controls are embedded into the data and technologically enforced, Variant Twins can travel anywhere – across departments, outside the enterprise, or around the globe. Therefore, data protection teams and data users can collaborate to advance projects for capturing valuable insights without compromising privacy, security, accuracy or speed. Anonos. Data without the drama. About Statice Statice develops state-of-the-art data privacy technology that helps companies double-down on data-driven innovation while safeguarding the privacy of individuals. Thanks to the privacy guarantees of the Statice data anonymization software, companies generate privacy-preserving synthetic data compliant for any type of data integration, processing and dissemination. With Statice, enterprises from the financial, insurance and healthcare industries can drive data agility and unlock the creation of value along their data lifecycle. Safely train machine learning models, finally process your data in the cloud, or easily share it with partners.

Read More

BUSINESS INTELLIGENCE, BIG DATA MANAGEMENT

Xillio to support CellTrust with Archive Data Migration for Mobile Communication Data Governance and Compliance

Xillio | September 13, 2022

Xillio, the global content migration solutions provider that enables organizations to modernize information landscapes and CellTrust Corporation, a leading provider of global secure and compliant mobile communication for government and enterprise, announced today they have entered a strategic relationship to enable CellTrust ‘s archiving solutions through Xillio data migration services and products. Xillio is seeing an ever-increasing need for organizations to preserve critical business communication and information in a compliant manner. The global market for Enterprise Information Archiving (EIA) continues to expand, as do the technological features. To improve efficiency, price performance, security and compliance outcomes, some organizations opt to consolidate previously separate archiving platforms for specific communication channels into one overarching data management solution. Most of CellTrust’s customers operate in highly regulated industries, i.e., financial services, government, healthcare, education, or insurance, where recordkeeping, eDiscovery, and compliance are mandated by law (SEC, CFTC, FINRA, SOX, FCA, MiFID II, IIROC, FOIA, Sunshine Laws, Public Records Laws and HIPAA). As the number of mobile communication channels (text, chat, voice, email, app to app) grows, highly regulated organizations are looking for technology to help them seamlessly manage, govern, classify, monitor and enforce regulatory compliance. They are also often required by law to capture, archive, and retain the data across these channels for eDiscovery and compliance audit purposes. “As the market demands, CellTrust is excited to be able to support organizations transitioning from one archiving solution to another,” said Sean Moshir, CellTrust Chairman and CEO. “Xillio is a leader in content migration solutions and experts in secure and compliant data migration.” “With an experienced team across EMEA and North America, Xillio is at the forefront of helping organizations plan and execute a secure and compliant content migration strategy,” said Rikkert Engels, Founder, and CEO of Xillio. “We are thrilled to be working with CellTrust within the dynamic Enterprise Information Archiving space.” About Xillio With an experienced team across EMEA and North America, Xillio’s mission is to enable organizations to create a future-proof content migration strategy that aligns core information management principles - security, search-and findability, governance, compliance – with user-centricity, adaptability, and business value. Xillio is a member of the Microsoft Intelligent Security Association, a Microsoft Charter Member for Content Services, and an Associate Partner on Project Cortex. About CellTrust Corporation CellTrust is a global leader in enterprise mobile communications, compliance enforcement, traceability, eDiscovery and security for highly regulated industries. CellTrust SL2™ helps enforce regulatory compliance: SEC, CFTC, FINRA, SOX, FCA, MiFID II, FOIA, Sunshine Laws, Public Records Laws and HIPAA. CellTrust is a member of the Microsoft Intelligent Security Association.

Read More

Spotlight

Dialogue around value in healthcare has given way to both hope for a brighter future and great consternation about the way it is managed today. Driven by converging forces—growing population health needs, limited resources, and advances in science and data analytics—the focus on how to adapt established systems to drive better patient outcomes and improved cost efficiencies has become paramount but difficult.

Resources