Delivering Trusted AI with DataRobot and Microsoft

Denodo DataFest, the premier agile data management and analytics conference, returned once again to New York and London in 2018. Our annual user conference brings together industry analysts, subject matter experts, business leaders, data management leaders to discuss data strategies to enable a successful journey to the cloud, self-service BI, and data lakes with data virtualization. The event invited attendees to watch demos, hear customer success stories, and educate themselves on the best practice implementations of data virtualization.

Data privacy regulation is bigger than just GDPR. Other countries and jurisdictions are enacting their own versions of the data privacy regulation, each with subtle nuances - such as the California Consumer Privacy Act (CCPA), Lei Geral de Proteção de Dados (LGPD), and more - and that’s on top of existing privacy regulations. Moreover, consumers increasingly expect more protection for their sensitive information. A recent IBM-Harris poll of 10,000 individuals revealed that 75% of consumers won’t buy from companies they don’t trust no matter how great their product or service.

Building performant ETL pipelines to address analytics requirements is hard as data volumes and variety grow at an explosive pace. With existing technologies, data engineers are challenged to deliver data pipelines to support the real-time insight business owners demand from their analytics. Databricks Delta is the next generation of evolution in big data processing from Databricks, the company founded by the original creators of Apache Spark.

Few things bring down the value of data faster than confusion and uncertainty about what it is, where it came from, and whether it is good quality data. Yet as more users seek to access and interact with data and reports for business intelligence and analytics and as data sources become larger and more varied, confusion and uncertainty spread fast. Executives, managers, regulatory administrators, and other key personnel cannot rely on their reports, KPIs, and dashboards. Users cannot even find reports that the organization is producing. Instead, users spend more of their time trying to locate data and reports and correcting mistakes than they do applying data insights to solve business problems.