Tuesday, December 30, 2014

Scoring data with ADAPA using Pentaho Data Integration

Predictive model integration for MySQL, Microsoft SQL Server, Oracle and PostgreSQL


The main use of predictive models is to generate predictions for new data. This data frequently resides in databases like MySQL, and the ADAPA scoring engine needs a way to easily access it. One way of accomplishing this is by using the Pentaho Data Integration (PDI) tool, and in this post we outline how to score data from relational databases using the ADAPA REST API and PDI.

PDI provides an easy to use point-and-click interface to manage the whole workflow: retrieving the data, scoring it through ADAPA, and saving the results elsewhere. It is possible to use PDI to read and write to different databases, including MySQL, Microsoft SQL Server, Oracle, PostgreSQL, and others. PDI can also act as a client to the ADAPA Scoring Engine by leveraging the ADAPA REST API, and take care of transforming the data into necessary formats - JSON and URL in this case.

Prior to starting, we assume that:
  • PDI is installed
  • Data to be scored is stored in either MySQL, Microsoft SQL Server, Oracle or PostgreSQL
  • A PMML model for the data is deployed and available through the ADAPA REST API.

The process is built and executed in PDI. The transformation should consist of the following steps:
  • Retrieve data from the database
  • Transform to a JSON object
  • Convert the JSON object to a URL as a method to transmit it
  • Send URL to ADAPA through REST API
  • Capture ADAPA output
  • Write the scoring result back to a flat file

For detailed step-by-step instructions using a neural network model deployed in ADAPA, please review the following videos:


Monday, December 29, 2014

Using MySQL as a Client to the ADAPA Scoring Engine

Predictive analytics scoring with MySQL and ADAPA


In this blog post, we outline how to use a MySQL database as a client to the ADAPA Scoring Engine by leveraging the ADAPA REST API to execute a predictive analytics model based on the Predictive Model Markup Language (PMML) industry standard.

We assume that:
  • MySQL and cURL are installed
  • Necessary MySQL tables are already created
  • A PMML model for the data is deployed and available through the ADAPA
  • REST API.
One option to make API calls from MySQL is by using the MySQL-UDF-HTTP package, which enables creation of user defined functions for HTTP REST Operations in a database. This package is available on Google Code and will be installed on top of MySQL. We can leverage the User Defined Functions (UDFs) created with this package to make REST API calls to ADAPA from MySQL. Specifically, we use HTTP GET requests to the ADAPA engine to score one record at a time. An advantage of using these functions is that we can easily write the scores back to the database.

In addition, the scoring process can be automated with database triggers. Triggers automatically execute database queries when specified events occur. In this case, we can write functions to score and update or insert records, and set triggers to execute these functions on update and insert events. The HTTP UDF is called by the scoring function to send a GET request to the ADAPA REST API.

Simply using SQL and UDFs, the above enables us to easily execute complex predictive analytics models directly from one of the most commonly used databases, score the records, and write the results back into a database table.

A step-by-step tutorial, including installing MySQL-UDF-HTTP and writing functions and triggers, is available in this video.

Tuesday, December 23, 2014

451 Research Initiates Coverage of Zementis

2014 has been a busy year of growth for Zementis, as our customers, business partners and employees have noticed. Industry analysts have also noticed, with two leading research firms initiating coverage of Zementis in 2014. In May, Gartner included Zementis on its short list of “Cool Vendors in Data Science”, and just this week, 451 Research published its first report on Zementis.

451 Research is well known in the technology sector as a highly respected research and advisory company, and is especially noted for its coverage of emerging technologies and the companies that bring these technologies to market. Within the Enterprise Software sector, Krishna Roy leads 451’s analytical efforts in the realm of business applications and software infrastructure, including big data analytics and predictive analytics. She has a longstanding background in technology journalism, and covers the big data analytics segment extensively. 451’s subscribers will find an amazing number of insightful reports on big data and predictive analytics that bear her byline.

The universe of companies in her analytical portfolio numbers more than 100, affording her a fantastic vantage point from which to study the technologies and market dynamics that shape the competitive landscape and define the market’s evolutionary trajectory. This breadth of coverage also makes her schedule extremely full. Zementis is honored that she has chosen to devote some of her scarce time to studying our company and imparting her perspectives and insights.

To access the report, click on the link below:

Impact Report - December 22, 2014


Wednesday, November 12, 2014

IBM and Zementis Release White Paper: "Enhancing Predictive Analytics"

Continuing their longstanding partnership, Zementis and IBM recently released a white paper that details how organizations can improve their business agility through predictive analytics. The paper describes some of the key benefits that organizations can derive from applying predictive analytics to key decisions, outlines some of the operational and technical challenges that organizations commonly face in this effort, and showcases the capabilities that IBM and Zementis make possible to unlock the full potential of big data through predictive analytics.

Together, Zementis and IBM help enterprises overcome many challenges associated with their big data efforts, simplifying and accelerating the deployment of predictive models and making possible large-scale analytics that once seemed impractical to execute.

Zementis' UPPITM solution is integrated with several of IBM's flagship big data analytics platforms, including IBM PureDataTM System for Analytics, powered by Netezza® technology, and IBM InfoSphere® BigInsightsTM software. In each case, the joint IBM/Zementis solution helps companies deploy, execute and integrate scalable, standards-based predictive analytics. UPPI extends the in-database and Hadoop-based predictive analytics capabilities of these IBM platforms through the use of Hive, a data warehouse system for Hadoop.

The white paper describes the benefits of Zementis' open standards approach to predictive analytics, as well as the technical capabilities of the joint solutions with IBM and the tangible benefits that organizations can realize by making IBM and Zementis a foundational element of their big data analytics strategy and architecture.

Highlights of the joint solution include:
  • Enables near real-time predictive model deployment through a universal, flexible approach
  • Reduces cost and complexity of deploying and utilizing predictive analytics for big data
  • Delivers standards-based execution of predictive analytics for in-database scoring
  • Accelerates time-to-market for enhancing intelligent decision making via predictive data
  • Supports highly dynamic and complex data environments with massively parallel processing
  • Extends the analytics functionality and business value of robust IBM platforms
Download the white paper

Thursday, November 6, 2014

Microsoft and Zementis Announce ADAPA for Azure

On October 28, Microsoft and Zementis unveiled the culmination of a collaborative effort that had begun many months before. Zementis' real-time predictive analytics decision engine, ADAPA®, became officially certified on Azure - Microsoft's dynamic and innovative cloud platform.


Microsoft Azure offers enterprise users a powerful collection of integrated services - compute, storage, data, networking, and applications - and is the only major cloud platform ranked by Gartner as an industry leader for both infrastructure-as-a-service (IaaS) and platform-as-a-service (PaaS).

With ADAPA on Azure, organizations can develop predictive models using most open source and commercial data mining tools and deploy machine learning models rapidly to generate predictive insights in real-time. New and existing Zementis customers can now take advantage of the "pay per use" model with Azure to reduce infrastructure costs and total cost of ownership.

Microsoft's Azure Marketplace makes it easy to find, purchase and launch ADAPA. Configuration is easy, and organizations can be up and running quickly with predictive analytics that leverage the efficiency, scalability, security and performance of Microsoft's enterprise-grade cloud environment.
 
"With a focus on rapid deployment and integration of predictive algorithms through open standards, Zementis embraces the cloud," said Garth Fort, General Manager of Enterprise Partners, Microsoft. "ADAPA allows customers to take advantage of the compute resources in Azure to support predictive analytics solutions and quickly scale capacity as computing requirements change, paying only for the resources used."

To purchase and deploy ADAPA from the Azure Marketplace today, please visit Microsoft Azure

Wednesday, October 1, 2014

Zementis/Teradata Whitepaper: Massively Parallel In-database Predictions with PMML


Zementis and Teradata have teamed up to make available to you a whitepaper which not only discusses the benefits of in-database scoring using UPPI for Teradata/Aster but also shares performance numbers that will blow you away! Enjoy!

DOWNLOAD WHITEPAPER

Abstract

Open standards enable interoperability and portability across systems and solutions. Such a level of flexibility creates new opportunities for addressing exceedingly demanding business 
agility and performance requirements. The Predictive Model Markup Language (PMML) is the embodiment of an open standard and delivers such benefits in the world of data mining and predictive analytics. This means that models developed in any environment and tool set can be deployed and used in a completely different system. 

In the context of Big Data, the urgent need to apply the power of predictive analytics to derive reliable predictions-and, hence, business decisions-from vast amounts of data collected by 
many organizations is a key requirement. In this paper, we discuss how the PMML standard enables embedding advanced predictive models directly into the database or the data warehouse, alongside the actual data to be scored. More importantly, we show how we can easily take advantage of a highly parallel database architecture to efficiently derive predictions from very large volumes of data.

DOWNLOAD WHITEPAPER

Monday, August 25, 2014

Hortonworks/Zementis Webinar: Hadoop’s Advantages for Machine Learning and Predictive Analytics

Please join Ofer Mendelevitch, Director of Data Science of Hortonworks and Michael Zeller, Founder and CEO of Zementis as they present key learnings as to what drives successful implementations of big data analytics projects. Their knowledge comes from working with dozens of companies from small cloud-based start-ups to some of the largest companies in the world.

When: Wednesday, September 10, 2014 at 10 am PST / 1 pm EST

REGISTRATION

Hortonworks will present their approach to using Apache Hadoop for predictive models with big data, and the benefits of Hadoop to data scientists. Zementis will demonstrate how to quickly deploy, execute, and optimize predictive models from open source machine learning tools like R and Python as well as commercial data mining vendors like IBM, SAP and SAS.

Zementis leverages the PMML open industry standard (Predictive Model Markup Language) providing a higher ROI for Big Data and predictive analytics initiatives. At the same time reducing IT costs, and improving the quality of predictive model management while requiring no change in how data science teams do their day-to-day work.

Whether your company is just beginning to work with predictive analytics or has an experienced data science team this webinar will provide valuable insights on how to move predictive models into an operational environment based on Hadoop and Hive and using open industry standards while eliminating the custom coding and delays typically associated with these projects. Please join us for this exciting presentation and discussion.

REGISTRATION

Wednesday, August 20, 2014

Zementis Sponsors SIGKDD 2014 Test of Time Award

The SIGKDD Test of Time Award recognizes outstanding papers from past KDD conferences beyond the last decade that have had an important impact on the data mining research community.  SIGKDD is the ACM Special Interest Group for Knowledge Discovery and Data Mining.  Not only since the advent of “Big Data”, but for 20 years, the annual SIGKDD conference has been the leading global forum for data scientists and practitioners from academia, industry and government to disseminate cutting edge research results and to demonstrate innovative applications.


It is our privilege to support the SIGKDD 2014 Test of Time Award as it recognizes influential contributions published in KDD conference proceedings which have had a substantial impact on data science.  Selected by a committee of leading scientists and supported by thousands of citations since their original publication, one could almost call it the “Nobel Prize in Data Science.”





The following three papers were selected by the award committee to receive the inaugural award:

  • A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise [KDD 1996]
  • Integrating Classification and Association Rule Mining [KDD 1998]
  • Maximizing the Spread of Influence through a Social Network [KDD 2003]
For abstracts and additional details, please see the SIGKDD web site blog.

Please join us at KDD 2014 in New York City, August 24-27, to celebrate the winners at an interdisciplinary event which will bring together researchers and practitioners from data science, data mining, knowledge discovery, large-scale data analytics, and big data.

Monday, August 18, 2014

UCSD's John Freeman interview with Alex Guazzelli, Zementis CTO: Predictive Analytics, Big Data, and PMML


Dr. Alex Guazzelli, Zementis CTO, has been extra busy lately by teaching a class at UCSD Extension entitled "Predictive Models with PMML". As the 6-week course is nearing its end for this Summer quarter, Dr. Guazzelli was invited by John Freeman, Director of Communications for UCSD Extension, for an interview  on UCTV's Career Talk to discuss Predictive Analytics, Big Data and PMML.

The interview itself was broadcast last week and it is now AVAILABLE ONLINE.

Tuesday, July 22, 2014

Alpine Data Labs/Zementis Webinar - Breaking Down Barriers for Predictive Analytics

If you are interested in learning about how PMML, the Predictive Model Markup Language standard, is being used by Alpine Data Labs and Zementis to instantly move predictive analytic models from the scientist's desktop into the IT operational environment, be sure to join us for the upcoming Alpine Data Labs/Zementis webinar on July 30th, featuring Steven Hillion, CPO of Alpine Data Labs, and Michael Zeller, CEO of Zementis.

Register here!



This will be an engaging, fast-paced and informative presentation and discussion of the latest tools and trends in predictive analytics. The webinar will include a demo of the PMML capabilities in Alpine Data Labs Chorus 4.0 and instant deployment of predictive models via Zementis solutions.

Title:

Breaking Down Barriers for Predictive Analytics


When?

Wednesday, July 30 2014 at 1 pm ET / noon CT / 11 am MT / 10 am PT / 5 pm GMT

Register here!





Copyright © 2009-2014 Zementis Incorporated. All rights reserved.

Privacy - Terms Of Use - Contact Us