{"id":3073,"date":"2014-04-13T21:41:14","date_gmt":"2014-04-13T21:41:14","guid":{"rendered":"http:\/\/dalelane.co.uk\/blog\/?p=3073"},"modified":"2014-06-25T22:19:04","modified_gmt":"2014-06-25T22:19:04","slug":"text-analytics-in-bluemix-using-uima","status":"publish","type":"post","link":"https:\/\/dalelane.co.uk\/blog\/?p=3073","title":{"rendered":"Text analytics in BlueMix using UIMA"},"content":{"rendered":"

In this post, I want to explain how to create a text analytics application in BlueMix using UIMA<\/strong>, and share sample code to show how to get started<\/a>. <\/p>\n

First, some background if you’re unfamiliar with the jargon. <\/p>\n

What is UIMA?<\/strong><\/p>\n

UIMA<\/a> (Unstructured Information Management Architecture) is an Apache framework for building analytics applications for unstructured information and the OASIS standard for content analytics. <\/p>\n

I’ve written about it before<\/a>, having used it on a few projects when I was in ETS<\/a>, and on other side projects since such as building a conversational interface to web pages<\/a>. <\/p>\n

It’s perhaps better known for providing the architecture for the question answering system IBM Watson<\/a>. <\/p>\n

What is BlueMix?<\/strong><\/p>\n

BlueMix<\/a> is IBM’s new Platform-as-a-Service (PaaS) offering, built on top of Cloud Foundry<\/a> to provide a cloud development platform. <\/p>\n

It’s in open beta at the moment, so you can sign up and have a play. <\/p>\n

I’ve never used BlueMix before, or Cloud Foundry for that matter, so this was a chance for me to write my first app for it. <\/p>\n

A UIMA “Hello World” for BlueMix<\/strong><\/p>\n

I’ve written a small sample to show how UIMA and BlueMix can work together. It provides a REST API that you can submit text to, and get back a JSON response with some attributes found in the text (long words, capitalised words, and strings that look like email addresses). <\/p>\n

The “analytics” that the app is doing is trivial at best, but this is just a Hello World. For now my aim isn’t to produce a useful analytics solution, but to walk through the configuration needed to define a UIMA analytics pipeline, wrap it in a REST API using Wink<\/a>, and deploy it as a BlueMix application. <\/p>\n

When I get a chance, I’ll write a follow-up post on making something more useful. <\/p>\n

You can try out the sample on BlueMix as it’s deployed to bluemix.net<\/a> <\/p>\n

The source is on GitHub at github.com\/dalelane\/bluemixuima<\/a>. <\/p>\n

In the rest of this post, I’ll walk through some of the implementation details. <\/p>\n

Runtimes and services<\/strong><\/p>\n

Creating an application in BlueMix is already well documented<\/a> so I won’t reiterate those steps, other than to say that as Apache UIMA is a Java SDK and framework, I use the Liberty for Java<\/strong> runtime. <\/p>\n

<\/p>\n

I’m not using any of the services in this simple sample. <\/p>\n

Manifest<\/strong><\/p>\n

The app is bundled up in a war file, which is what we deploy. This is specified in manifest.yml<\/a>.<\/p>\n

Building<\/strong><\/p>\n

The war file is built by an ant task<\/a> which has to include the UIMA jar in the classpath<\/a>, and copy my UIMA descriptor XML files into the war<\/a>. <\/p>\n

I’m developing in eclipse, so I set up an ant builder to run the build<\/a>, and configured the project to do it automatically<\/a>. <\/p>\n

I’m deploying from eclipse, too, using the Cloud Foundry plugins for eclipse<\/a>. <\/p>\n

XML descriptors<\/strong><\/p>\n

The type system is defined in an XML descriptor file<\/a> and specifies the different annotations that can be created by this pipeline, and the attributes that they have. <\/p>\n

Running JCasGen in eclipse on that descriptor generates Java classes representing those types<\/a>. <\/p>\n

The pipeline is also defined in XML descriptors: one overall aggregate descriptor<\/a> which imports three primitive descriptors for each of the three annotators in my sample pipeline : one to find email addresses<\/a>, one to find capitalised words<\/a> and one to find long words<\/a>. <\/p>\n

Note that the imports in the aggregate descriptor<\/a> need to be relative so that they keep working once you deploy to BlueMix. <\/p>\n

These XML descriptor files are all added to the war file by being included in the build.xml with a fileset include<\/a>. <\/p>\n

Annotators<\/strong><\/p>\n

Each of the primitive descriptor files specifies the fully qualified class name<\/a> for the Java implementation of the annotator. <\/p>\n

There are three annotators in this sample<\/a>. (XML files with names starting “primitiveAeDescriptor”).<\/p>\n

Each one is implemented by a Java class<\/a> that extends JCasAnnotator_ImplBase<\/a>.<\/p>\n

Each uses a regular expression to find things to annotate in the text. This isn’t intended to be an indication that this is how things should be done, just that it makes for a simple and stateless demonstration without any additional dependencies. <\/p>\n

The simplest is the regex used to find capitalised words in WordCaseAnnotator<\/a> and the most complex is the ridiculously painful one used to find email addresses in EmailAnnotator<\/a>. <\/p>\n

Note that the regexes are prepared in the annotator initializer<\/a>, and reused for each new CAS to process<\/a>, to improve performance. <\/p>\n

UIMA pipeline<\/strong><\/p>\n

The UIMA pipeline is defined in a single Java class<\/a>. <\/p>\n

It finds the XML descriptor for the pipeline<\/a> by looking in the location where BlueMix will unpack the war<\/a>. <\/p>\n

It creates a CAS pool<\/a> to make it easier to handle multiple concurrent requests, and avoid the overhead of creating a CAS for every request. <\/p>\n

Once the pipeline is initialised<\/a>, it is ready to handle incoming analysis requests<\/a>. <\/p>\n

Once the CAS has passed through the pipeline, the annotations are immediately copied out of the CAS into a POJO<\/a>, so that the CAS can be returned to the pool. <\/p>\n

REST API<\/strong><\/p>\n

The war file deployed to BlueMix contains a web.xml which specifies the servlet<\/a> that implements the REST API.<\/p>\n

I’m using Wink<\/a> to implement the API. The servlet definition in the web.xml specifies where to find the list of API endpoints<\/a> and the URL where the API should be<\/a>.<\/p>\n

The list of API endpoints<\/a> is a list of classes that Wink uses. There is only one API endpoint, so only one class listed. <\/p>\n

The API implementation<\/a> is a very thin wrapper around the Pipeline class<\/a>. <\/p>\n

Everything is defined using annotations<\/a>, and Wink handles turning the response into a JSON payload. <\/p>\n

That’s it<\/strong><\/p>\n

I think that’s pretty much it. <\/p>\n

<\/a><\/p>\n

I’ve added a simple front-end webpage<\/a>, with a script to submit API requests<\/a> for people who don’t want to do it with something like curl. <\/p>\n

It’s live at uimahelloworld.mybluemix.net<\/a>.<\/p>\n

Like I said, it’s very simple. The Java itself isn’t particularly complex. My reason for sharing it was to provide a boilerplate config for defining a UIMA analytics pipeline, wrapping it in a REST API, and deploying it to BlueMix. <\/p>\n

Once you’ve got that working, you can do text analytics in BlueMix as complex as whatever you can dream up for your annotators. <\/p>\n

When I get time, I’ll write a follow-up post sharing what that could look like. <\/p>\n","protected":false},"excerpt":{"rendered":"

In this post, I want to explain how to create a text analytics application in BlueMix using UIMA, and share sample code to show how to get started. First, some background if you’re unfamiliar with the jargon. What is UIMA? UIMA (Unstructured Information Management Architecture) is an Apache framework for building analytics applications for unstructured […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[560,561,512,533],"class_list":["post-3073","post","type-post","status-publish","format-standard","hentry","category-code","tag-bluemix","tag-cloudfoundry","tag-eightbar","tag-uima"],"_links":{"self":[{"href":"https:\/\/dalelane.co.uk\/blog\/index.php?rest_route=\/wp\/v2\/posts\/3073","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/dalelane.co.uk\/blog\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/dalelane.co.uk\/blog\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/dalelane.co.uk\/blog\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/dalelane.co.uk\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=3073"}],"version-history":[{"count":0,"href":"https:\/\/dalelane.co.uk\/blog\/index.php?rest_route=\/wp\/v2\/posts\/3073\/revisions"}],"wp:attachment":[{"href":"https:\/\/dalelane.co.uk\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=3073"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/dalelane.co.uk\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=3073"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/dalelane.co.uk\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=3073"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}