In this post, I want to explain how to get started creating machine learning applications using the data you have on Kafka topics.<\/strong><\/p>\n<\/p>\nI’ve written a sample app<\/a>, with examples of how you can use Kafka topics as:<\/p>\n\n a source of training data for creating machine learning models<\/li>\n a source of test data for evaluating machine learning models<\/li>\n an ongoing stream of events to make predictions about using machine learning models<\/li>\n<\/ul>\nI’ll use this post to explain how it works, and how you can use it as the basis of writing your first ML pipeline using the data on your own Kafka topics.<\/p>\n<\/p>\nOverview<\/h2>\nThere are a variety of ways to do this, but for this post I’ll be starting with perhaps the simplest, aiming for something a bit like this:<\/p>\n<\/a>\n
<\/p>\n
I’ve written a sample app<\/a>, with examples of how you can use Kafka topics as:<\/p>\n\n a source of training data for creating machine learning models<\/li>\n a source of test data for evaluating machine learning models<\/li>\n an ongoing stream of events to make predictions about using machine learning models<\/li>\n<\/ul>\nI’ll use this post to explain how it works, and how you can use it as the basis of writing your first ML pipeline using the data on your own Kafka topics.<\/p>\n<\/p>\nOverview<\/h2>\nThere are a variety of ways to do this, but for this post I’ll be starting with perhaps the simplest, aiming for something a bit like this:<\/p>\n<\/a>\n
I’ll use this post to explain how it works, and how you can use it as the basis of writing your first ML pipeline using the data on your own Kafka topics.<\/p>\n
There are a variety of ways to do this, but for this post I’ll be starting with perhaps the simplest, aiming for something a bit like this:<\/p>\n
<\/a>\n
![](\"\/\/dalelane.co.uk\/blog\/wp-content\/uploads\/2019\/10\/191030-kafka-ml-3.png\")
<\/p>\n<\/p>\n![\"191030-kafka-ml-1\"\/](\"https:\/\/live.staticflickr.com\/65535\/48982711886_d8b2a807da.jpg\")
<\/a>