Moving Oracle Data into Microsoft Azure Event Hub with Quest SharePlex

Hi, this is Clay Jackson, Senior Database Sales Engineer here at Quest Software. Today I'd like to show you our award-winning database replication software, SharePlex, moving data from an Oracle database into Microsoft Azure Event Hub. We do that through a Kafka target. Here on my screen, I've got a capture process, or read process, and a post process posting to a Kafka target. Let's look at the config file and see how we make that happen. A very simple config, three lines, a comment line here in the middle, a source line that tells me where my data is coming from, a target line that tells me I'm going to take this flex demo source table, replicate it to Kafka-- and here is the server I'm going to use for that replication. If I do a status, you'll see those processes up and running. If you do a queue status, you'll see nothing in the queues right now. Let's put some stuff in the queue and do some work. I've already got some things in demo source. This is what the table looks like. And so I'm going to insert into demo_src. Select-- oops, [INAUDIBLE] keyboard here. And I'll commit. And we'll do another insert here, just to get a couple more rows going. Now I've got two rows. We'll do a few more. And then we'll commit that whole block. Now let's go over and take a look on Azure and see what's going on in the Azure side. Here is my Event Hub. And I'm all the way into my Event Hub container here. Let's go back out a little bit. And we'll show you the Event Hub first. Here is my Event Hub, ClaySPEventHub. And I've got one actual Event Hub. That was the name space. Here is my Event Hub. You can see I've got some traffic going through here. And that's moving along. All that data is going into the Event Hub. Now if I go to my storage where I keep this-- we defined a storage container for this. And we'll take a look at that. And since this is going to Kafka, our storage is going to contain JSON data. We could just as easily have used XML or even SQL statements. So you could put it directly into a database if you wanted to. Here is August, the end of the day. Here is my file. And this is an Avro file, because it is Kafka, as I said. And here, we'll look at this and go ahead and edit that file. And there is my information right there with the data. And you see, I've got an insert into the table, the table name, and the data, and the names of the columns, and then the operation with a commit to actually make that happen. So that's what shows up when you do your replication, all in all very, very simple, very easy to do. You can take it anywhere you want, once you get into Azure. There is your Synapse. There is your SQL, SQL server, analytics. Do whatever you want to do with the data. Now you've got that Oracle transaction turned into a Kafka event. If you need some additional resources, you can go to our website, quest.com/shareplex. And we'll take you to everything SharePlex. And if you look at communities.quest.com and do a search there for Kafka, you'll find a blog that I wrote that actually goes into much more detail about how I did this and how you can do it yourself in your environment. And we can also go to Confluent, another Apache Kafka broker. Or directly to Apache Kafka itself. You already have Kafka installed in house and are ready to use it. Thanks for listening. I hope you have a nice day. And come visit us soon and see what other things you do with SharePlex.