Use the Amazon Glue Schema registry with KCL - Amazon Kinesis Data Streams
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China (PDF).

Use the Amazon Glue Schema registry with KCL

You can integrate Kinesis Data Streams with the Amazon Glue Schema registry. The Amazon Glue Schema registry lets you centrally discover, control, and evolve schemas, while ensuring data produced is continuously validated by a registered schema. A schema defines the structure and format of a data record. A schema is a versioned specification for reliable data publication, consumption, or storage. The Amazon Glue Schema registry lets you improve end-to-end data quality and data governance within your streaming applications. For more information, see Amazon Glue Schema Registry. One of the ways to set up this integration is through KCL for Java.

Important

  • Amazon Glue Schema registry integration for Kinesis Data Streams is only supported in KCL 2.3 or later.

  • Amazon Glue Schema registry integration for Kinesis Data Streams is not supported for KCL consumers written in non-Java languages that run with multilangdaemon.

  • Amazon Glue Schema registry integration for Kinesis Data Streams is not supported in any versions of KCL 1.x.

For detailed instructions on how to set up integration of Kinesis Data Streamswith Amazon Glue Schema registry using KCL, see the "Interacting with Data Using the KPL/KCL Libraries" section in Use Case: Integrating Amazon Kinesis Data Streams with the Amazon Glue Schema Registry.