Validations
No more invalid data into your data lake
Last updated
No more invalid data into your data lake
Last updated
You can configure one or more validation rules at each flow level. Events that are streamed in will be passed through these validation rules and those events that fail validations will be moved to error queue with metadata.errorType as "Validation". e.g. when you configure the Not Null validation rule on a event attribute, then any events that come in with missing value for that attribute will be marked as invalid.
Validations will be performed before the Transform stage, that way you don't have to worry about invalid data in your transform code.
You can test your validation by click the "Test Validation" button before submitting them. Update the sample message to test different possibilities.
You can use Custom validation type to specify complex conditions in either Java or Groovy script. You can use the full power of Java to perform any complex validations.
