Events & Schemas
The basic building blocks of your data!
Last updated
Was this helpful?
The basic building blocks of your data!
Last updated
Was this helpful?
An event in FLOW is the base unit of data that can be an application action sent to FLOW via our Input Connectors, a row in Database Table, a line in a CSV file, a row in a Salesforce object and so on — each piece of information that is streamed into FLOW is treated as an individual event. FLOW automatically converts each event into a JSON structure as part of the input process. FLOW also adds metadata information to every event.
Transform lets you define how the events from each input are handled, meaning how they are transformed, enriched, merged and so on.
Mapper lets you define which event fields are taken and replicated into the tables and columns of your target data lake.
Schema is an internal data construct (similar to JSON/Avro Schema) automatically created by FLOW to represent the data structure of events of a flow. FLOW automatically generates the schema based on the input type and allows you to adjust for schema less data such as CSV or JSON inputs.
When an event of a certain flow contains a new attribute, then this attribute is automatically added to the corresponding schema. If an attribute of an event is changed, then its schema includes both the old attribute and the new attribute.
Attributes are not deleted from the schema. If you want to remove attributes that are no longer relevant, you can do so manually from the schema.