Understanding Prequel data types
Because data from any source can be synced to any destination, and because data types are not necessarily synonymous across data stores, a common mapping must be used to specify the source data type and predict the destination data type. As part of Prequel configuration, the expected data type must be defined ahead of time.Source type mapping
If you are configuring a source and need to decide whatPREQUEL type to use, reference this table.
Scale and Precision limitations for decimal typesIn order to support broad compatibility across destinations,
decimal typed values must fit within the DECIMAL(38,19) scale and precision. decimal values transferred to BigQuery will be truncated to DECIMAL(38,9), as this is the maximum supported size.Geography type is limited to World Geodetic SystemEvery geometric shape has a spatial reference system associated with it. The
geography type is limited to geospatial data that corresponds to an SRID of 4326, which represents spatial data using longitude and latitude coordinates on the Earth’s surface as defined in the WGS84 standard.Choosing between
array, json, and vector- The
vectorPrequel type is used when syncing float-valued arrays (e.g., ML embeddings). - For all other array-like data, including text arrays, integer arrays, mixed types, or nested structures convert to
jsonupstream and use thejsonPrequel data type.jsonhas broader destination support and is the safer default for arbitrary arrays.
Timestamps are synced as epoch valuesAll
timestamp values are stored as a UTC epoch (microseconds since Unix epoch), regardless of the source timezone. The source timezone has no bearing on what reaches the destination. How the destination displays that epoch depends on the destination system’s timezone configuration.Athena Iceberg limitations: For Iceberg tables, Athena has two timestamp restrictions:- Type: Athena only supports
timestamp(without time zone) in DDL operations. If your Athena Iceberg source has columns typed astimestamp with time zone, cast them totimestampin your source before syncing. - Precision: Athena Iceberg only supports millisecond precision (
timestamp(3)). If your source hastimestamp(6)columns, cast them totimestamp(3)in your source before syncing.
Destination type mapping
If you are interested in what data type your recipient destination will receive, reference this table.
* An asterisk indicates partial or incomplete support. Ask us about any specific data type limitations.