You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When creating a BigQuery schema, it would be really nice to create a BigQuery schema from an avro schema, or json schema.
The command line tool seems to allow this; and the load command probably loads the schema from the avro file, and having this logic as a support class in the java api would add a lot of value.
Because honestly, I have an industry-standard schema. I don't really want to hand-code that same schema for BigQuery and I most certainly don't want to rely on manual load actions to initialise a schema.
My use case is more of a replication system. BigQuery is just one of the sinks.
I get my messages from Kafka, and can read them as byte[]. I also have the avro.Schema.
Ideally I would just give my bytes and the schema to BigQuery (the BigQuery client lib) and let that do the generic lifting.
When creating a BigQuery schema, it would be really nice to create a BigQuery schema from an avro schema, or json schema.
The command line tool seems to allow this; and the load command probably loads the schema from the avro file, and having this logic as a support class in the java api would add a lot of value.
Because honestly, I have an industry-standard schema. I don't really want to hand-code that same schema for BigQuery and I most certainly don't want to rely on manual load actions to initialise a schema.
My use case is more of a replication system. BigQuery is just one of the sinks.
I get my messages from Kafka, and can read them as byte[]. I also have the avro.Schema.
Ideally I would just give my bytes and the schema to BigQuery (the BigQuery client lib) and let that do the generic lifting.