嘗試將 bigquery 數(shù)據(jù)導(dǎo)出到存儲，但出現(xiàn)錯誤“400 無法對嵌套架構(gòu)執(zhí)行操作。字段：event_params”。下面是我的代碼：from google.cloud import bigqueryclient = bigquery.Client()os.environ["GOOGLE_APPLICATION_CREDENTIALS"] = "/Users/Nitin/Desktop/big_query_test/soy-serty-897-ed73.json"bucket_name = "soy-serty-897.appspot.com"project = "soy-serty-897"dataset_id = "analytics_157738"table_id = "events_20190326"destination_uri = 'gs://{}/{}'.format(bucket_name, 'basket.csv')dataset_ref = client.dataset(dataset_id, project=project)table_ref = dataset_ref.table(table_id)extract_job = client.extract_table( table_ref, destination_uri, # Location must match that of the source table. location='US') # API requestextract_job.result() # Waits for job to complete.print('Exported {}:{}.{} to {}'.format( project, dataset_id, table_id, destination_uri))
2 回答
至尊寶的傳說
TA貢獻1789條經(jīng)驗 獲得超10個贊
在 BigQuery導(dǎo)出限制中，提到 CSV 不支持嵌套和重復(fù)數(shù)據(jù)。因此，嘗試導(dǎo)出到 Avro 或 JSON：
from google.cloud import bigquery
client = bigquery.Client()
bucket_name = 'your_bucket'
project = 'bigquery-public-data'
dataset_id = 'samples'
table_id = 'shakespeare'
destination_uri = 'gs://{}/{}'.format(bucket_name, '<your_file>')
dataset_ref = client.dataset(dataset_id, project=project)
table_ref = dataset_ref.table(table_id)
configuration = bigquery.job.ExtractJobConfig()
#For AVRO
#configuration.destination_format ='AVRO'
#For JSON
#configuration.destination_format ='NEWLINE_DELIMITED_JSON'
extract_job = client.extract_table(
table_ref,
destination_uri,
job_config=configuration,
location='US')
extract_job.result()
希望能幫助到你。
手掌心
TA貢獻1942條經(jīng)驗 獲得超3個贊
現(xiàn)在無法測試，但也許這有效：
from google.cloud import bigquery as bq
ejc = bq.ExtractJobConfig()
ejc.destination_format='NEWLINE_DELIMITED_JSON'
extract_job = client.extract_table(
table_ref,
destination_uri,
# Location must match that of the source table.
location='US',
job_config=ejc) # API request
這個想法是使用 JSON 而不是 CSV，以便您支持嵌套數(shù)據(jù)。
添加回答
舉報
0/150
提交
取消