The BigQuery data object will always be associated to an BigQuery Data point. For details of creating BigQuery data point, refer Working with BigQuery Data Point

To work with BigQuery Data Object, follow below steps:

Step I: Edit, create or import an BigQuery data object

It is recommended to create data object by importing the structure from the database object.

Step II: Configuring attributes

The BigQuery Data Object contains following fields. These fields can be edited by clicking on the field and inputting the required value. When importing the structure directly from the database these fields are auto-populated based on the column properties of the database object.

  • Attribute: Displays the name of the field as in the database object. This is a text field and name can be defined as needed. It is mandatory that the attribute names in data object exactly match the column names of the database object they are referring.
  • Data Type: Displays the data type associated with the field. This is a list of applicable data types. You can select appropriate type for the field.
  • Precision: Displays the precision for the varchar, number and decimal data type. This is a text field and name can be defined as per the data in the file.
  • Scale: Displays the scale for the number and decimal data type. This is a text field and name can be defined as per the data in the file.
  • Not Null: Displays if the field can have NULL values. This is a checkbox and can be defined as per the data in the file. 
  • Cluster: A clustering key is a subset of columns in a table (or expressions on a table) that are explicitly designated to co-locate the data in the table in the same micro-partitions.
  • Description: Displays any details provided for the field. This is a text field and you can enter any detail as need.

Note:

  • Following operations are allowed on the database entries: Add, Cut, Copy, Paste, Up, Down, Delete, and Search.
  • From the list of attributes, multiple attributes can be selected and we can perform/apply these operations.
  • To add a new attribute, click Add. By default a new attribute is populated in the last row. If you want to add an attribute at a specific position then, select the attribute in the position prior to it and click Add.
  • To search for a specific attribute, enter the keyword in the search bar, and the page displays the related attributes.

Step III: Define Table Partition

Partition Attribute

Bigquery supports table partitioning by Date/Timestamp and Integer type attributes. To specify how to partition the table, select the partition attribute from the Attribute Name drop-down.

The attribute list in the drop-down is of either integer, date or timestamp type attributes. And the attributes can consists of either the data object attributes, and the BigQuery supported pseudo columns that are defined in the data object.

  • Date/timestamp: Tables are partitioned based on a TIMESTAMP or DATE column.
  • Integer range: Tables are partitioned based on an integer column.

Select the partition attribute

Option I: If the partition attribute selected is of Date or timestamp datatype, then the Partition Type drop-down displays the specific attribute options to choose from such as DATE | DAY | HOUR | MONTH | YEAR.

Option II: If the partition attribute selected is of integer datatype, then the Bucket Range text box is displayed.

To create an integer range partitioned table, provide the range values in the Bucket Range text box:

  • The start of range partitioning (inclusive)
  • The end of range partitioning (exclusive)
  • The interval of each range within the partition.

Option III: Partition can also be based on the pseudo columns _PARTITIONDATE and _PARTITIONTIME.

Options Clause Properties

To add Options Clause Properties, either select from the predefined list by clicking on Select, or add a new entry by clicking on Click Here and modifying the name manually.

Option I: 1. To add options clause, click Select

2. The Add Options window displays the list of supported properties. To add options, select properties and click Ok.

3. The selected properties are added and you can provide the values for the properties added.

The Options Clause properties consists of Property and value.

  • The "Property" field is the property name. 
  • Provide the value to be used for the property in the "Value" field against the property name.

Option II: 1. To add options clause, click Click Here

2. The Default property is added and you can enter the key and value pairs.

  • If the table with partition already exists in the database then while importing the schema, the partition details are not being added into the imported Data Object.
  • The partition options will be used when creating new table. If table already exists then the table will not be altered with any changes to the partition options.

Step III: Save the changes

To save the changes made to the data object, refer Saving Data Object.

Note: 

Viewing DDL:

DDL is generated based on the attributes and their properties in the Attributes tab. If cluster and table partition is enabled, then DDL also shows the cluster and partition expression.

Note: DDL is available only for database-based data objects, and for file-based data objects, the DDL is not available.

Viewing sample Data:

Displays preview of data from the associated object in the database.

Following options are available in View Data tab:

  • By clicking Refresh, the data displayed is reloaded.
  • By clicking Export, the displayed records are exported and saved as excel to default download folder in the machine.

Note: To view, write, and run a SQL query on the Data Object, refer Working with SQL Editor.