Netsuite walkthrough
Prerequisite
Working NetSuite connector in Data Integration. If you do not have a connection, follow the steps.
Pulling Netsuite data into a Target
Using Data Integration, you can pull data from Netsuite and send the data into your target database.
Procedure
-
Navigate to your Data Integration console and select Rivers.
-
Click Add River and select Source to Target River.
-
In the General Info tab, enter the river name and give it a description.
-
Go to the Source tab, find NetSuite in the list of data sources, and select it.
-
Define a Netsuite connection.
Configuring a Netsuite River
Choose your River mode:
- Multi-Tables: Load multiple tables (entities) simultaneously from Netsuite to your target.
- Legacy River: Choose a single table (entity) or a custom query to load into a single target.
Multi-table mode
Load multiple tables simultaneously from Netsuite to your target.
Auto-detect new fields in each run
By default, Data Integration updates the extracted tables metadata before each run execution. New fields are added automatically when data is pulled from the river.
Disabling this option causes the river to run according to its saved metadata without updating it before executing the data. You can track metadata updates manually by clicking the Reload Metadata in the Mapping tab.
When you add new fields to the "column mapping", existing target names/data types for mappings remain unchanged.
Mapping
- In the Mapping tab, select the tables to load.
- Click Edit on the right to edit individual table settings.
Table settings in a multi-table mode
On the Table Settings tab, you can edit the following:
- Change the loading mode.
- Change the extraction method. If you select Incremental, you can define the field to define the increment.
- Filter by an expression that acts as a WHERE clause to fetch the selected data from the table.
Filter
Add any filter to act as a WHERE clause for pulling the data.
If you want to use the filters in Netsuite, keep the syntax as supported in Netsuite.
- Combine multiple filters using the following operators: AND and OR Operator
- String and date values should be quoted with " ' ", number values should not be quoted.
For example:
(country ='United States' or curreny_id=482) and date_last_modified='2021-07-04- 08:00:00'
Legacy river mode
This river mode lets you load a single source table or a custom query into a single target table.
Procedure
-
Navigate to the Data Integration console
-
Select the connection.
-
Click the entity to pull all the available tables for that connection and select the desired table.
-
Choose an extract method:
- All: Extracts all the data in the table, which is recommended for smaller tables.
- Incremental: Runs over an increment for bigger tables and frequent runs.
-
Enter a filter to slice the returned data by field conditions:
- The condition should be a WHERE clause using NetSuite query language.
- Combine multiple filters using the following operators: AND, OR, or BETWEEN.
- String and date values should be quoted with '.
- Number values should not be quoted.
For Example:
- ( country=' United States ' or currency_id=48226) and date_last_modified=' 2018-08-08 08:08:08 '
- date_last_modified between '2018-12-09 23:00:00' and '2018-12-10 01:00:00'
-
Incremental runs require additional settings:
-
Incremental Type: The field type to increment over, Timestamp, and Running number are available.
-
Incremental Field: Click on the Incremental Field to pull all possible columns from the selected Incremental Type to increment over.
- Incremental type:
- Select Timestamp from the drop-down menu.
- Select a start and end date.
The rivers pull data from the specified start date and exclude the end date unless the include End Value checkbox is enabled.
-
Interval chunks size: This is an optional setting that splits the data into intervals, useful when dealing with large amounts of data.
-
Interval Size: The interval size splits the calls for the data into groups of the selected size. For example, a Daily chunk with an interval size of 3 splits the date range to calls of 3 days in each request.
-
Select Running Number from the drop-down menu.
-
Select a start and end value. If the end value is left empty, the river pulls data until the maximum ID in the table.
The Start Date does not advance if a River run is unsuccessful. If you do not want this default setting, click More Options and select the checkbox to advance the start date even if the River run is unsuccessful (Not recommended).
- Mapping Attributes: Click the auto mapping to get the source mapping for your table. You can delete multiple fields by selecting the desired fields using the v button and removing them using the trash can button. You can delete a single field by clicking the x button for the specific field.
- If your target destination is a database, go to step 3 (columns mapping) and click the auto mapping to convert the NetSuite mapping to the desired database mapping.
Also known as SuiteAnalytics connect.