Loading Data to External Source Models
  • 6 Minutes to read
  • Dark
    Light
  • PDF

Loading Data to External Source Models

  • Dark
    Light
  • PDF

Article summary

Loading Data to the ESM Models through SpotlightXL and Spotlight Web

There are three ways to load data from an ESM model to another model:

  • Manual Entry: Data can be entered manually field by field from the source data page of the target model.
  • Bulk Entry: Bulk Entry allows for the efficient loading of large datasets by importing them directly from the source data page using file formats like CSV or TXT.
  • PCR (Planning, Consolidation, and Reporting) Data Load Entry: Data can be loaded from the ESM model to the target model using planning, consolidation, and reporting tools that provide dedicated interfaces for managing and transferring data.

These options provide flexibility in transferring data between models, allowing you to select the most suitable approach based on your specific needs and requirements.

Source Data

Source Data is used to load data into the Source Model or to review data already existing in the Source Model. To see if your Source Model contains data, click Refresh. If your Source Model does not contain data, fill in the fields provided. Then either select the Load Data, Load File option to load data from a file, or copy and paste data from your external data source into the grid of cells under the column headings.

Options Available on the Source Data Page

  • Source Model - Select the name of the source model defined on the Source Model page.
  • Total Records - A read-only field that shows how many records are in the Source Model.
  • Current Page - If your Source Model contains more than 5000 records, you can page through the data by selecting a page number from the drop-down.
  • Current Status - A read-only field that shows the current status of the load operation.
  • Last Run Time and Last Run Status - Read-only fields that show the last time a load was run and its status. Expand this row to see the details.
  • Field - Columns are provided for all field names entered on the Source Model page. If there is data in the Source Model, it appears automatically. Or you can click Refresh.

To load more data, copy and paste data in this area before clicking Load Data.

How to Load Data from Source Data Page in SpotlightXL?

  1. Go to Source Model > External Source Model > Source Data.
  2. Select the newly added Source Model name from the Value dropdown menu.
  3. Enter the data in the added fields.
  4. Once the data is added, click Load Data. After the loading process finishes, click Refresh to update the view and see the newly populated data fields.

How to Load Bulk Data from the Source Data Page?

  1. Click the Load Data dropdown and select Load File.
  2. The Source Model Data Load window appears.
  3. Click Browse to locate the file that needs to be loaded.
  4. Select the required Separator from the dropdown list.
    Note:
    The Separator is only applicable when loading TXT files.
  5. Click Load Data.
    Note;
    You can upload CSV, Excel, and Text files.
  6. A confirmation message will appear, stating that your request is being processed, and you will receive a notification once the process is completed.
  7. Upon receiving the notification, refresh the screen to update the displayed information.

Loading Data to the ESM Models through DLR (Data Load Rule)

You can load data to your ESM models from PCR (Planning, Consolidation, and Reporting) by using the DLR (Data Load Rule) feature. To create a new Data Load Rule for an ESM, you must have an already existing external source model.

How to Load Data through a DLR from Structured Planning? 

Creating a New Data Load Rule:

  1. Navigate to Maintenance > DLR.
  2. Click Data Load Rules.
  3. Click New Data Load Rule.
  4. Enter a Name for the DLR.
  5. Select any Load Type from the dropdown list. Below are the recommended options:
    • File Load 
    • Web Services
    • Copy – Paste
  6. Select External Source Model from the Load Item dropdown list.
  7. Under Load Sub Item, select the name of the ESM.
  8. Click Next.
  9. On the Select Sample Input File section, if you are loading from a file, specify its file type. These are the options available: 
    • .csv
    • .txt
    • .xls
    • .xlsx
  10. If you select the .txt file, specify the Column Delimiter from the available options, for example, Comma, Tab, and Semicolon.
  11. By default, {CR}{LF} is selected in the Row Delimiter field.
  12. Select None from the Text Qualifier drop-down.
  13. Select Data File under File Information. Notice that the Header section is pre-populated with information about your external source model and the number of fields it expects.
    Note:
    For the Number Format, we support only Comma as the Thousands Separator and Dot as the Decimal Separator.
  14. Click Next.
  15. In the Define Overall Rule Settings screen, fill in the following details:
    • Select External Source Model details, in the General tab.
      Note:
      • On the Define Overall Rule Settings section, you can select the Include in Clear Data checkbox DLR to handle clearing the existing data and loading the new data.
        • If you leave everything unchecked, the system will retain everything in your ESM and append the additional data to your load file.
      • If you want to clear all data before the load, use the Clear Model command from the SpotlightXL External Source Model menu, or Clear Model from the More menu in Model Manager.
      ModelingImagesEDSMESMClearModel1.png
    • Select Model and Calculation from the Calculations tab.
      Note:
      Users will be able to select a calculation from any model that needs to be executed right after the data load rule (DLR) is successfully executed. This will automate the calculation process every time the ESM DLR is run, and users will receive a notification once the calculation is complete.
  16. The Manipulate Input File section displays the added model information. Click Next.
  17. In the Define Data Mapping section, select the Source Column and the Map to data.
  18. Click Next. On the Load Data section, select the Data File.
  19. Click Finish and click Refresh once the data load is completed. The derived fields are populated.
Notes:

After loading the data, the formula fields in the external source model are calculated and populated. Users who submit External Source Model data via data load rules will receive email and in-app notifications. When External Source Model data is uploaded through web services, users will receive an email notification for the status.

  • An in-app notification will appear for successful and failed loading and processing of DLR in Dynamic Planning.
Quick Summary:
  • In PCR, the External Source Model is provided as a Load Item in Data Load Rules. When ESM is selected, all the ESMs are listed in the Load Sub-Item drop-down. These items are found in Maintenance, DLR, and Data Load Rules.
  • This support applies to File, Web Services, and Copy/Paste Load Types. Existing Web Services APIs (Boomi), Clear Data, Load Data & Transfer Data are extended to External Source Models.
  • Data Integration User security for users and user groups is honored for ESM data load rules. If a user or group does not have access to a DLR, they will not see it in the grid.
  • ESM data loads support Comma & Dot for Thousand & Decimal separators, respectively.
  • The Number of Source Columns and their mappings are automatically updated in the Data Load Rule based on the external source model selected. A maximum of 100 columns can be loaded via the Data Load Rule.
  • Formula and Constant type fields are not included in the Data Load Rule because they are derived automatically during the data load.
  • A maximum of 4000 characters are allowed on each field when loaded via the Data Load Rule.
  • You can also use the Include in Clear Data functionality with External Source Models. You can choose to include or exclude specific fields and, based on the clear data definition, any existing data in the model is cleared before loading the updated data.
  • The Data Load History is updated after the data load. Select Maintenance > Audit > Data Load History.

Was this article helpful?