Configuration FilesΒΆ

InforFlow requires following 3 configuration files to run properly.

  • Credentials (credentials.yml)

  • Modules (modules.csv)

  • Module Dependencies (module_dependencies.csv)

Credentials

Credentials file contains credentials for MS-SQL Server, M3 and Prefect Cloud.

  • MS-SQL Server
    • Server name

    • Username

    • Password

    • Source Database name (Database from which data will be transfered to M3)

    • Staging Database name (Database where data will store after transformation)

  • Prefect cloud
    • Project name

    • User token

    • Runner token

  • M3
    • M3 URL

    • ION API File

_images/img-yml.png

All these credential informations should be provided in yml format and file name should be provided in parameter when creating flow.

Modules information

For every module you want to export data from MS-SQL Server to M3 you need following information and add this to a csv file.

  • Module name (You can put any name here. This is only used to create flows)

  • Program name (This should be valid M3 program name where data will be exported)

  • Mapping excel file path (Full path for the excel file which contains the sheet used for data tranformation)

  • Sheet name (Name of the sheet which contains all the transformation information)

  • Source table name: Table name from which data will be extracted.

  • Stage table name: Table name where data will stored after transformation.

  • Start: Start row for extraction [inclusive]. 1 means first row.

  • End: End row for extraction [inclusive]. -1 means all records starting from start row. (Hint: This is not number of rows instead end row. e.g Start 2, End 6 means Rows 2, 3, 4, 5 and 6).

_images/img-module.png

All this information should be provided in csv format and file name should be provided in parameter when creating flow.

Modules dependencies information

This file contains dependencies informations. Like if a module in dependent on another module and should run only after parent module in migrated. e.g. OrderLineItems is dependent on Orders and should be transferred after Orders are transferred.

_images/img-dependencies.png

This information should be provided in csv file in a parent-child format and file name should be provided in parameter when creating flow.