The import and export database can be located either Internal on the StruxureWare Data Center Operation or in an External database setup (server, cluster, etc.). Both configurations are done from the same configuration interface.

With the introduction of StruxureWare Data Center Operation 7.4 configuration and management of ETL databases is done using the server configuration interface.

 

 

 

 

Internal Database

An Internal Database is a PostgreSQL instance running on the same server as StruxureWare Data Center Operation.
The database is created and deleted by StruxureWare Data Center Operation.
To create an internal database, you must provide the following:

  • Configuration Name - the name that will later be shown inside the StruxureWare Data Center Operation Client to distinguish between different databases, when configuring External Systems.
  • Database Type - databases are used for either Import or export of data
  • Database Name - the unique name used when creating the database. Import databases are always prefixed with 'staging_' and Export databases with 'export_'
  • Username - unique username. The username is prefixed by 'etluser_'
  • Password - password of the user. No special requirements.
  • Allowed IP addresses - When integrating with external systems, it may be necessary to allow direct database access to the database. It is mandatory to enter the specific ip or range of ip addresses allowed to access the database. Information regarding IP ranges can be found here

Note

Double byte characters are not supported in the configuration of the database

Once saved, the database is created and will subsequently be available inside the StruxureWare Data Center Operation Client.

The internal database connection can be paused/started using the pause/start management button. This can be used in order to pause/start the scheduled communication with the database. Pressing start will not force the communication to run but enable the scheduled communication to run according to schedule.

 

Internal Database configuration


 

 

 

 

 

 

 

External Database

An External Database is located outside of the StruxureWare Data Center Operation server. We have tested with PostgreSQL, MS Sequel Server and MySql database types and generally the only requirement is the existence of a JDBC4 compliant database driver. The database must be created, deleted and managed outside of StruxureWare Data Center Operation. The database must be set up using a UTF8 character encoding.


Webmin is used to create a configuration defining how to access the external database, and must include the following:

  • Configuration Name - the name that will later be shown inside the StruxureWare Data Center Operation Client to distinguish between different databases, when configuring External Systems.
  • Database Type - databases are used for either Import or export of data
  • Database Driver - choose what JDBC driver to use when connecting to the database. If the required driver does not appear in the list, it can be uploaded using the Upload database driver functionality
  • Database Dialect - some databases speak several  different dialects, choose the one the matches your setup.
  • Database Name - the name used when connecting to the database. External databases are never prefixed.
  • Port Number - specify what port is used to communicate with the external database. Please note that it may be necessary to open ports in firewalls between the StruxureWare Data Center Operation server, and the server hosting the remote database.
  • Username - unique username. The username is prefixed by 'etluser_'
  • Password - password of the user. No special requirements.
  • Database URL - entered values from the previous fields are combined into a database url, if extra parameters are needed, they may be inserted into the url.

Note

Double byte characters are not supported in the configuration of the database

Once saved, the configuration is created and will subsequently be available as an external database inside the StruxureWare Data Center Operation Client.

The internal database connection can be paused/started using the pause/start management button. This can be used in order to pause/start the scheduled communication with the database. Pressing start will not force the communication to run but enable the scheduled communication to run according to schedule.

 

 

External Database configuration

Database Driver Upload

When using external databases of other types than postgreSQL, it may be necessary to upload a JDBC driver to the StruxureWare Data Center Operation server. (Note: The JDBC driver must be Java 6 compatible)

This in done from the server configuration interface StruxureWare DC Operation->ETL Integration Management in the tab Upload JDBC Driver.

The required JDBC driver should be downloaded from the database vendors support site (or other trusted support site), and stored locally on the client computer.

After upload completes, the StruxureWare Data Center Operation server must be restarted.

An example using MS SQL Server can be found here

 

 

 

 

See also

ETL Examples, Troubleshooting, Tips and Tricks

ETL - Change allowed IPs

 

Skip to end of metadata
Go to start of metadata
  • No labels
RELATED COMMUNITY QUESTIONS
WAS THIS ARTICLE HELPFUL?