Version 8

8.2.0.1

(10.04.2025)

Hints for the Installation:
  • Manual Update Scripts / Automatic Model Update:

    • Exasol: No / No

    • Google BigQuery: No / No

    • MS Fabric SQL DB: No / No

    • MS SQL: No / No

    • MS Synapse: No / No

    • Oracle: No / No

    • Postgres: No / No

    • Snowflake: No / No

Bugfix:

  • Datavault: Resolved an issue where returning to the link load dialog after adding a hub load would fail if the link did not already exist.

8.2.0.0

(08.04.2025)

Hints for the Installation:
  • Manual Update Scripts / Automatic Model Update:

    • Exasol: No / Yes

    • Google BigQuery: No / Yes

    • MS Fabric SQL DB: No / Yes

    • MS SQL: No / Yes

    • MS Synapse: No / Yes

    • Oracle: No / Yes

    • Postgres: No / Yes

    • Snowflake: No / Yes

New Features:

  • Datavault: Introducing option to change DWH Historization of Satellites and bringing available option for Non Historized Transaction Links into UI. [2]

  • Operations: New API (/rpc/getMetrics) available to query current load slot usage programmatically. Check API documentation for details.

  • Deployment: New parameter available to control state of deployed materialized business rules: deployment_br_materialization_virtual_if_not_loaded (in dvb_config.config). (Details: https://support.portal.datavault-builder.com/servicedesk/customer/portal/5/article/11993221)

  • Datavault: Introducing data compression for CDC Transaction Link Loads (SCD2).

Improvements:

  • Datavault: Enable duplicate link suffix ID check also for empty suffix when creating new link.

  • Business Rules: On databases supporting transactions for truncate (i.e. Snowflake, Postgres, MS SQL, MS Fabric SQL DB, Exasol, Google BigQuery) will no longer switch proxy view during Business Ruleset materialization.

Bugfix:

  • Documentation: Fixed wrong label in documentation for Max Retention Period.

Behavior Changes:

  • Business Rules: Datavault Builder will prevent creation of Alias Views in Datavault Builder managed schemas (except for Accesslayer and Access Errormart, which are still allowed but not recommended. You should use custom schemas for Alias Views).

  • Staging: Security hardening. Source Systems loading from files may only use paths within /files. Relative paths are resolved in relation to /files. If you are sourcing from different root paths, you need to change file/volume mount and update the Source System configuration accordingly. Otherwise may lead to “file not found” error on load.

  • Datavault: Introducing data compression for CDC Transaction Link Loads (SCD2).

Other Changes:

  • Snowflake: Updated driver to 3.23.1.

8.1.0.0

(04.03.2025)

Hints for the Installation:
  • Manual Update Scripts / Automatic Model Update:

    • Exasol: No / Yes

    • Google BigQuery: No / Yes

    • MS Fabric SQL DB: No / Yes

    • MS SQL: No / Yes

    • MS Synapse: No / Yes

    • Oracle: No / Yes

    • Postgres: No / Yes

    • Snowflake: No / Yes

Preview:

  • MS Fabric SQL DB: Introducing support to target sql database on MS Fabric.

New Features:

  • Snowflake: Introducing option in Business Rules to make Alias View a Secure View. [2]

  • Staging: New source type available: SAP/Sybase SQL Anywhere (JConnect).

Improvements:

  • Dimensional Model: Introducing Hub Elimination for SCD1 Business Objects. If no fields of a Hub are used, the Hub will no longer be joined while traversing it. Especially for databases without built in table elimination (e.g. Snowflake) improving performance significantly. Also, if only the hash of the Start Hub is used and a Granularity Object (Transaction Link or Satellite) exists, the hash field will automatically be taken from the Granularity Object instead of from the Hub.

  • Deployment: Safety for inconsistent object states which may otherwise block deployment.

  • Business Rules: Dropdown for Accesslayer prioritization, highlighting option to Stack (UNION ALL) Business Rulesets.

  • Exasol: Improved pattern for CDC loads.

Bugfix:

  • Staging: Fixed displaying issue with whitespace stripping of subset parameters.

  • Dimensional Model: Fixed automated column matching when having a deployed Business Object and a related Business Object.

  • Staging: Including patched MS Access connector to handle reserved keywords in object names.

  • Operations: Fixed putJobBase API to return error on failure.

  • Datavault: Fixed preview of columns which were renamed in Staging.

  • Operations: Fixed Job opening on Job creation.

  • Snowflake: Handle missing output of Links if Link was never loaded full due to unexpected join behavior of the database. (Introduced with 8.0.0.1)

Behavior Changes:

  • Datavault: Aligned Business Key null handling between databases. For installs targeting MS SQL, Exasol, Snowflake & Synapse, if for a composite key all values are null, the record was previously loaded with only delimiters as Business Key. Now, such a record is not loaded anymore.

  • Dimensional Model: Introducing Hub Elimination for SCD1 Business Objects. If no fields of a Hub are used, the Hub will no longer be joined while traversing it. Especially for databases without built in table elimination (e.g. Snowflake) improving performance significantly. Also, if only the hash of the Start Hub is used and a Granularity Object (Transaction Link or Satellite) exists, the hash field will automatically be taken from the Granularity Object instead of from the Hub.

Other Changes:

  • Snowflake: Updated driver to 3.22.0.

  • Databricks: Updated driver to 2.7.1.

8.0.1.0

(22.01.2025)

Hints for the Installation:
  • Manual Update Scripts / Automatic Model Update:

    • MS SQL: No / No

    • Oracle: No / No

    • Postgres: No / No

    • Exasol: No / No

    • Snowflake: No / No

    • Synapse: No / No

    • BigQuery: No / No

  • Manual Update Actions:
    • MS SQL:

      • When using containerized MS SQL, modify connection string in docker compose and append trustServerCertificate=true;.

      • After stopping the environment, lookup the path for the <mssqldata_volume> on the host and execute the following: sudo chown -R 10001 <mssqldata_volume>.

Bugfix:

  • Deployment: Fixed “schedule_is_enabled” to be exported correctly. Could lead to activation of disabled job schedules on deployment of schedule changes. (Introduced in 7.5.1.0)

  • Documentation: Fixed export to not be empty in certain scenarios.

  • Deployment: Fixed import of unused job schedule properties (null instead of {}).

  • Snowflake: Fixed saving code (e.g. custom source query) explicitly containing tabs.

Behavior Changes:

  • Staging: On load completion, instead of -1 actual total_rows is logged now as well for loads from views and custom queries.

Other Changes:

  • MS SQL: Updated containerized database to 2022-CU16 and ubuntu 22.04. Can now also run on a host with ubuntu 24.

8.0.0.1

(31.12.2024)

Initial GA Release of Version 8. List of changes compared against Version 7.5.1.0.

With this release, Version 7 will go into maintenance mode and will only receive bugfix and security updates. End of Support for Version 7: 31.12.2025.

Hints for the Installation:
  • Manual Update Scripts / Automatic Model Update:

    • MS SQL: Yes / No

    • Oracle: Yes / No

    • Postgres: Yes / No

    • Exasol: Yes / No

    • Snowflake: Yes / Yes

    • Synapse: Yes / No

    • BigQuery: No / No

  • Manual Update Actions:

    • BigQuery source: If currently in use, remove manual driver inclusion from configuration.

New Features:

  • Target Database: Introducing BigQuery as new target database.

  • Data Catalog: Introducing additional fields to capture metadata (Object Tags, Data Owner, Retention Period, etc.). [1]

  • Snowflake: Introducing option to materialize Business Ruleset using Dynamic Tables. [2]

Improvements:

  • Documentation: Redo of Documentation module. Now allows to browse without having to generate. Also, the Documentation can now be exported over API.

  • Exasol: Improved parsing for table / view code containing unix newlines.

  • Deployment: Export & deploy system colors.

Bugfix:

  • Snowflake: Fixed data preview for large numeric values.

  • Metadata Views: Fixed broken fields to extract system_id and functional_suffix_id in base views.

  • MS SQL: Fixed business rules materialization schema to not contain a space.

  • Snowflake / Exasol: Fixed renaming of materialized Business Rulesets.

  • Startup: Fixed cache refresh of runtime data (last full load, staging table state).

Behavior Changes:

  • Snowflake: New default for jdbc connection to database (to be able to read large numeric values): JDBC_TREAT_DECIMAL_AS_INT=false.

  • Snowflake: Make staging and pit schema transient.

  • ID Validation: Enforce ID restrictions from UI also on API level.

  • Documentation: Switched to HTML Export instead of PDF (currently no graphics in the exported version).

  • Deployment: Removed deprecated legacy export format (1.0).

Other Changes:

  • Databricks: Updated driver to 2.6.40.

  • Exasol: Updated driver to 24.2.1.

  • BigQuery: Included driver 1.6.1.1002 in distribution.

  • CSV: Updated driver to 1.0.42.

  • Snowflake: Updated driver to 3.21.0.

8.0.0.0 Beta

(11.09.2024)