Version 8

8.3.1.0

(24.06.2025)

Hints for the Installation:
  • Manual Update Scripts / Automatic Model Update:

    • Exasol: No / No

    • Google BigQuery: No / No

    • MS Fabric SQL DB: No / No

    • MS SQL: No / No

    • MS Synapse: No / No

    • Oracle: No / No

    • Postgres: No / No

    • Snowflake: No / No

Bug Fixes:

  • Datavault: Fixed possibly invalid state of objects / loads after editing metadata (only affects Snowflake and Exasol).

8.3.0.1

(23.06.2025)

Hints for the Installation:
  • Manual Update Scripts / Automatic Model Update:

    • Exasol: No / No

    • Google BigQuery: No / No

    • MS Fabric SQL DB: No / No

    • MS SQL: No / No

    • MS Synapse: No / No

    • Oracle: No / No

    • Postgres: No / No

    • Snowflake: No / No

Bug Fixes:

  • Datavault: Fixed a GUI issue introduced in version 8.2.1.0 that occurred when multiple loads were present for a Hub or Link.

8.3.0.0

(13.06.2025)

Hints for the Installation:
  • Manual Update Scripts / Automatic Model Update:

    • Exasol: Yes / No

    • Google BigQuery: Yes / No

    • MS Fabric SQL DB: Yes / No

    • MS SQL: Yes / No

    • MS Synapse: Yes / No

    • Oracle: Yes / No

    • Postgres: Yes / No

    • Snowflake: Yes / No

  • Manual Update Actions:
New Features:

  • PIT: Introducing incremental loads for PITs. After the first load, on the consecutive loads the PIT will automatically detect only relevant changes since it was last loaded, reducing load time and lowering resource footprint. Currently Opt-In by parameter “enable_pit_delta_load” in dvb_config.config set to “TRUE”. [2]

Improvements:

  • Snowflake: Improved dependency evaluation when building stacked business rules using dynamic tables.

Bug Fixes:

  • Oracle: Fixed an issue which could prevent creation of multiple loads for one to one links.

  • Business Rules: Fixed an issue with newline characters in column comments to break business rule generation.

Behavior Changes:

  • Dimensional Model: Improved element layout on canvas by disabling grouping by subject area.

  • Staging: Lazy evaluation for job parameters. Only parameters which are actually used for a staging load are computed & logged.

  • Athena: Changed driver from simba to amazon.

  • API: Update of API will require onetime renewal of existing “non expiring” tokens if in use.

  • Staging: In custom source query templates, the syntax for accessing delta parameters has changed! Please check this knowledge base article: https://support.portal.datavault-builder.com/servicedesk/customer/kb/view/11995382

  • MS SQL: The new driver now uses SSL/TLS encryption by default, which in many cases will need additional settings (for client database as well as source connections). Please check this knowledge base article: https://support.portal.datavault-builder.com/servicedesk/customer/kb/view/218857485

Other Changes:

  • Core: Updated internal postgres to 17.5.

  • Core & Connection Pool: Updated to Java 21.

  • Core & Connection Pool: Optimized template handling reducing memory and cpu footprint.

  • API, Connection Pool, Core & Webgui: Updated alpine to 3.22.

  • API: Updated PostgREST to 13.0.0.

  • GIT Integration: Updated git library.

  • Amazon Redshift: Updated driver to 2.1.0.32.

  • Athena: Changed driver from simba 2.0.35 to amazon 3.5.0.

  • CSV: Updated driver to 1.0.46.

  • Databricks: Updated driver to 1.0.6-oss.

  • DB2 for IBM i: Updated driver to 21.0.3.

  • DB2 for LUW: Updated driver to 12.1.0.0.

  • Elasticsearch: Updated driver to 9.0.0.

  • Exasol: Updated driver to 25.2.3.

  • Firebird: Updated driver to 6.0.1.

  • Google BigQuery: Updated driver to 1.6.3.1004.

  • MariaDB: Updated driver to 3.5.3.

  • MS SQL: Updated driver to 12.10.0.

  • MySQL: Updated driver to 9.2.0.

  • Oracle: Updated driver to 19.27.0.0.

  • Postgres: Updated driver to 42.7.7.

  • Snowflake: Updated driver to 3.24.2.

  • SQLite: Updated driver to 3.49.1.0.

  • Theobald SAP Connector: Updated driver to 3.49.1.0.

  • Trino: Updated driver to 474.

8.2.1.0

(08.05.2025)

Hints for the Installation:
  • Manual Update Scripts / Automatic Model Update:

    • Exasol: No / No

    • Google BigQuery: No / No

    • MS Fabric SQL DB: No / No

    • MS SQL: No / No

    • MS Synapse: No / No

    • Oracle: No / No

    • Postgres: No / No

    • Snowflake: No / No

New Features:

  • Datavault: Added option to immediately load objects during creation.

Improvements:
Bug Fixes:

  • MS SQL / MS Synapse / MS Fabric SQL DB: Fixed possibly failing loads with more than 2 billion rows by using BIG_COUNT instead of COUNT.

  • Staging: Databricks source: Fixed filtering by database name.

Behavior Changes:

  • GIT: Minor differences in unselected objects are no longer automatically committed.

Other Changes:

8.2.0.1

(10.04.2025)

Hints for the Installation:
  • Manual Update Scripts / Automatic Model Update:

    • Exasol: No / No

    • Google BigQuery: No / No

    • MS Fabric SQL DB: No / No

    • MS SQL: No / No

    • MS Synapse: No / No

    • Oracle: No / No

    • Postgres: No / No

    • Snowflake: No / No

Bug Fixes:

  • Datavault: Resolved an issue where returning to the link load dialog after adding a hub load would fail if the link did not already exist.

8.2.0.0

(08.04.2025)

Hints for the Installation:
  • Manual Update Scripts / Automatic Model Update:

    • Exasol: No / Yes

    • Google BigQuery: No / Yes

    • MS Fabric SQL DB: No / Yes

    • MS SQL: No / Yes

    • MS Synapse: No / Yes

    • Oracle: No / Yes

    • Postgres: No / Yes

    • Snowflake: No / Yes

New Features:

  • Datavault: Introducing option to change DWH Historization of Satellites and bringing available option for Non Historized Transaction Links into UI. [2]

  • Operations: New API (/rpc/getMetrics) available to query current load slot usage programmatically. Check API documentation for details.

  • Deployment: New parameter available to control state of deployed materialized business rules: deployment_br_materialization_virtual_if_not_loaded (in dvb_config.config). (Details: https://support.portal.datavault-builder.com/servicedesk/customer/portal/5/article/11993221)

  • Datavault: Introducing data compression for CDC Transaction Link Loads (SCD2).

Improvements:

  • Datavault: Enable duplicate link suffix ID check also for empty suffix when creating new link.

  • Business Rules: On databases supporting transactions for truncate (i.e. Snowflake, Postgres, MS SQL, MS Fabric SQL DB, Exasol, Google BigQuery) will no longer switch proxy view during Business Ruleset materialization.

Bug Fixes:

  • Documentation: Fixed wrong label in documentation for Max Retention Period.

Behavior Changes:

  • Business Rules: Datavault Builder will prevent creation of Alias Views in Datavault Builder managed schemas (except for Accesslayer and Access Errormart, which are still allowed but not recommended. You should use custom schemas for Alias Views).

  • Staging: Security hardening. Source Systems loading from files may only use paths within /files. Relative paths are resolved in relation to /files. If you are sourcing from different root paths, you need to change file/volume mount and update the Source System configuration accordingly. Otherwise may lead to “file not found” error on load.

  • Datavault: Introducing data compression for CDC Transaction Link Loads (SCD2).

Other Changes:

  • Snowflake: Updated driver to 3.23.1.

8.1.0.0

(04.03.2025)

Hints for the Installation:
  • Manual Update Scripts / Automatic Model Update:

    • Exasol: No / Yes

    • Google BigQuery: No / Yes

    • MS Fabric SQL DB: No / Yes

    • MS SQL: No / Yes

    • MS Synapse: No / Yes

    • Oracle: No / Yes

    • Postgres: No / Yes

    • Snowflake: No / Yes

Preview:

  • MS Fabric SQL DB: Introducing support to target sql database on MS Fabric.

New Features:

  • Snowflake: Introducing option in Business Rules to make Alias View a Secure View. [2]

  • Staging: New source type available: SAP/Sybase SQL Anywhere (JConnect).

Improvements:

  • Dimensional Model: Introducing Hub Elimination for SCD1 Business Objects. If no fields of a Hub are used, the Hub will no longer be joined while traversing it. Especially for databases without built in table elimination (e.g. Snowflake) improving performance significantly. Also, if only the hash of the Start Hub is used and a Granularity Object (Transaction Link or Satellite) exists, the hash field will automatically be taken from the Granularity Object instead of from the Hub.

  • Deployment: Safety for inconsistent object states which may otherwise block deployment.

  • Business Rules: Dropdown for Accesslayer prioritization, highlighting option to Stack (UNION ALL) Business Rulesets.

  • Exasol: Improved pattern for CDC loads.

Bug Fixes:

  • Staging: Fixed displaying issue with whitespace stripping of subset parameters.

  • Dimensional Model: Fixed automated column matching when having a deployed Business Object and a related Business Object.

  • Staging: Including patched MS Access connector to handle reserved keywords in object names.

  • Operations: Fixed putJobBase API to return error on failure.

  • Datavault: Fixed preview of columns which were renamed in Staging.

  • Operations: Fixed Job opening on Job creation.

  • Snowflake: Handle missing output of Links if Link was never loaded full due to unexpected join behavior of the database. (Introduced with 8.0.0.1)

Behavior Changes:

  • Datavault: Aligned Business Key null handling between databases. For installs targeting MS SQL, Exasol, Snowflake & Synapse, if for a composite key all values are null, the record was previously loaded with only delimiters as Business Key. Now, such a record is not loaded anymore.

  • Dimensional Model: Introducing Hub Elimination for SCD1 Business Objects. If no fields of a Hub are used, the Hub will no longer be joined while traversing it. Especially for databases without built in table elimination (e.g. Snowflake) improving performance significantly. Also, if only the hash of the Start Hub is used and a Granularity Object (Transaction Link or Satellite) exists, the hash field will automatically be taken from the Granularity Object instead of from the Hub.

Other Changes:

  • Snowflake: Updated driver to 3.22.0.

  • Databricks: Updated driver to 2.7.1.

8.0.1.0

(22.01.2025)

Hints for the Installation:
  • Manual Update Scripts / Automatic Model Update:

    • MS SQL: No / No

    • Oracle: No / No

    • Postgres: No / No

    • Exasol: No / No

    • Snowflake: No / No

    • Synapse: No / No

    • BigQuery: No / No

  • Manual Update Actions:
    • MS SQL:

      • When using containerized MS SQL, modify connection string in docker compose and append trustServerCertificate=true;.

      • After stopping the environment, lookup the path for the <mssqldata_volume> on the host and execute the following: sudo chown -R 10001 <mssqldata_volume>.

Bug Fixes:

  • Deployment: Fixed “schedule_is_enabled” to be exported correctly. Could lead to activation of disabled job schedules on deployment of schedule changes. (Introduced in 7.5.1.0)

  • Documentation: Fixed export to not be empty in certain scenarios.

  • Deployment: Fixed import of unused job schedule properties (null instead of {}).

  • Snowflake: Fixed saving code (e.g. custom source query) explicitly containing tabs.

Behavior Changes:

  • Staging: On load completion, instead of -1 actual total_rows is logged now as well for loads from views and custom queries.

Other Changes:

  • MS SQL: Updated containerized database to 2022-CU16 and ubuntu 22.04. Can now also run on a host with ubuntu 24.

8.0.0.1

(31.12.2024)

Initial GA Release of Version 8. List of changes compared against Version 7.5.1.0.

With this release, Version 7 will go into maintenance mode and will only receive bugfix and security updates. End of Support for Version 7: 31.12.2025.

Hints for the Installation:
  • Manual Update Scripts / Automatic Model Update:

    • MS SQL: Yes / No

    • Oracle: Yes / No

    • Postgres: Yes / No

    • Exasol: Yes / No

    • Snowflake: Yes / Yes

    • Synapse: Yes / No

    • BigQuery: No / No

  • Manual Update Actions:

    • BigQuery source: If currently in use, remove manual driver inclusion from configuration.

New Features:

  • Target Database: Introducing BigQuery as new target database.

  • Data Catalog: Introducing additional fields to capture metadata (Object Tags, Data Owner, Retention Period, etc.). [1]

  • Snowflake: Introducing option to materialize Business Ruleset using Dynamic Tables. [2]

Improvements:

  • Documentation: Redo of Documentation module. Now allows to browse without having to generate. Also, the Documentation can now be exported over API.

  • Exasol: Improved parsing for table / view code containing unix newlines.

  • Deployment: Export & deploy system colors.

Bug Fixes:

  • Snowflake: Fixed data preview for large numeric values.

  • Metadata Views: Fixed broken fields to extract system_id and functional_suffix_id in base views.

  • MS SQL: Fixed business rules materialization schema to not contain a space.

  • Snowflake / Exasol: Fixed renaming of materialized Business Rulesets.

  • Startup: Fixed cache refresh of runtime data (last full load, staging table state).

Behavior Changes:

  • Snowflake: New default for jdbc connection to database (to be able to read large numeric values): JDBC_TREAT_DECIMAL_AS_INT=false.

  • Snowflake: Make staging and pit schema transient.

  • ID Validation: Enforce ID restrictions from UI also on API level.

  • Documentation: Switched to HTML Export instead of PDF (currently no graphics in the exported version).

  • Deployment: Removed deprecated legacy export format (1.0).

Other Changes:

  • Databricks: Updated driver to 2.6.40.

  • Exasol: Updated driver to 24.2.1.

  • BigQuery: Included driver 1.6.1.1002 in distribution.

  • CSV: Updated driver to 1.0.42.

  • Snowflake: Updated driver to 3.21.0.

8.0.0.0 Beta

(11.09.2024)