Release Notes Incorta 2024.1.5

Release Highlights

This maintenance pack introduces new features as well as fixes and enhancements, including:

• Support for Single Logout for SAML2 SSO providers
• Enhancements to the Inspector Tool’s output
• New Public API endpoints to create Catalog folders and manage dashboards
• Performance enhancements on GCS and monitoring its usage

Upgrade Considerations

Single Logout for SAML2 SSO providers

Incorta now supports Single Logout (SLO) for SAML2 SSO identity providers, including Azure Active Directory (AD) and OneLogin. When users sign out from Incorta, they are automatically signed out from their SAML2 SSO identity providers.

The Single Logout URL on both Incorta and the identity provider must be set to Incorta’s login page URL, for example, https://myCluster.cloud.incorta.com/incorta/!myTenant/ or https://10.10.1.5:8080/incorta/!myTenant/.

In the case of OneLogin, set the SAML initiator option to Service Provider.

Update the SSO configurations on Incorta and add the following settings:

• onelogin.saml2.idp.single_logout_service.url: The logout URL provided in your SSO provider's metadata.xml
• onelogin.saml2.sp.single_logout_service.url: Incorta’s login URL, for example, https://myCluster.cloud.incorta.com/incorta/!myTenant/ or https://10.10.1.5:8080/incorta/!myTenant/
• onelogin.saml2.sp.single_logout_service.response.url: Incorta’s login URL

For more details, refer to Guides → Configure SSO.

What’s New

• Inspector Tool enhancements
• New Public API endpoints
• Monitoring file system usage enhancements
• Performance enhancements on GCS

Inspector Tool enhancements

The Inspector Tool now generates three new reports as part of its output. You can modify the InspectorMetadata schema and create new tables based on the new CSV files.

• schemaClusters
• tablesDataSources
• mvsProperties

Additionally, the busSchemaViews report has been updated to include business schemas with Analyzer Views only.

schemaClusters report

The schemaClusters report organizes physical schemas within a tenant into clusters based on their interrelationships. Related physical schemas are grouped into distinct clusters while independent schemas are placed in their dedicated cluster: single schema cluster. Schemas are related if they have cross-schema joins or if a materialized view (MV) in one schema references objects in another. This report provides a deeper insight into schema relationships, enabling Schema Managers to create more efficient load plans tailored for optimal performance.

tablesDataSources report

The tablesDataSources report details the physical schema tables within a tenant along with their data sources, allowing Schema Managers to track where each data source is referenced.

mvsProperties report

The mvsProperties report captures materialized views (MVs) in a tenant and lists the additional properties per MV, including Spark and Notebook properties

New Public API endpoints

Two new endpoints are now available:

• Create Catalog Folder (/catalog/folder: Creates a new folder after providing the folder name and the ID of its parent folder.
• Rename and move Dashboards (/dashboards): Renames a list of dashboards, moves them to other folders, or transfers their ownership.

Monitoring file system usage enhancements

Incorta can now collect more metrics when monitoring how Incorta services use the Google Cloud Storage (GCS) file system. The following are some of the metrics that Incorta captures in the new audit file:

• The shortest and longest time taken by different backend method calls related to file operations, including reading and writing operations on audit and Parquet files
• The path of the files that record the shortest and longest time
• The smallest and largest file sizes

Contact Incorta Support to enable this feature.

Performance enhancements on GCS

This release is introducing multiple enhancements to reading Parquet segments on the Google Cloud Storage (GCS) file system, improving the system performance in the following areas:

• Full PK Index calculations
• Incremental PK Index calculations
• Full column reading from Parquet via the Loader or Analytics services

The new enhancements include:

• Getting Parquet segments from multiple increment directories in parallel
• Checking the existence of offsets in parallel by default (This feature was introduced before but disabled by default.)
• Using a Cached Thread Pool when creating threads instead of a Fixed Thread Pool

Fixes and Enhancements

Additional Enhancements

Fixes