Skip to main content

Reduce the use of large volume tables

Calculations joining with large volume tables often experience slow performance due to the extensive data iteration required for extracting specific columns or rows. This frequent processing can degrade overall system efficiency.

Joining a date table multiple times in a chain of logic can further impact performance, as it increases the complexity and processing time for each calculation.

Recommendations

  • Separate processing: Process the large table in a separate calculation to extract the necessary partitions. This calculation can then be used in subsequent calculations to reduce the overall processing load.

  • Consolidate joins: Ensure that the first calculation joining with the date table extracts all necessary columns for upstream calculations. This limits the need for repetitive joining and optimizes performance.