2022-07-22 stonedb-并行hashJoin内存占用分析

摘要: 分析内存增长的逻辑, 确定出导致OOM的原因 代码位置: stonedb-dev: https://github.com/adofsauron/s

摘要:

分析内存增长的逻辑, 确定出导致OOM的原因

代码位置: stonedb-dev: https://github.com/adofsauron/stonedb-dev

分析:

追踪内存增长的日志

单个任务执行 ParallelHashJoiner::AsyncMatchDim

[2022-07-22 18:33:51.739837] [29191] [INFO] [parameterized_filter.cpp:1310] MSG: Timer 2.807702 : ApplyDescriptor: Parallel : task_num : 24
[2022-07-22 18:33:51.742806] [29191] [INFO] [parallel_hash_join.cpp:262] MSG: ParallelHashJoiner::ExecuteJoinConditions
[2022-07-22 18:33:51.744499] [29191] [INFO] [multi_index_builder.cpp:176] MSG: PARAL HASH  MultiIndexBuilder::Init: 600037902
[2022-07