tools/indexing/scip_pipeline.py:112 vs :210-216
total_files is snapshotted once from the SCIP-covered file count:
update_job(job_id, total_files=len(files_data))
The supplementary Tree-sitter pass afterwards indexes every repo file SCIP missed, incrementing processed past that total:
files_data[abs_str] = ts_data
processed += 1
update_job(..., processed_files=processed)
Reproduction
Mocked ScipIndexer/ScipIndexParser over a 4-file repo where SCIP reports 1 file:
status=COMPLETED total_files=1 processed_files=4 progress_percentage=400.0
Impact
Any indexer covering a subset of the repo hits this — scip-php with a Composer classmap, scip-clang without full compdb coverage, scip-typescript on a partial tsconfig. Two visible symptoms:
JobInfo.progress_percentage exceeds 100 (400% above).
- While
RUNNING, remaining_files = total - processed goes negative, and management_handlers.check_job_status formats that into output like "-1m -40s" remaining.
Suggested fix
Recompute total_files before the supplementary pass begins (the full discovery list is known by then), or count the supplement into the total as files are added rather than treating the SCIP count as final.
Environment
|
|
| Commit |
c0e0bed (main) |
| Python |
3.12.3, Linux |
Reproduced with mocked SCIP components over a 4-file repo.
tools/indexing/scip_pipeline.py:112vs:210-216total_filesis snapshotted once from the SCIP-covered file count:The supplementary Tree-sitter pass afterwards indexes every repo file SCIP missed, incrementing
processedpast that total:Reproduction
Mocked
ScipIndexer/ScipIndexParserover a 4-file repo where SCIP reports 1 file:Impact
Any indexer covering a subset of the repo hits this — scip-php with a Composer classmap, scip-clang without full compdb coverage, scip-typescript on a partial tsconfig. Two visible symptoms:
JobInfo.progress_percentageexceeds 100 (400% above).RUNNING,remaining_files = total - processedgoes negative, andmanagement_handlers.check_job_statusformats that into output like"-1m -40s"remaining.Suggested fix
Recompute
total_filesbefore the supplementary pass begins (the full discovery list is known by then), or count the supplement into the total as files are added rather than treating the SCIP count as final.Environment
c0e0bed(main)Reproduced with mocked SCIP components over a 4-file repo.