@arcane-utils/ingestion
v1.5.1
Published
Ingestion utilities for Arcane
Downloads
536
Readme
@arcane-utils/error
CHANGE LOG
V 1.5.1
Point @arcane-utils/bigquery at ^1.1.22, @arcane-utils/datastore at ^1.2.5, @arcane-utils/job-helper at ^3.1.7, @arcane-utils/logger at ^1.1.16 and @arcane-utils/types at ^1.4.7 Drops two of the three vulnerable lodash 4.17.21 copies. The last one arrives through @arcane-utils/job-helper 3.1.7, which still pins @arcane-utils/bigquery 1.1.20, and clears once job-helper is republished at 3.2.0 Use caret ranges for @arcane-utils dependencies, so a published patch or minor is picked up without a manual sweep of every package
V 1.5.0
Security: fix SQL injection in storeExecutionDetails by validating the BigQuery identifiers interpolated into the query getHistoricalTableName now rejects any ingestionId that is not a non-negative integer, and storeExecutionDetails throws when GCP_PROJECT or HISTORICAL_DATASET is missing Security: bump lodash to 4.18.1 (CVE-2026-4800, CVE-2025-13465) Update moment to 2.30.1, winston to 3.19.0 and build/test tooling (typescript 5.9.3, tsup 8.5.1, ts-jest 29.4.12)
V 1.4.12
Export createFileName and PREFIX_IMPORT from ingestion
V 1.4.11
Add the createFileName method for ingestion
V 1.4.10
jobRows can be null (instead of 0) for the new unchanged files logic + cleaning of unused dead code ('type' colon)
V 1.4.9
Remove unecessary types that can create bugs in the query job of storeExecutiondetails
V 1.4.8
Add types options paramater in the query job in storeExecutionDetails
V 1.4.7
Add the optionnal parameter "invoker" to storeExecutionDetails, it stores the uid during manual fetch
V 1.4.6
Add the parameter "labels" to storeExecutionDetails and remove "type" parameter from v1.4.4 (unused)
V 1.4.5
executionHandler now handles: - retry count from Cloud Tasks to allow retries in case of transient errors even if the previous execution is still running (ex: waiting for BigQuery job to finish) - stop the execution if the ingestion is disabled
V 1.4.4
Add the parameter "type" (manual/automatic) in storeExecutionDetails and propagate it in row
V 1.4.3
Add executionHandler function
V 1.4.2
Don't know, someone forget to update the changelog
V 1.4.1
Correct storeExecutionDetails
V 1.4.0
Add storeExecutionDetails and storeHistoryForUnchangedFile
V 1.3.0
Correct shouldCalledProductEvolutionInformation to return the correct response
V 1.2.0
Correct shouldCalledProductEvolutionInformation to return the correct response (BUGGED: missing update arcane types dependency)
V 1.1.0
Correct shouldCalledProductEvolutionInformation to return the correct response and rename it to shouldCallProductEvolutionCalculator ((BUGGED: incorrect response on first execution))
V 1.0.0
Init lib with shouldCalledProductEvolutionInformation (BUGGED: incorrect response)
