Commit ddf8891
authored
fix: set CustomTime when writing relations (#5033)
This was basically doubling the amount of work the workers had to do,
since the record checker uses this field to see if the modified in GCS
matches datastore 🤦
i.e.
- A record gets ingested
- The relations job computes new upstream/alias/related fields
- It uploads the record with computed fields to GCS (but does not set
the CustomTime field)
- The record-checker runs. It compares the CustomTime field (empty) with
the modified field in the Vulnerability datastore entity
- Since they don't match, it sends a `gcs_mismatch` task to the
recoverer
- The recoverer picks up the `gcs_mismatch` task, and sends a reimport
job to the worker
- (since the alias/upstream/related have already been computed, this
isn't an infinite loop)1 parent 3d46c6e commit ddf8891
1 file changed
Lines changed: 1 addition & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
222 | 222 | | |
223 | 223 | | |
224 | 224 | | |
| 225 | + | |
225 | 226 | | |
226 | 227 | | |
227 | 228 | | |
| |||
0 commit comments