1822141 - Missing columns in `firefox_desktop.newtab_v1` for `events`.[...].`timestamp`

Status: RESOLVED WONTFIX

(Data Platform and Tools :: General, defect)

Description

[Sean Rose [:srose]]

The column appears to have been added in June 2022, so why are we seeing this missing column error?

Comment 1

[Leli [:Leli]]

Ok I did look around a bit and this is what I found so far:

• The timestamp column is present as Sean mentioned.
• events is an array with multiple entries where a lot of them do have a timestamp, even in the cases where one or more array entries do not
• looking at a very small sample it seems as if a second opened event often comes with a null timestamp and if there are other impression events after that they will also have a null timestamp
• the timestamp recorded in the additional properties does look extremely off {"timestamp":18446744073705351253} ... which would be in nanoseconds and still refer to the year 2554

I don't think the problem is on our side but somewhere with the data getting sent

Comment 2

[Anna Scholtz [:ascholtz]]

This seems to have been fixed