978782 - missing processed Thunderbird crashes?

Status: RESOLVED INVALID

(Socorro :: General, task)

Description

[Wayne Mery (:wsmwk)]

100% of Thunderbird crashes are processed, afaik. I'm trying to query Thunderbird crashes prior to June 2013. I find no data via query. 

Picked a random date June 3 ... https://crash-stats.mozilla.com/query/?product=Thunderbird&version=ALL%3AALL&range_value=2&range_unit=days&date=06%2F03%2F2013+15%3A00%3A00&query_search=signature&query_type=contains&query=n&reason=&release_channels=&build_id=&process_type=any&hang_type=any comes up nul

June 20 also null
July 2 finds crashes 
https://crash-stats.mozilla.com/query/?product=Thunderbird&version=ALL%3AALL&range_value=2&range_unit=days&date=7%2F2%2F2013+15%3A00%3A00&query_search=signature&query_type=contains&query=&reason=&release_channels=&build_id=&process_type=any&hang_type=any

Comment 1

[[DEACTIVATED] Adrian Gaudebert]

The data retention policy is 6 months, there is no data in our elasticsearch database prior to July 2013. 

There seems to be more data in our PostgreSQL databases. You can get there by adding '&_force_api_impl=psql' to your URLs. For example: https://crash-stats.mozilla.com/query/?product=Thunderbird&version=ALL%3AALL&range_value=2&range_unit=days&date=06%2F03%2F2013+15%3A00%3A00&query_search=signature&query_type=contains&query=n&reason=&release_channels=&build_id=&process_type=any&hang_type=any&_force_api_impl=psql

Comment 2

[Robert Kaiser]

(In reply to Adrian Gaudebert [:adrian] from comment #1)
> The data retention policy is 6 months

That's not true universally, see https://mana.mozilla.org/wiki/display/websites/Socorro+Data+Expiration+Policy

>, there is no data in our elasticsearch
> database prior to July 2013. 

That might even be for a different reason, as we haven't had ES back then and we never backfilled that far back. That said, we probably should explicitely mention a policy for ES in the overall rules on the website.