Bug 1646436 Comment 1 Edit History

Note: The actual edited comment in the bug view page will always show the original commenter’s name and original timestamp.

Original comment by
on 
Are we sure this is a code changes not being picked up issue?

The failure mode yesterday was that the UI was showing "DAG fxa_export_to_amplitude seems to be missing." when clicking the dag.

https://workflow.telemetry.mozilla.org/tree?dag_id=fxa_export_to_amplitude.fxa_email_click_amplitude_export&execution_date=2020-06-16T07%3A30%3A00%2B00%3A00

I'm seeing errors in recreate_view, and create_temporary_table:
ERROR - tag name expected
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/site-packages/airflow/models/taskinstance.py", line 940, in _run_raw_task
    self.render_templates(context=context)
  File "/usr/local/lib/python2.7/site-packages/airflow/models/taskinstance.py", line 1319, in render_templates
    self.task.render_template_fields(context)
  File "/usr/local/lib/python2.7/site-packages/airflow/models/baseoperator.py", line 708, in render_template_fields
    self._do_render_template_fields(self, self.template_fields, context, jinja_env, set())
  File "/usr/local/lib/python2.7/site-packages/airflow/models/baseoperator.py", line 715, in _do_render_template_fields
    rendered_content = self.render_template(content, context, jinja_env, seen_oids)
  File "/usr/local/lib/python2.7/site-packages/airflow/models/baseoperator.py", line 744, in render_template
    return jinja_env.from_string(content).render(**context)
  File "/usr/local/lib/python2.7/site-packages/jinja2/environment.py", line 880, in from_string
    return cls.from_code(self, self.compile(source), globals, None)
  File "/usr/local/lib/python2.7/site-packages/jinja2/environment.py", line 591, in compile
    self.handle_exception(exc_info, source_hint=source_hint)
  File "/usr/local/lib/python2.7/site-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "<unknown>", line 120, in template
TemplateSyntaxError: tag name expected

ERROR - BigQuery job failed. Final error was: {u'reason': u'notFound', u'message': u'Not found: Table moz-fx-data-shared-prod:firefox_accounts.fxa_amplitude_email_clicks was not found in location US'}. The job was: {u'status': {u'state': u'DONE', u'errors': [{u'reason': u'notFound', u'message': u'Not found: Table moz-fx-data-shared-prod:firefox_accounts.fxa_amplitude_email_clicks was not found in location US'}], u'errorResult': {u'reason': u'notFound', u'message': u'Not found: Table moz-fx-data-shared-prod:firefox_accounts.fxa_amplitude_email_clicks was not found in location US'}}, u'kind': u'bigquery#job', u'statistics': {u'endTime': u'1592335591853', u'creationTime': u'1592335591803', u'startTime': u'1592335591853'}, u'jobReference': {u'projectId': u'moz-fx-data-derived-datasets', u'location': u'US', u'jobId': u'job_HGdmxKzz_Qb58qJCimpLMHwOVmbX'}, u'etag': u'IGYy3Pl7KaBjDTWWBPflbA==', u'selfLink': u'https://bigquery.googleapis.com/bigquery/v2/projects/moz-fx-data-derived-datasets/jobs/job_HGdmxKzz_Qb58qJCimpLMHwOVmbX?location=US', u'configuration': {u'query': {u'useLegacySql': False, u'destinationTable': {u'projectId': u'moz-fx-data-derived-datasets', u'tableId': u'fxa_amplitude_email_clicks_20200615', u'datasetId': u'firefox_accounts'}, u'priority': u'INTERACTIVE', u'writeDisposition': u'WRITE_EMPTY', u'allowLargeResults': False, u'createDisposition': u'CREATE_IF_NEEDED', u'query': u'SELECT * EXCEPT (submission_timestamp) FROM `moz-fx-data-shared-prod.firefox_accounts.fxa_amplitude_email_clicks` WHERE DATE(submission_timestamp) = "2020-06-15"'}, u'jobType': u'QUERY'}, u'id': u'moz-fx-data-derived-datasets:US.job_HGdmxKzz_Qb58qJCimpLMHwOVmbX', u'user_email': u'airflow-access@moz-fx-data-derived-datasets.iam.gserviceaccount.com'}
Revision 1 by
on 
Are we sure this is a code changes not being picked up issue?

The failure mode yesterday was that the UI was showing "DAG fxa_export_to_amplitude seems to be missing." when clicking the dag. I'm not seeing this today.

https://workflow.telemetry.mozilla.org/tree?dag_id=fxa_export_to_amplitude.fxa_email_click_amplitude_export&execution_date=2020-06-16T07%3A30%3A00%2B00%3A00

I'm seeing errors in recreate_view, and create_temporary_table:
ERROR - tag name expected
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/site-packages/airflow/models/taskinstance.py", line 940, in _run_raw_task
    self.render_templates(context=context)
  File "/usr/local/lib/python2.7/site-packages/airflow/models/taskinstance.py", line 1319, in render_templates
    self.task.render_template_fields(context)
  File "/usr/local/lib/python2.7/site-packages/airflow/models/baseoperator.py", line 708, in render_template_fields
    self._do_render_template_fields(self, self.template_fields, context, jinja_env, set())
  File "/usr/local/lib/python2.7/site-packages/airflow/models/baseoperator.py", line 715, in _do_render_template_fields
    rendered_content = self.render_template(content, context, jinja_env, seen_oids)
  File "/usr/local/lib/python2.7/site-packages/airflow/models/baseoperator.py", line 744, in render_template
    return jinja_env.from_string(content).render(**context)
  File "/usr/local/lib/python2.7/site-packages/jinja2/environment.py", line 880, in from_string
    return cls.from_code(self, self.compile(source), globals, None)
  File "/usr/local/lib/python2.7/site-packages/jinja2/environment.py", line 591, in compile
    self.handle_exception(exc_info, source_hint=source_hint)
  File "/usr/local/lib/python2.7/site-packages/jinja2/environment.py", line 780, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "<unknown>", line 120, in template
TemplateSyntaxError: tag name expected

ERROR - BigQuery job failed. Final error was: {u'reason': u'notFound', u'message': u'Not found: Table moz-fx-data-shared-prod:firefox_accounts.fxa_amplitude_email_clicks was not found in location US'}. The job was: {u'status': {u'state': u'DONE', u'errors': [{u'reason': u'notFound', u'message': u'Not found: Table moz-fx-data-shared-prod:firefox_accounts.fxa_amplitude_email_clicks was not found in location US'}], u'errorResult': {u'reason': u'notFound', u'message': u'Not found: Table moz-fx-data-shared-prod:firefox_accounts.fxa_amplitude_email_clicks was not found in location US'}}, u'kind': u'bigquery#job', u'statistics': {u'endTime': u'1592335591853', u'creationTime': u'1592335591803', u'startTime': u'1592335591853'}, u'jobReference': {u'projectId': u'moz-fx-data-derived-datasets', u'location': u'US', u'jobId': u'job_HGdmxKzz_Qb58qJCimpLMHwOVmbX'}, u'etag': u'IGYy3Pl7KaBjDTWWBPflbA==', u'selfLink': u'https://bigquery.googleapis.com/bigquery/v2/projects/moz-fx-data-derived-datasets/jobs/job_HGdmxKzz_Qb58qJCimpLMHwOVmbX?location=US', u'configuration': {u'query': {u'useLegacySql': False, u'destinationTable': {u'projectId': u'moz-fx-data-derived-datasets', u'tableId': u'fxa_amplitude_email_clicks_20200615', u'datasetId': u'firefox_accounts'}, u'priority': u'INTERACTIVE', u'writeDisposition': u'WRITE_EMPTY', u'allowLargeResults': False, u'createDisposition': u'CREATE_IF_NEEDED', u'query': u'SELECT * EXCEPT (submission_timestamp) FROM `moz-fx-data-shared-prod.firefox_accounts.fxa_amplitude_email_clicks` WHERE DATE(submission_timestamp) = "2020-06-15"'}, u'jobType': u'QUERY'}, u'id': u'moz-fx-data-derived-datasets:US.job_HGdmxKzz_Qb58qJCimpLMHwOVmbX', u'user_email': u'airflow-access@moz-fx-data-derived-datasets.iam.gserviceaccount.com'}

Back to Bug 1646436 Comment 1