1177106 - Cannot submit reports to treeherder staging: "TypeError: __str__ returned non-string (type WantReadError)"

Status: RESOLVED WORKSFORME

(Tree Management :: Treeherder: API, defect)

Description

[Henrik Skupin [:whimboo][⌚️UTC+2]]

A couple of minutes ago I tried to upload reports for our firefox ui tests to https://treeherder.allizom.org and it fails with the following exception:

Traceback (most recent call last):
  File "runtests.py", line 208, in <module>
    main()
  File "runtests.py", line 203, in main
    runner.run_tests(options, args)
  File "runtests.py", line 104, in run_tests
    print('Cannot post job information to treeherder: %s' % e.message)
TypeError: __str__ returned non-string (type WantReadError)

The key and secret are fine, so maybe it relates to the job collection or a server side change, which is not clear from looking at this failure. 

Here the job collection I'm posting:

Sending results to Treeherder: [{"project": "mozilla-central", "job": {"end_timestamp": 0, "submit_timestamp": 1435163873, "start_timestamp": 1435163873, "build_url": "", "name": "Firefox UI Test - functional (en-US)", "option_collection": {"opt": true}, "artifacts": [], "machine_platform": {"platform": "linux64", "os_name": "linux", "architecture": "x86_64"}, "who": "", "group_symbol": "Ff", "reason": "", "group_name": "Firefox UI Test - functional", "machine": "whimboo", "state": "running", "log_references": [], "result": "", "build_platform": {"platform": "linux64", "os_name": "linux", "architecture": "x86_64"}, "job_symbol": "en-US", "job_guid": "2e8192dd-b505-4c0d-9d30-1ed4b7564356", "product_name": "Firefox", "desc": ""}, "revision_hash": "3a6218bb5c12a4e4567e7d9001a54765c008ea1a", "coalesced": []}]

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+2]]

I traced this down to _post_json() in TreeherderClient where we use the requests module to post the data. So this should really be a server side issue.

Comment 2

[William Lachance (:wlach)]

Yeah, this doesn't seem like a client side issue to me.

Comment 3

[William Lachance (:wlach)]

It would be helpful to post a link to your code which is doing the submitting as well.

Comment 4

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Not sure why it wasn't working eariler but now all is fine and I can submit results:

https://treeherder.allizom.org/#/jobs?repo=mozilla-central&revision=be81b8d6fae9&filter-job_group_symbol=Ff&filter-job_group_symbol=Fr&filter-job_group_symbol=Fu

Comment 5

[Henrik Skupin [:whimboo][⌚️UTC+2]]

It's happening again. Looks like that this is a temporary issue with the server.

Comment 6

[Ed Morley [:emorley]]

I'm not really sure how to proceed with this.
Without knowing exactly what was submitted, there isn't much to go on.
Newer versions of the client (can't remember if we've done a release since) will log more about what was submitted, so perhaps that will help.

Comment 7

[Henrik Skupin [:whimboo][⌚️UTC+2]]

The problem didn't occur all August so far. Lets close as WFM for now. I will reopen if it happens again.