Closed
Bug 487469
Opened 17 years ago
Closed 2 years ago
Graph server should output less precise floating point values
Categories
(Webtools Graveyard :: Graph Server, defect)
Tracking
(Not tracked)
RESOLVED
INCOMPLETE
People
(Reporter: catlee, Unassigned)
Details
Attachments
(1 file)
|
1.51 KB,
patch
|
rdoherty
:
review+
|
Details | Diff | Splinter Review |
If you query graph server for test data, you'll get many values like 321.14400000000001 in the json output. This isn't because we have really precise data, but rather is due to how python converts floating point values to strings.
|
||
Comment 1•17 years ago
|
||
Comment on attachment 371705 [details] [diff] [review]
Force float data to be output to 8 significant digits
This looks fine to me, but I'm no Python expert. Would like to get Lars' opinion.
Attachment #371705 -
Flags: review?(lars)
|
|
Reporter | |
Comment 2•16 years ago
|
||
ping?
|
|
||
Updated•16 years ago
|
Attachment #371705 -
Flags: review?(lars) → review+
|
Assignee | |
Updated•9 years ago
|
Product: Webtools → Webtools Graveyard
You need to log in
before you can comment on or make changes to this bug.
Description
•