1485977 - Provide a process for producing an experiment report

Status: RESOLVED WONTFIX

(Data Science :: General, task, P2)

Description

[Ryan Harter [:harter]]

As the components of the experiment analysis pipeline [1] come together, we should provide a step-by-step guide of how to generate an experiment report.

[1] https://docs.google.com/document/d/1KSBgiKFRFqzcZWjRZt6faiRp4mR56jxaJtZwJRPa3Jk/edit#

Comment 1

[Ryan Harter [:harter]]

Hey Tim,

Assigning this bug to you as discussed Monday. We need an interface for a analyst to produce an experiment report from the experiment analysis API Sunah is working on (Bug 1485804). I've been calling this the CLI, but I suppose it could be something as simple as documentation and a set of different tools. Bug 1485974 is somewhat related, designing the report scaffolding.

In short, we're looking for a way to turn a table of experiment metrics into a report. If the report we produce is in Markdown, analysts can extend that to be Rmd if they so choose. Maybe a Click CLI with some wrapper around Jinja makes sense? Feel free to grab some time on my calendar if you'd like to discuss.

Comment 3

[Jess Mokrzecki [:jmok]]

Is this bug still needed or can we close? Please note that if we do not receive a response within 7 days we will close the ticket.

Comment 4

[Tim Smith (inactive) 👨‍🔬 [:tdsmith]]

Still needed.

Comment 5

[Tim Smith (inactive) 👨‍🔬 [:tdsmith]]

I think the process Felix is driving is a better way to represent this work now.