1302215 - Better support for task serialization and un-serialization

Status: RESOLVED FIXED

(Firefox Build System :: Task Configuration, task)

Description

[Dustin J. Mitchell [:dustin] (he/him)]

Tasks are serialized by building a JSON object out of some of their properties.  They are un-serialized using a `from_json` class method, but that method often lacks the context it needs to completely restore the object.  In particular, it is usually missing dependencies and context necessary for optimization.

My thinking is:

 * make optimization a dispatch-driven process (with e.g., a "files_changed" function and a "indexed_docker_image" function)
 * make task enumeration a function call, rather than a class method -- this is the "meat" of most custom task implementations anyway
 * remove use of a class hierarhcy for tasks at all -- just use a single Task class that ties all of this together and knows how to JSON/un-JSON itself.

Comment 1

[Dustin J. Mitchell [:dustin] (he/him)]

The class hierarchy I built is rooted in `taskcluster/taskgraph/task/base.py` with the subclasses in sibling files to that one.  The most interesting one is in `transform.py`, but `docker_image.py` is cool too.

These classes are referred to from `taskcluster/ci/*/kind.yml`.

Comment 2

[Dustin J. Mitchell [:dustin] (he/him)]

This has long since been fixed..