1206064 - Setup an HTTP endpoint to accept application logs in the standard format

Status: RESOLVED WONTFIX

(Data Platform and Tools :: General, defect, P3)

Description

[Mark Reid [:mreid]]

It would be really nice to be able to submit an HTTP POST to log applications data into the pipeline in the standard format[1].

Example sources:
- scheduled job start / finish / status messages
- aggregation pipeline alerts
- notifications about spark clusters and workers being launched (for tracking usage / billing)
- others, as needed.

This is currently *not* intended for logging from client applications (like Firefox per bug 1194907, or FxOS, etc), but rather for relatively low volume server applications, for use in alerting and monitoring.

[1] https://mana.mozilla.org/wiki/display/CLOUDSERVICES/Logging+Standard

Comment 1

[Wesley Dawson [:whd]]

Generic ingestion (upon which this bug depended) is being used for these kinds of use cases e.g. mozza, edge-validator, hgpush. I don't think it's worth supporting the logging standard presently (hence WONTFIX), but it could probably be emulated/supported on generic ingestion using a JSON schema matching said standard.