Skip to content

external_detector_example.rst

Latest commit

 

History

History
80 lines (58 loc) · 2.97 KB

external_detector_example.rst

File metadata and controls

80 lines (58 loc) · 2.97 KB

External detector example

This software is pre-production and should not be deployed to production servers.

Before running the example you must:

  • Set up Mesos cluster with Aurora framework.
  • Be able to connect to Mesos operator API available at https://127.0.0.1:5051

Assuming that external implementation of detector is provided as external_package in example module and called ExampleDetector defined as:

#example/external_package.py

from wca import detectors
from wca import mesos
from wca import metrics


class ExampleDetector(detectors.AnomalyDetector):
    """Always return anomaly for given task."""

    def __init__(self, task_id: mesos.TaskId):
        self.task_id = task_id

    def detect(
            self,
            platform: Platform,
            tasks_data: TasksData,
            ) -> (List[Anomaly], List[Metric]):
        anomalies = [
            detectors.ContentionAnomaly(
                resource=detectors.ContendedResource.CPUS
                contended_task_id='task1',
                contending_task_ids=['task2', 'task3']
                metrics=[Metric(name="a_threshold", value=66.6, type="gauge")]
            )
        ]
        debugging_metrics = [
            metrics.Metric(
                name='some_debug',
                value=2,
                labels=dict(
                    version=2,
                )
            )
        ]
        return anomalies, debugging_metrics

when configuration file mesos_external_detector.yaml is used:

runner: !DetectionRunner
  measurement_runner: !MeasurementRunner
    ...
  detector: !ExampleDetector
    task_id: 'some_task_id'
    ...

you can run WCA in following way. Remember to use the absolute configuration path:

sudo env PYTHONPATH=$PWD/examples PEX_INHERIT_PATH=fallback dist/wca.pex -c ${PWD}/configs/mesos/mesos_external_detector.yaml -r external_package:ExampleDetector -l debug --root

you will see similar output:

2018-07-13 14:51:32,829 DEBUG    {MainThread} [wca.logger] level=DEBUG
2018-07-13 14:51:32,829 DEBUG    {MainThread} [wca.main] started PID=30048
2018-07-13 14:51:32,913 DEBUG    {MainThread} [wca.storage] [Metric(name='platform_dummy', value=1, labels={}, type=None, help=None)]
2018-07-13 14:51:32,913 DEBUG    {MainThread} [wca.storage] [Metric(name='anomaly', value=1, labels={'task_id': 'task_id', 'resource': <ContendedResource.CPUS: 'cpus'>, 'uuid': <bound method ContentionAnomaly.uuid of ContentionAnomaly(task_ids=['task_id'], resource=<ContendedResource.CPUS: 'cpus'>)>}, type=<MetricType.COUNTER: 'counter'>, help=None), Metric(name='some_debug', value=2, labels={'version': 2}, type=None, help=None)]