Skip to content

Study

Jump to bottom Edit New page
Brian Helba edited this page Apr 13, 2018 · 22 revisions

Concept

A study gathers clinical interpretations on a set of images from a set of users.

The prompts for clinical interpretation may in the form of questions or features.

Each study has the following properties:

  • _id: A unique identifier
  • name: A human-readable name
  • description: A paragraph-length description
  • images: A list of images, each of which will be annotated
  • users: A list of participating annotators
  • questions: A list questions that are posed to annotators
  • features: A list of features that are available for annotators to markup
  • creator: A user who created this study
  • created: A UTC time when this was created

Annotator

An annotator is a user who is participating in a study. All annotators are treated equally, so every image, question, and feature within the study is presented to every annotator.

Question

A question is textual prompt, asking for clinical interpretations regarding a whole image.

For each question in a study, annotators will prompted input a free-text value or a multiple-choice text value (depending on the properties of the question) on each image of the study, creating responses in an annotation as a result.

Feature

A feature is a type of clinically-observable localized visual pattern within the skin.

Features are not clinical properties of an entire lesion (e.g. lesion symmetry); rather, features must occur at specific locations within the skin. Features are also not particular observed instances of a pattern within an image: that is markup; rather, features are prototypical kinds of patterns.

When a feature is included in a study, annotators will prompted provide their clinical interpretation of the location of all included features in each image of the study, creating markups in an annotation as a result.

Master Feature List

At present, only features from the Master Feature List may be included in a study. The Master Feature List consists of:

Click to expand
  • Lines : Angulated lines / Polygons / Zig-zag pattern
  • Lines : Atypical pigment network / Reticulation
  • Lines : Branched streaks
  • Lines : Broadened pigment network / Reticulation
  • Lines : Cerebriform pattern
  • Lines : Crypts
  • Lines : Delicate pigment network / Reticulation
  • Lines : Fibrillar pattern
  • Lines : Fingerprint pattern
  • Lines : Leaf like areas
  • Lines : Negative pigment network
  • Lines : Parallel furrows pattern (volar lesions)
  • Lines : Parallel lines (volar lesions)
  • Lines : Parallel ridge pattern (volar lesions)
  • Lines : Pseudopods
  • Lines : Radial streaming
  • Lines : Rhomboids (facial skin)
  • Lines : Shiny white streaks
  • Lines : Spoke wheel areas
  • Lines : Streaks
  • Lines : Starburst pattern
  • Lines : Typical pigment network / Reticulation
  • Lines : NOS
  • Globules / Clods : Blue
  • Globules / Clods : Blue-gray ovoid nests
  • Globules / Clods : Cobblestone pattern
  • Globules / Clods : Comedo-like openings
  • Globules / Clods : Concentric
  • Globules / Clods : Irregular
  • Globules / Clods : Regular
  • Globules / Clods : Leaflike area
  • Globules / Clods : Spoke wheel areas
  • Globules / Clods : Milia-like cysts
  • Globules / Clods : Milky red
  • Globules / Clods : Lacunae : Red
  • Globules / Clods : Lacunae : Black
  • Globules / Clods : Lacunae : Blue
  • Globules / Clods : Lacunae : Red-purple
  • Globules / Clods : Lacunae : NOS
  • Globules / Clods : Rim of brown globules
  • Globules / Clods : Shiny white blotches and strands
  • Globules / Clods : Variant of spoke wheel area
  • Globules / Clods : White
  • Globules / Clods : NOS
  • Dots : Annular-granular pattern
  • Dots : Black
  • Dots : Blue-gray
  • Dots : Brown
  • Dots : Granularity
  • Dots : Irregular
  • Dots : Linear
  • Dots : Milia-like cysts
  • Dots : Peppering
  • Dots : Regular
  • Dots : Rosettes
  • Dots : Targetoid
  • Dots : Yellow
  • Dots : NOS
  • Circles & Semicircles : Asymmetric follicular openings
  • Circles & Semicircles : Brown
  • Circles & Semicircles : Circle within a circle
  • Circles & Semicircles : Fish scale (mucosal lesions)
  • Circles & Semicircles : Gray
  • Circles & Semicircles : White
  • Circles & Semicircles : NOS
  • Structureless : Blotch irregular
  • Structureless : Blotch regular
  • Structureless : Blue-whitish veil
  • Structureless : Central white patch
  • Structureless : Homogeneous pattern : Blue
  • Structureless : Homogeneous pattern : Brown
  • Structureless : Homogeneous pattern : Pink
  • Structureless : Homogeneous pattern : NOS
  • Structureless : Milky red areas
  • Structureless : Pseudonetwork
  • Structureless : Rainbow pattern
  • Structureless : Scar-like depigmentation
  • Structureless : Strawberry pattern
  • Structureless : Structureless brown (tan)
  • Structureless : NOS
  • Vessels : Arborizing
  • Vessels : Comma
  • Vessels : Corkscrew
  • Vessels : Crown
  • Vessels : Dotted
  • Vessels : Glomerular
  • Vessels : Hairpin
  • Vessels : Linear irregular
  • Vessels : Monomorphous
  • Vessels : Polymorphous
  • Vessels : String of pearls
  • Vessels : Targetoid
  • Vessels : NOS
  • Network : Atypical pigment network / Reticulation
  • Network : Broadened pigment network / Reticulation
  • Network : Delicate Pigment Network / Reticulation
  • Network : Negative pigment network
  • Network : Typical pigment network / Reticulation
  • Network : NOS
  • Pattern : Cerebriform
  • Pattern : Fibrilar
  • Pattern : Fingerprint
  • Pattern : Homogeneous : Blue
  • Pattern : Homogeneous : Brown
  • Pattern : Homogeneous : Pink
  • Pattern : Homogeneous : NOS
  • Pattern : Honeycomb
  • Pattern : Latticelike
  • Pattern : Parallel furrow
  • Pattern : Parallel ridge
  • Pattern : Rainbow
  • Pattern : Starburst
  • Pattern : Strawberry
  • Pattern : NOS
  • Regression structures : Peppering / Granularity
  • Regression structures : Scarlike depigmentation
  • Regression structures : NOS
  • Shiny white structures : Rosettes
  • Shiny white structures : Shiny white blotches and strands
  • Shiny white structures : Shiny white streaks
  • Shiny white structures : NOS
  • Facial Skin : Annular-granular pattern
  • Facial Skin : Asymmetric follicular openings
  • Facial Skin : Brown circles
  • Facial Skin : Circle within a circle
  • Facial Skin : Pseudonetwork
  • Facial Skin : Rhomboids / Zig-zag pattern
  • Volar lesions : Parallel furrow pattern
  • Volar lesions : Fibrilar pattern
  • Volar lesions : Latticelike pattern
  • Volar lesions : Parallel lines
  • Volar lesions : Parallel ridge pattern
  • Nail lesions : Blood spots
  • Nail lesions : Granular inclusions
  • Nail lesions : Hutchinson sign
  • Nail lesions : Irregular lines
  • Nail lesions : Pseudo-Hutchinson sign
  • Nail lesions : Splinter hemorrhage
  • Nail lesions : Regular lines
  • Miscellaneous : Angulated lines / Polygons
  • Miscellaneous : Annular-granular pattern
  • Miscellaneous : Asymmetric pigmented follicular openings
  • Miscellaneous : Blood spots
  • Miscellaneous : Blotch irregular
  • Miscellaneous : Blotch regular
  • Miscellaneous : Blue-whitish veil
  • Miscellaneous : Circle within a circle
  • Miscellaneous : Comedo-like openings
  • Miscellaneous : Crypts
  • Miscellaneous : Disruption of parallelism
  • Miscellaneous : Fissures
  • Miscellaneous : Granularity or granules
  • Miscellaneous : Hutchinson sign
  • Miscellaneous : Lacunae : Red
  • Miscellaneous : Lacunae : Black
  • Miscellaneous : Lacunae : Blue
  • Miscellaneous : Lacunae : Red-purple
  • Miscellaneous : Lacunae : NOS
  • Miscellaneous : Leaflike area
  • Miscellaneous : Milia-like cysts, cloudy or starry
  • Miscellaneous : Moth-eaten border
  • Miscellaneous : Pseudo-Hutchinson sign
  • Miscellaneous : Pseudonetwork
  • Miscellaneous : Pseudopods
  • Miscellaneous : Radial streaming
  • Miscellaneous : Regularly bended ribbon sign
  • Miscellaneous : Rhomboids / Zig-zag pattern
  • Miscellaneous : Ridges
  • Miscellaneous : Scale
  • Miscellaneous : Setting-sun pattern
  • Miscellaneous : Spoke wheel area
  • Miscellaneous : Streaks
  • Miscellaneous : String of pearls
  • Miscellaneous : Structureless, brown (tan)
  • Miscellaneous : Twisted red loops
  • Miscellaneous : Ulceration / Erosion

Feature Synonyms

Some types of visual patterns appear multiple times on the Master Feature List as distinct features, as the same semantic pattern may be commonly referred to using multiple terminologies or locations within a hierarchy.

However, to preserve information about which particular feature an annotator is actually using, the API does not recognize or combine synonymous feature terms. Instead, it is the responsibility of the client (either a web application or an API script) to include all synonymous features when creating a study and when performing queries of markups.

For reference, the synonymous terms of the Master Feature List are:

Click to expand
  • Lines : Angulated lines / Polygons / Zig-zag pattern
  • Miscellaneous : Angulated lines / Polygons
  • Lines : Atypical pigment network / Reticulation
  • Network : Atypical pigment network / Reticulation
  • Lines : Broadened pigment network / Reticulation
  • Network : Broadened pigment network / Reticulation
  • Lines : Crypts
  • Miscellaneous : Crypts
  • Lines : Delicate pigment network / Reticulation
  • Network : Delicate Pigment Network / Reticulation
  • Lines : Negative pigment network
  • Network : Negative pigment network
  • Lines : Pseudopods
  • Miscellaneous : Pseudopods
  • Lines : Radial streaming
  • Miscellaneous : Radial streaming
  • Lines : Spoke wheel areas
  • Globules / Clods : Spoke wheel areas
  • Miscellaneous : Spoke wheel area
  • Lines : Streaks
  • Miscellaneous : Streaks
  • Lines : Starburst pattern
  • Pattern : Starburst
  • Lines : Typical pigment network / Reticulation
  • Network : Typical pigment network / Reticulation
  • Globules / Clods : Comedo-like openings
  • Miscellaneous : Comedo-like openings
  • Lines : Leaf like areas
  • Globules / Clods : Leaflike area
  • Miscellaneous : Leaflike area
  • Globules / Clods : Milia-like cysts
  • Dots : Milia-like cysts
  • Miscellaneous : Milia-like cysts, cloudy or starry
  • Globules / Clods : Shiny white blotches and strands
  • Shiny white structures : Shiny white blotches and strands
  • Dots : Annular-granular pattern
  • Facial Skin : Annular-granular pattern
  • Miscellaneous : Annular-granular pattern
  • Dots : Rosettes
  • Shiny white structures : Rosettes
  • Circles & Semicircles : Asymmetric follicular openings
  • Facial Skin : Asymmetric follicular openings
  • Circles & Semicircles : Circle within a circle
  • Facial Skin : Circle within a circle
  • Miscellaneous : Circle within a circle
  • Structureless : Pseudonetwork
  • Facial Skin : Pseudonetwork
  • Miscellaneous : Pseudonetwork
  • Nail lesions : Blood spots
  • Miscellaneous : Blood spots
  • Nail lesions : Hutchinson sign
  • Miscellaneous : Hutchinson sign
  • Nail lesions : Pseudo-Hutchinson sign
  • Miscellaneous : Pseudo-Hutchinson sign
  • Vessels : String of pearls
  • Miscellaneous : String of pearls
  • Structureless : Blotch irregular
  • Miscellaneous : Blotch irregular
  • Structureless : Blotch regular
  • Miscellaneous : Blotch regular
  • Structureless : Blue-whitish veil
  • Miscellaneous : Blue-whitish veil
  • Lines : Parallel furrows pattern (volar lesions)
  • Pattern : Parallel furrow
  • Volar lesions : Parallel furrow pattern
  • Lines : Parallel lines (volar lesions)
  • Pattern : Parallel ridge
  • Volar lesions : Parallel lines
  • Lines : Parallel ridge pattern (volar lesions)
  • Volar lesions : Parallel ridge pattern
  • Globules / Clods : Lacunae : Red
  • Miscellaneous : Lacunae : Red
  • Globules / Clods : Lacunae : Black
  • Miscellaneous : Lacunae : Black
  • Globules / Clods : Lacunae : Blue
  • Miscellaneous : Lacunae : Blue
  • Globules / Clods : Lacunae : Red-purple
  • Miscellaneous : Lacunae : Red-purple
  • Globules / Clods : Lacunae : NOS
  • Miscellaneous : Lacunae : NOS
  • Lines : Fibrillar pattern
  • Pattern : Fibrilar
  • Volar lesions : Fibrilar pattern
  • Pattern : Latticelike
  • Volar lesions : Latticelike pattern
  • Structureless : Rainbow pattern
  • Pattern : Rainbow
  • Lines : Cerebriform pattern
  • Pattern : Cerebriform
  • Structureless : Strawberry pattern
  • Pattern : Strawberry
  • Structureless : Scar-like depigmentation
  • Regression structures : Scarlike depigmentation
  • Dots : Peppering
  • Regression structures : Peppering / Granularity
  • Lines : Shiny white streaks
  • Shiny white structures : Shiny white streaks
  • Structureless : Homogeneous pattern : Blue
  • Pattern : Homogeneous : Blue
  • Structureless : Homogeneous pattern : Brown
  • Pattern : Homogeneous : Brown
  • Structureless : Homogeneous pattern : Pink
  • Pattern : Homogeneous : Pink
  • Structureless : Homogeneous pattern : NOS
  • Pattern : Homogeneous : NOS
  • Circles & Semicircles : Brown
  • Facial Skin : Brown circles
  • Structureless : Structureless brown (tan)
  • Miscellaneous : Structureless, brown (tan)
  • Lines : Fingerprint pattern
  • Pattern : Fingerprint
  • Lines : Rhomboids (facial skin)
  • Facial Skin : Rhomboids / Zig-zag pattern
  • Miscellaneous : Rhomboids / Zig-zag pattern

Example

A typical study object is JSON-encoded, and may look like:

{
    "_id": "",
    ...
}

...

API

...

Add a custom footer
Add a custom sidebar

Clone this wiki locally