View on GitHub

Main Menu    Labelling Interface    Rules

Labelling Rules

Note: We have revised and simplified these rules as of July 12, 2019

There are a number of rules that need to be followed for labelling, so that we can have consistent results between labellers. These rules can be broken down into two broad categories:

  1. Rules for interpreting and labelling imagery
  2. Rules for classifying different types of agriculture

Rules for interpreting and labelling imagery

There are several rules for how you label on the images that you see in the interface. We list these rules here and then explain and illustrate them in more depth in the linked pages.

Rule 1: Label the fields that are visible in the Planet imagery, not the fields that you see in the basemap.

Rule 2: Please label the fields as they appear in the off-season Planet images. If it is too hard to make these out clearly, the next choice is to label them in growing season imagery.

Rule 3: But use all available images (Planet scenes and base label) to help you interpret what is and is not a field. Toggling back and forth between the different image sources can help you identify and classify the field boundaries.

Rule 4: Label fields that _intersect_ the labelling target, making sure to finish the entire boundary.

Rules for classifying different types of agriculture

Each time you draw a polygon around a field, you have the option of choosing one of several categories for classifying the type of agriculture in the field under the polygon that you drew. Previously (in 2018) we were interested in labelling both annual cropland and tree crops, but now we are only interested in labelling annual cropland. We also have a class for fallow fields (annual croplands that haven’t been planted in a few years), and two categories for cases where you are uncertain (“Unsure if agricultural field or not”; “Field, but unsure of category”). We also have a category for labelling cloud or cloud shadow, because sometimes these occur in images. We have rules for using each of these classes also.

Rule 5: Choose the annual croplands category if the fields looks like they contain crops that are planted and harvested during a single year (or occasionally after a few seasons).

Rule 6: 2019 Update: Fields that look like they are under tree crops, such as orchards, woodlots, or other planted forest types are agriculture, but we will not label these in the current campaign. Therefore, do not draw polygons around these types of fields.

Rule 7: Choose the fallow category if the fields looks like it was an annual cropland that is somewhat overgrown, and hasn’t been planted in a few seasons.

Rule 8: Choose the field, but unsure of category if you can’t tell whether the field is annual cropland, a tree crop, or fallow. Try hard to avoid this category.

Rule 9: Choose the unsure if agricultural field or not category if you think the field might be agriculture (whether annual cropland, tree crops, or fallow), but it could also be non-agricultural land. Try hard to avoid this category also.

Rule 10: Label clouds or cloud shadows if you see it in the Planet images, and label accordingly.

Rule 11: Don’t label any polygons if there is no agricultural to label, or if the fields look like they are tree crops (see updated Rule 6).

Other Rules

Rule 12: Don’t label fields within urban neighborhoods

Extra Labelling Examples

We add to our rules list in this page, and provide some additional examples here.

Main Menu    Labelling Interface    Rules