AgTech · Precision farming · Crop science

Agriculture annotation: plant & leaf disease datasets

Agricultural computer vision starts with a deceptively hard problem: everything is green, organic, overlapping, and variable. A leaf-disease detection model must distinguish early blight from nutrient deficiency from insect damage from ordinary senescence - distinctions that live in subtle texture, color gradients, and lesion morphology. Payana has produced a plant leaf-disease dataset on the platform, and the workflow it validated now serves AgTech companies, crop-science research groups, and precision-farming products.

The economics matter here more than in most domains. Agricultural imagery arrives in bulk - drone surveys, phone photos from field agents, fixed greenhouse cameras - and the value of a disease model depends on catching conditions early, when symptoms are small and easy to miss. That means large datasets with fine-grained, pixel-level labels: exactly the combination that makes manual annotation prohibitively slow and AI-assisted annotation transformative.

What we annotate in agricultural imagery

Label typeAgriculture useExamples
Instance segmentationPer-leaf, per-fruit, per-plant masksindividual leaves, fruits for yield estimation, weeds vs. crop
Semantic segmentationField and canopy analysishealthy tissue vs. lesion area, soil, canopy cover
Bounding boxesDetection at field scaleplants, pests, flowers, fruit clusters
ClassificationDisease identificationearly blight, late blight, rust, mosaic virus, powdery mildew, healthy
Severity attributesGrading and progression modelslesion coverage percentage, growth stage, severity grade

Disease datasets usually combine levels: a classification label for the disease, a segmentation mask for the diseased region, and attributes for severity. Payana projects support attributes on every label, so one annotation pass produces data for a classifier, a segmenter, and a severity grader simultaneously - three models from one labeling budget.

AI-assisted labeling on organic shapes

Organic boundaries are where click-to-segment assistance shines. Leaves have serrated edges, lesions have irregular margins, and neither is fun to trace by hand. On Payana, a click on a leaf returns its full boundary - serrations included - as an editable polygon; a rough box around a lesion cluster returns the lesion region. The annotator's time goes into the judgment calls (is this blight or burn?) rather than the geometry. For greenhouse or field video - a camera moving along a crop row - whole-video tracking follows individual plants across frames, enabling growth-stage and progression datasets that static images cannot provide.

Class balance is the silent killer of agricultural models: diseases are rare relative to healthy tissue, and some diseases are rare relative to others. Every Payana delivery includes class distribution reporting, and our annotators flag underrepresented classes during labeling so collection can be redirected while the field season is still open - not after it closes.

From field photos to training-ready data

Agriculture datasets export as classification folder structures or CSV (for disease classifiers), COCO JSON and YOLO (for detection), and PNG masks (for segmentation) - with versioned train/valid/test splits that keep images from the same field or survey flight together, preventing the leakage that inflates validation accuracy and then embarrasses the model in production. Multi-source datasets (drone + phone + greenhouse camera) are tagged by source so you can measure how well the model transfers between them.

Conditions we label

  • Crops - vegetables, cereals, orchards, plantation crops; any species with visual pathology.
  • Diseases & disorders - fungal (blight, rust, mildew), viral (mosaic, curl), bacterial spots, nutrient deficiencies, pest damage.
  • Capture sources - smartphone field photos, drone/UAV surveys, greenhouse cameras, lab imagery.
  • Growth analytics - plant counting, canopy coverage, flowering and fruiting stages, weed pressure.

Designing a disease taxonomy annotators can apply consistently

The hardest part of a plant-disease dataset is not drawing the masks - it is deciding what counts as what. Early blight and septoria leaf spot look similar at certain stages; potassium deficiency mimics leaf scorch; two diseases frequently co-occur on one leaf. Before bulk annotation we build a visual labeling guide with the client's agronomist: three to five reference images per class spanning early, mid, and late presentation, plus explicit decision rules ("if both rust and mildew are present, mask each region separately; if indistinguishable, use the co-infection class"). Co-occurring diseases get separate overlapping masks rather than a forced single call, and an uncertain attribute exists precisely so annotators never have to guess silently - a flagged uncertain label can be adjudicated by an expert, but a confidently wrong one poisons training data invisibly.

From dataset to field deployment

Most leaf-disease models ship to a phone in a farmer's hand or an edge box on a tractor - environments with no GPU and no connectivity guarantees. That deployment reality shapes the dataset: training images must include the noise of real capture (shadow, dew, dust on the lens, motion blur from a walking user), not just clean lab photos, and the export lands in YOLO or classification-folder formats that the small, fast model families used on-device train from directly. We tag capture source and conditions on every image, so when the field accuracy of the deployed model dips, you can trace whether the gap is a data-distribution problem (fixable with targeted collection) or a model problem - a diagnosis that is impossible when all images are an undifferentiated pile.

Beyond disease: weeds, counting, and yield

The same annotation pipeline covers the rest of the precision-agriculture stack. Weed-vs-crop segmentation - the data behind targeted spraying systems that cut herbicide use - is per-pixel work where AI-assisted masking shines, because weed boundaries interleave with crop canopies. Fruit and flower counting for yield estimation uses small-object detection with density attributes; growth-stage classification tags plants across a season into phenological stages; and canopy-cover semantic segmentation from drone surveys feeds irrigation and vigor models. A greenhouse or field robot program combines several of these - and because all label types live in one project system, the combined dataset stays coherent: one taxonomy, one QA process, one versioned export.

Seasonality: the dataset that grows with the crop

Agricultural data arrives on nature's schedule. Disease pressure varies by season and region, which means the dataset you can build this year is bounded by what the fields actually show - and the honest strategy is planned multi-season growth. Payana's versioning is built for it: each season's collection becomes a new dataset version with its provenance tagged, class-balance reports show which diseases remain underrepresented (so next season's collection can target them), and models trained on v1 remain exactly reproducible while v2 trains. Clients treat the dataset as a living asset with a roadmap, not a one-time purchase - which is also how the best agricultural AI teams treat their models.

Annotating under real capture noise

Agricultural images are captured by farmers in fields, not photographers in studios - and the dataset must embrace that or the model will fail exactly where it matters. Real capture means harsh midday shadow that splits a leaf into two exposure zones, dew and spray droplets that mimic lesion specularity, wind-blurred edges, soil-splashed lower leaves, and phone cameras that white-balance the same disease three different colors in one afternoon. Our annotators are trained on these confounders explicitly: the labeling guide includes a "not disease" gallery (water damage, mechanical injury, shadow patterns) as first-class reference material, and ambiguous images get the uncertain flag rather than a coin-flip label. The result is a dataset whose difficulty distribution matches deployment - which is the single strongest predictor that validation accuracy will survive contact with a real field.

Research institutions and product teams: two rhythms, one pipeline

Agricultural annotation clients split into two rhythms and Payana serves both. Research groups (crop-science institutes, university labs, plant-pathology programs) need publication-grade rigor: documented taxonomies, inter-annotator agreement on sampled subsets, dataset cards, and exports their reviewers can audit - deliverables that come standard with our medical-style QA applied to plants. Product teams (agri-input companies, farm-management apps, spraying-robot builders) need speed and iteration: a pilot this month, a deployable dataset next month, and a feedback loop where field failures route back into targeted collection and a new dataset version. The same platform runs both rhythms because versioning, class-balance reporting, and the labeling-guide discipline serve either master. For teams searching for a plant disease dataset annotation service, leaf disease image labeling, or precision agriculture segmentation data, the shipped leaf-disease dataset above is the working proof: per-leaf masks, disease classes, severity attributes, and training-ready exports from a single pass.

Greenhouse video and plant-level tracking

Controlled-environment agriculture adds a temporal dimension field photos lack. Greenhouse and vertical-farm operators run fixed or rail-mounted cameras past the same plants daily, and the valuable dataset is longitudinal: this specific plant, across weeks, developing symptoms or responding to treatment. Payana's video tracking applies directly - a plant labeled once in a camera pass is tracked through the traverse with a persistent identity, and identities are linked across daily passes during review, producing per-plant timelines. Disease-progression models, growth-rate estimators, and treatment-response studies all train from this structure, and it is effectively impossible to build by hand at scale: per-frame plant masks across weeks of daily video is exactly the volume regime where AI-assisted tracking changes what is feasible. The same longitudinal recipe serves phenotyping research, where the "disease" is replaced by trait expression and the timeline by a growing season.

With a labeling guide agreed before annotation starts (reference images per class, decision rules for ambiguous cases) plus a review pass. Where classes are genuinely confusable, we recommend an "uncertain" attribute rather than forced guesses - honest labels train better models.

Yes. Large orthomosaics and survey frames are annotated with detection and semantic segmentation (crop rows, bare soil, weed pressure, lodging). Very large images are tiled for annotation and the labels are merged back to original coordinates.

Yes - attributes on each label carry severity grades or lesion-coverage estimates, so the same dataset trains detection and severity models together.

That is the default working mode: datasets are versioned, so each season's additions become a new snapshot. Your v1-trained model stays reproducible while v2 trains on the extended data.

Frequently asked questions

Plant and leaf instance segmentation, disease and pest conditions as region masks with class labels, weeds versus crops, and counting datasets (fruits, plants, stands). Greenhouse video can be tracked plant-by-plant over time.

Have agriculture data to annotate?

Send us your images or video - we annotate, review, and deliver a training-ready dataset in your format.

Book an intro call