Audit Dashboard and Audit UI

How to Audit

This section helps the user understand how to access the Audit Dashboard and begin auditing in the audit tool.

Audit Dashboard

https://lh7-us.googleusercontent.com/docsz/AD_4nXdN9wcOy-9T3vNf1ECYMBuy-PXINlz5l_0OPJyILCGwHTKnjOCXY0SPNUtd4-D0Vlz7Plr_1saqtaseB5VAFJeXOKpnH0M_dFH15wVrZkaSneO1bMsMB2I-tbIkZPZvBg7iRgEmfmW0k0cP9XbIlZBCE5dk?key=tqmIQLWSqKPLCxepT_CyYQ

  • Select the job to audit

  • The dashboard for the selected job is displayed

https://lh7-us.googleusercontent.com/docsz/AD_4nXetj4qCgG-iT0NK1qRz5CAOdv7hJ_b6pMr4_QpTF5aoc0F8w57PWEx3aRbfJM1sQIt9fPwrhMtHm2Wk2uu6FHv63gR7TFyzMmbEqMZLSrls-EL4RexQvrJUlXvVP4S1WdYVcvm8AH9HICUDJ_PqNMCWEEk?key=tqmIQLWSqKPLCxepT_CyYQ

  • Each batch represents one sequence

  • Tasks - Number of frames in one sequence

  • Total Annotations - Total annotations in sequence

  • Issues - Feedback created by the auditor

  • Open/Closed/Ignored - Number of feedback/issues in open/closed/ignored status respectively

  • Status

    • LIP (Label in Progress) - Cannot be accessed by auditor till labeling is complete

    • RFA (Ready for Audit) - Auditor can select this sequence provided no other sequence is assigned to them

    • AIP (Audit in Progress) - Auditor is currently reviewing the sequence

  • Assigned To - Name of the Auditor

  • Last Updated - Last time the sequence was submitted. A sequence can go multiple rounds of audit

  • Action - To launch a sequence to audit

Audit Tool

  • Annotated data is loaded on the tool

  • The annotated data is read-only and audit can only provide feedback/issues against

    1. Annotations created

    2. Missing annotations

  • To create an issue, auditor can

    1. Click on the Issues button at the top right -> Click on ‘+’

    2. Contextual click the annotation and select ‘Create Issue’

  • User provides the frame number on where the issue was spotted

    • If auditor provides ‘-1’, the tool understand it to be an issue card against the sequence

  • Class, Instance and Attributes are all dropdowns which appear from the recipe created

  • Issue category must be provided to understand where the error occurred

  • Issue category is color coordinated, grouping the same types of errors in a similar color.

  • Once the necessary details have been entered, click on Save to create a new issue card.

  • Clicking on the 3 dots on an issue card shows how the user can change the status of the issue card, reply on it or add markers

  • 3D and 2D markers are used to redirect the annotator's attention to a location on the point cloud or image respectively. This is used mostly to point out missed objects.

  • Auditors use the Issues Summary and see a summary of the issues created so far.

  • Filter Issues allows the user to create custom filters

  • Clicking on the issue cards redirects the Auditor to the location the issue was created

  • Once auditor is done creating issues, they click on the top right corner Submit button

PreviousExportNextSteps to Load LiDAR Data in the Tool

Last updated