We have had quality metrics based on independent reviews of Office actions since at least 1983. Our initial reviews focused solely on allowances. Over time, we included additional types of reviews to provide a more thorough understanding of the quality of our work products and processes.
FY 1967 Quality Audit Program considers patents for statutory
compliance, adherence to policy, and accuracy of
classification
FY 1983 Review of Allowances begin (reviews occur prior to patent
grant)
FY 2005 Reviews of In-Process Office actions are added to allowance
reviews (includes finals and non-finals)
FY 2007 External Quality Surveys begin (to assess our stakeholders’
perception of quality)
FY 2008 Quality Index Reportings (QIR) (assessing the quality of our
processing)
FY 2010 Reviews grouped into Final Disposition (allowances and final
rejections) and In-Process (non-final rejections)
FY 2011 Quality Composite Score begins – combining seven (7)
individual quality metrics.
- In-Process Compliance Rate*
- Final Disposition Compliance Rate*
- Complete First Action on the Merits Review
- First Action on the Merits Search Review
- QIR (average of actions per disposal: RCEs as percent of total disposals; reopenings after final; second action non-finals; and restrictions after first action)
- External Quality Survey
- Internal Quality Survey
*Measuring compliance considering an Office action's ability to advance prosecution
FY 2016 Quality Metrics Program begins (composite score retired) to
simplify metrics into three (3) categories:
- Product indicators (focused on statutory compliance and clarity of Office action)*
- Process indicators (focused on QIR-type data)
- Perception indicators (focused on survey data)
*Measuring compliance considering an Office action's adherence to the criteria of compliance under each statutory basis
FY 2020 Product indicators begun in FY16 now focus more on (a) statutory
compliance, to inform our quality metrics, and (b) best practices,
to encourage activities we have found to be drivers of clarity and correctness.