Call for PapersPerMIS'08 will be the eighth in the series that started in 2000, targeted at defining measures and methodologies of evaluating performance of intelligent systems. The workshop has proved to be an excellent forum for discussions and partnerships, dissemination of ideas, and future collaborations in an informal setting. Attendees usually include researchers, graduate students, practitioners from industry, academia, and government agencies. 

PerMIS’08 aims at identifying and quantifying contributions of functional intelligence towards achieving success. Our working definition of functional intelligence is “the ability to act appropriately in an uncertain environment, where appropriate action is that which increases the probability of success”, and success is “the achievement of behavioral goals” (J. Albus, 1991). In addition to the main theme, as in previous years, the workshop will focus on applications of performance measures to practical problems in commercial, industrial, homeland security, and military applications. Topic areas include, but are not limited to:• Defining and measuring aspects of a system:

The level of autonomy Human-robot interactionCollaboration & coordinationTaxonomiesBiologically inspired models

• Evaluating components within intelligent systems:Sensing and perceptionKnowledge representation, world models, ontologiesPlanning and controlLearning and adaptingReasoning

• Infrastructural support for performance evaluation:Testbeds and competitions for intercomparisonsInstrumentation and other measurement tools Simulation and modeling support 

• Technology readiness measures for intelligent systems• Applied performance measures in various domains, e.g.,

Intelligent transportation systemsEmergency response robots (search and rescue, bomb disposal)Homeland security systemsDe-mining robotsDefense roboticsHazardous environments (e.g., nuclear remediation)Industrial and manufacturing systemsSpace/Aerial  roboticsMedical Robotics & assistive devices 

The Proceedings of PerMIS are indexed by INSPEC, Compendex, ACM Digital Library, and are released as a NIST Special Publication. Selected papers from past workshops have been published as special issues with the Journal of Integrated Computer-Aided Engineering (PerMIS’04) and the Journal of Field Robotics (PerMIS’06). 

PerMIS’08Performance Metrics for Intelligent Systems Workshop

August 19—21, 2008http://www.isd.mel.nist.gov/PerMIS_2008

Important DatesSubmission of full papers May 29, 2008 Proposal for invited sessions June 06, 2008Notification of acceptance June 27, 2008Final papers due July 25, 2008

Submission InformationProspective authors are requested to submit a draft paper (max. 8 pages) or an extended abstract (1-2 pages) for review. Invited session proposals can also be submitted as draft papers but should contain 1) a session title and a brief statement of purpose, 2) name and affiliation of the organizer(s), and 3) a preliminary list of speakers. All submissions must be written in English, starting with a succinct statement of the problem, the results achieved, their significance, and a comparison with previous work. Papers are to be submitted at www.isd.mel.nist.gov/PerMIS_2008/submission.htm/ using the specified templates.

General ChairElena Messina, NISTProgram ChairRaj Madhavan, ORNL/NIST

Program CommitteeS. Balakirsky NIST USAR. Bostelman NIST USAF. Bonsignorio Heron Robots ItalyG. Berg-Cross EM & I USAJ. Bornstein ARL USAP. Courtney PerkinElmer UKJ. Evans USA D. Gage XPM Tech. USAJ. Gunderson GammaTwo USAL. Gunderson GammaTwo USAS.K. Gupta UMD USAA. Jacoff NIST USAS. Julier Univ. College London UKM. Lewis UPitt USAT. Kalmar-Nagy Texas A& M USAA. del Pobil Univ. Jaume-I SpainS. Ramasamy UALR USAL. Reeker NIST USAC. Schlenoff NIST USAM. Shneier NIST USAE. Tunstel JHU-APL USA

LocationWashington, D.C. (The workshop will be held at NIST, Gaithersburg MD 20899)