sample navigation bar go NIST home page Go to the IAD Home Page About IAD IAD Programs IAD Publications IAD Search

Information Access Division (IAD) Publications List

Below are links to the complete listings of publications, and papers as a result of the research performed by Information Access Division's Retrieval Group staff. The publications with a letter after the coding number (such as 101A, or 205C) are available by the Superintendent of Documents through the U.S. Government Printing Office. The documents with a coding system without a letter (such as 101, 205) are available in electronic format below. If a paper copy is required, please send your request to the Patricia Flanagan .

2004
#580 Stanford, V., Rochet, C., Michel, M., and Garofolo, J., Beyond Close-Talk - Issues in Distant Speech Acquisition, Conditioning, Classification, and Recognition, Proceeding in the ICASSP 2004 Meeting Recognition Workshop, PDF Format

#579 Stanford, V., Kasianowicz, J.,Transport of DNA through a Single Nanometer-Scale Pore: Evolution of Signal Structure Proceeding in the IEEE Workshop on Genomic Signal Processing and Statistics, 2004, PDF Format

#578 Martin, A., Garofolo, J., Fiscus, J., Le, A., Pallett, D., Przybocki, M., and Sanders, G., NIST Language Technology Evaluation Cookbook, Proceeding in the 4th Intl.Conference on Language Resources and Evaluation - Lisbon, Portugal. PDF Format

#577 Martin, A., Przybocki, M., etc, The MMSR Bilingual and Crosschannel Corpora for Speaker Recogntion Research and Evaluation, Proceeding in Odyssey 2004, Toledo, Spain. PDF Format

#576 Slattery, O., Drive Compatibility Test (Phase 2) for DVD-R (General) and DVD+R Discs, including DVD Creation Plan, NIST SP 500-258

#575 Slattery, O., Lu, Zheng, J., Byers, F., & Tang, X., Stability Comparison of Recordable optical Discs - A Study of Error Rates in Harsh Conditions, NIST Journal 0f Research.

#574 Grother, P., FRVT 2002 Supplemental Report, NISTIR 7083.

#573 Gother, P., Watson, C., Wilson, C., and et al, FpVTE Report, NISTIR 7123.

#572 Grother, P., Phillips, J., Models of Large Population Recognition Performance, Proceedings of CVPR 2004.

#571 Garofolo,J., Laprun, C., and Fiscus, J., The Rich Transcripiton 2004 Spring Meeting Recognition Evaluation. Washington, D.C.

#570 Garofolo, J., Laprun, C., Michel, M., Stanford, V., and Tabassi, E., The NIST Meeting Room Pilot Corpus. proceeding in the 2004 International Language Resources and Evaluation Conference (LREC), Lisbon, Portugal.

#566 Soboroff, I., On Evaluatiing Web Search with Very Few Relevant Documents. Proceedings of the Twenty-Seventy Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Toronto, Canada, pp. 530-531. ACM Press: 2004. PDF Format

#565 Soboroff I and Harman D, Overview of the TREC 2003 Novelty Track. Proceedings of the Twelfth Text REtrieval Conference (TREC 2003), NIST Special Publication 500-255, pp. 38-53. PDF Format

#564 Godil, A., ViSA: Video Segmentation and Annotation, UPA2004 conference, June 6-11, 2004, Minneapolis, MN PDF Format

#563 Godil, A., Ressler, S., and Grother, P., Face Recognition using 3D surface and color map information: Comparison and Combination to the SPIE’s symposium on “ Biometrics Technology for Human Identification”, April 12-13, 2004, Orlando, FL, PDF Format

#562 Godil, A., Grother, P., and Ressler, R., Human Identification from Body Shape proceedings of 4th International Conference on 3D Digital Imaging and Modeling, Oct 6-10 2003, Banff, Canada, PDF Format.

#561 Voorhees, E.M., Overview of TREC 2003, In Proceedings of the Twelfth Text REtrieval Conference (TREC 2003), NIST Special Publication 500-255, 2004, pp. 1--13. PDF Format

#560 Voorhees, E.M., Overview of the TREC 2003 Question Answering Track, In Proceedings of the Twelfth Text REtrieval Conference (TREC 2003), NIST Special Publication 500-255, 2004, pp. 54--68. PDF Format

#559 Voorhees, E.M., Overview of the TREC 2003 Robust Retrieval Track, In Proceedings of the Twelfth Text REtrieval Conference (TREC 2003), NIST Special Publication 500-255, 2004, pp. 69--77. PDF Format

#558 Buckley, C., and Voorhees, E., M., Retrieval Evaluation with Incomplete Information, In Proceedings of the Twenty-Seventh Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM Press, 2004, pp. 25--32. PDF Format

#557 Voorhees, E., Measuring Ineffectiveness, In Proceedings of the Twenty-Seventh Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM Press, 2004, pp. 562--563. PDF Format

#556 Voorhees, E., Harman, D., The Text REtrieval Conference, Chapter 1 in in "TREC: Experiment and Evaluation in Information Retrieval, Ellen M. Voorhees and Donna K. Harman, editors. MIT Press, 2005.

#555 Buckley, C., Voorhees, E., Chap. 3 Retrieval System Evaluation, Chapter 3 in "TREC: Experiment and Evaluation in Information Retrieval, Ellen M. Voorhees and Donna K. Harman, editors. MIT Press, 2005.

#554 Voorhees, E., Garofolo, J., Retrieving Noisy Text, Chapter 8 in "TREC: Experiment and Evaluation in Information Retrieval, Ellen M. Voorhees and Donna K. Harman, editors. MIT Press, 2005.

#553 Voorhees, E., Question Answering in TREC, Chapter 10 in "TREC: Experiment and Evaluation in Information Retrieval, Ellen M. Voorhees and Donna K. Harman, editors. MIT Press, 2005.

#552 Przybocki, M., Martin, A., Conversational Telephone Speech Corpus Collection for the NIST Speaker Recognition Evaluation 2004, Proceeding in LREC 2004, pp 587-590. PDF format

#551 Przybocki, M., Martin, A., NIST Speaker Recognition Evaluation Chronicles, Proceedings in Odyssey 2004, PDF format

#550 Wood, S., Wilson, C., Studies of Plain-to-Rolled Fingerprint Matching Using the NSIT Algorithmic Test Bed (ATB), NISTIR 7112, PDF format

#549 Michaels, R., Boult is the Urn Well-Mixed? Uncovering False Cofactor Homogeneity Assumption in Evaluation, , NISTIR , PDF Format

#548 Wilson, C.L., Garris, M.D., and Watson, C.I., Matching Performance for the US-VISIT IDENT System Using Flat Fingerprints, NISTIR 7110, National Institute of Standards and Technology, (May 2004). PDF Format

#547 Wilson, C.L., Austin Hicklin, R., Korves, H., Ulery, B., Zoepfl, M., Bone, M., Grother, P., Micheal, R., Otto, S., and Watson, C., Fingerprint vendor technology evaluation 2003: summary of results and analysis report, NISTIR 7123, National Institute of Standards and Technology, (June 2004). NSIT 7123

#546 Scholtz, J., The Effect of Situation Awareness Acquisition in Determining the Ratio of Operators to Semi-Autonomous Driving Vehicles, Journal Intl. Society for Optical Engineering, PDF format

#545 Scholtz, J., Usability Evaluation, Encyclopedia of Human-Computer Interaction, PDF format

#544 Scholtz, J., Antonishek, A.,Young, J., Evaluation of Human-Robot Interaction in the NIST Reference Search and Rescue Test Arenas, proceedings in the Performance Metrics for Intelligent Systems 2004 (PerMIS '04), PDF Format

#543 Drury, Scholtz, J., Evaluating Inter-Organizational Information System, book chapter, Book Inter-Organizational Information Systems in the internet Age Sean B. Eom, Editor

#542 Scholtz,J., Consolvo,S., Towards a Discipline for Evaluating Ubiquitous Computing Applications NISTIR 7091 and published in the IEEE CS and IEEE COMSoc, Pervasive Computing, March 2004, ppg. 82-88, PDF format

#541 Scholtz,J., Morse, E.,& Hewett, T., In Depth Observational Studies of Professional Intelligence Analysis, proceeding in the Human performance, Situation Awareness & Automation Techn. Conference, PDF format

#540 Scholtz, J., Young, J., Antonishek, B., Evaluation of Human-Robot Interface: Development of a Situational Awareness Methodology , proceeding in the Hawaii Intl Conference on System Science (HICSS), PDF format

#539 Smith, J.R., Over P., Leung C., Ip H., Grubinger M. 2004. Multimedia retrieval benchmarks. IEEE Multimedia vol.11, no.2: 80-4.

#538 Smeaton, A.F., Kraaij, W., and Over, P., The TREC Video Retrieval Evaluation (TRECVID): A Case Study and Status Report. in RIAO 2004 Conference Proceedings, Avignon, France. 26-28 April 2004. Pgs 25-37.

#537 Tabassi, E., Wilson, C., Watson, C. Fingerprint Image Quality NIST IR 7151, August 2004 PDF format

#536 Sheppard, C., LaPlant, Neville, Dublin Core and the Alternative Interface Access protocol Proceedings in the Dublin Core 2003 Conference, PDF format

#535 Fenimore, C., Baroncini, V., Oelbaum, T., Tan, K. T., Subjective testing Methodology in MPEG video verification Proceedings in the SPIE Conference, PDF format

#534 Fenimore, C., Nikolaev, A., a Assessment of Resolution and dynamic Range for Digital Cinema proceedings in Image and Video Communicaitons & Processing 2003, SPIE

#533 Irvine, Fenimore, C.., et al Feasibility Study for the Development of a Motion Imagery Quality Metric proceedings in Applied Imagery Pattern Recognition Workshop, Oct. 13-15, 2004 In Washington, DC, PDF format

#532 Watson, C., Wilson, C., Indovina, M., Snelick, Studies of One-to-One Fingerprint Matching with Vendor SDK Matchers, NISTIR 7119 ,PDF format

2003
#531 Use of Technology Standards and Interoperable DatabasesWith Machine-Readable, Tamper-Resistant Travel Documents submitted to the Congress jointly by the Attorney General, Secretary of State, and NIST , Feb.4,2003.

#530 Godil, A., Grother, P., Ressler, S., Human Identification from Body Shape accepted to 4th International Conference on 3D Digital Imaging and Modeling, Oct 6-10 2003, Banff, Canada.

#529 Ressler, S., Wang, Q., Using Web3D Technologies to Visualize and Analyze Caesar Data, in proceeding of XVth Triennial Congress International Ergonomics Association (IEA 2003) Aug 24-29, Seoul, Korea.

#528 Ressler, S., Intellectual Property Issues and the Web3D Consortium Standards Development, in ACM SIGGRAPH Public Policy May 2003 Computer Graphics Column ,

#527 Ressler, S., Summary of NIST Standards for Biometric Accuracy, Tamper Resistance, and Interoperability, November 13 2002.

#526 Sheppard., LaPlant, W., Nevile, L., Dublin Core and the Alternative Interface Access Protocol, Proceedings

#525 Rehm, E., Chang, W., A Simple Metadata Profile with Levels, ISO/MPEG M9587, MPEG Pattaya Meeting, March 2003

#524 Voorhees, E.M., Evaluating the Evaluation: A Case Study Using the TREC 2002 Question Answering Track, Proceedings of the 2003 Human Language Technology Conference (HLT-NAACL 03)

#523 Parush, A. and Morse, E. Industry Usability Reporting and the Common Industry Format (ANSI-NCITS 354-2001). UPA Voice 5(1),

#522 Martin, A., Przybocki, M., NIST 2003 Language Recognition Evaluation, Proceedings, Eurospeech 2003

#521 Stanford, V.M., Garofolo, J.S., Galibert, O.P., Michel, M., Laprun, C.D.m The NIST Smart Space and Meeting Room Projects: Signals, Acquisition, Annotation, and Metrics, Proceedings of the 2003 IEEE International Conference on Acoustics Speech and Signal Processing

#520 Stanford, V.M., Kasianowicz, J.J., Using HMMs to Quantify Signals from DNA Driven Through a Nanometer Scale Pore, 2002 Genomic Signal Processing Conference website (http://www.gensips.gatech.edu)

#519 Casasent, D., Watson, C., Correlation Filters for Elastic-Distorted Live-Scan Fingerprint Recognition, NISTIR 6990

#518 Micheals, R.J., Grother, P., Phillips, P.J., The NIST Human ID Evaluation Framework, NISTIR 6983 and AVBPA 2003

#517 Sanders, G.A., Le, A.N., Effects of Speech Recognition Accuracy on Performance of DARPA Communicator Spoken Dialogue Systems, International Journal of Speech Technology (ISSN 1381-2416)

#516 Yanco, H., Drury, J., Scholtz, J., Awareness in Human-robot Interaction,, to appear in System, Man, and Cybernetics Conference, October, 2004. Scholtz, J., Antonishek, B.,

#515 Young, J., Evaluation of Operator Interventions in Autonomous Off-road Driving National Institute of Standards and Technology To appear in PerMis, September, 2003.

#514 Scholtz, J., Bahrami, S., Human-Robot Interaction: Development of an Evaluation Methodology for the Bystander Role of Interaction, to appear in System, Man, and Cybernetics Conference, October, 2004

#513 Scholtz, J., Human-Robot Interaction, in Proceedings of Hawaii International Conference on System Science, Jan. 2003.

#512 Scholtz, J.C., Laskowski, S.J., Morse, E.L., Wichansky, A., Butler, K., Sullivan, K., The Common Industry Format: A Way for Vendors and Customers to Talk About Software Usability, Proceedings of the 10th Annual Human-Computer Interaction Conference

#511 Scholtz, J., Other Evaluation of Intelligent, Interactive Systems, to appear in IJCAI (International Joint Conference Artificial Intelligence), Workshop on AI 2 IA, August, 2004.

#510 Smeaton, A. F. (Ireland) Over, P. D., The TREC-2002 Video Track Report Text Retrieval , in proceedings the TREC Workshop, (NIST SP)

#509 Harman, D., Overview of the TREC 2002 Novelty Track, Proceedings of the Eleventh Text Retrieval Conference, TREC 2002NIST Special Publication 500-251 May 2003

#508 Harman, D., The Development and Evolution of TREC and DUC, Proceedings of the Third NTCIR Workshop on Research in Information Retrieval, Automatic Text Summarization and Question-Answering, March 2003

#507 Soboroff, I., Robertson, S., Building a Filtering Test Collection for TREC 2002. To be presented at the 26th Annual International ACM SIGIR Conference (SIGIR 2003), Toronto, Canada,July 2003.

#506 Wilson, C. Watson, C., Garris, M., Hicklin, A., Studies of Fingerprint Matching Using the NIST Verification Test Bed (VTB), NIST Internal Report 7020. Watson, C.,

#505 Casasent, D., Correlation Filters for Recognition of Live-scan Fingerprints with Elastic Distortions, SPIE-Optical Pattern Recognition, Orlando, FL April 2003.

#504 Chang, W., MPEG-7 Profiles & Levels Schema Verification and Test Cases, ISO/MPEG M8919, MPEG Shanghai Meeting, October 2002

#503 Michel, M., Stanford, V., Galibert, O., Network Transfer of Control Data: An Application of the NIST Smart Data Flow presented at CCCT 2003 International Conference on Computer,Communication and Control Technologies: CCCT '03) on July 31, August 1-2, 2003 - Orlando, Florida, USA

#502 Stanford, V., Pervasive Computing Puts Food on the Table, IEEE Pervasive Computing Mobile and Ubiquitous Systems, Volume 2, Number 1, January-March 2003

#501 Stanford, V., Pervasive Computing Goes tha Last Hundred Feet with RFID Systems, IEEE Pervasive Computing Mobile and Ubiquitous Systems, Volume 2, Number 1, April-June 2003

#500 Chang, W., AHG Report on MPEG-7 Interoperability and Profiling, ISO/MPEG M8784, MPEG Shanghai Meeting, October 2002

2002
#569 Robertson, S., and Soboroff, I., The TREC 2002 Filtering Track Report. Proceedings of the Eleventh Text REtrieval Conference (TREC 2002), NIST Special Publication 500-253. PDF Format.

#568 Soboroff, I., Does WT10g Look Like the Web? Proceedings of the 25th Annual International Conference on Research and Development in Information Retrieval (SIGIR 2002), Tampere, Finland, pp. 423-424. ACM Press: 2002. PDF Format.

#567 Chowdhury, A., and Soboroff, I., Automatic Evaluation of World Wide Web Searches. Proceedings of the 25th Annual International Conference on Research and Development in Information Retrieval (SIGIR 2002), Tampere, Finland, pp. 421-422. ACM Press: 2002. PDF Format.

#499 Russakoff, D., Herman, M, Head Tracking Using Stereo., Machine Vision and Applications, Vol. 13, No. 3, July 2002, 164-173.

#498 Herman, M., Have a problem with information overload now? Just wait a while. Government Computer News, Vol. 21, No. 32, November 4, 2002, p. 30.

#497 Harman, D., The Importance of Focused Evaluations: A Case Study of TREC and DUC Invited paper in the Proceeedings of the NTCIR Workshop on Chinese and Japanese Text Retrieval and Text Summarization.

#496 Ressler, S., Wang, Q.,A Web3D Based CAESAR Viewer in Proceedings of CARS 2002 - H.U. Lemke, M.W. Vannier; K. Inamura, A.G. Farman, K. Doi & J.H.C. Reiber (Editors) CARS/Springer.

#495 Over, P., Harman, D., The DUC Summarization Evaluations Proceedings of the International Conference on Human Language Technology, San Diego, California, March, 2002.

#494 Smeaton, A., Over, P., et. al. The TREC 2001 Video Track: Information Retrieval on Digital Video Information Proceedings of 6th European Conference on Digital Libraries Rome, Italy, Sept. 2002.

#493 Soboroff, I., Nicholas, C.,Related, but not Relevant: Content-based Collaborative Filtering in TREC-8 Information Retrieval, 5:2/3, Apr-Jul 2002, pp. 189-208.

#492 Scholtz, J., Wischanksy, A., Butler, K., Emile Morse, E., Laskowski, S., Quantifying Usability: The Industry Usability Reporting Project in proceedings of the Human Factors Conference (HFES2002), September 30-October 4, 2002 in Baltimore, Maryland.

#491 Scholtz, J., Theory and Evaluation of Human-Robot Interaction Hawaii International Conference on System Science (HICSS) Waikoloa, Hawaiian 6-9, 2003

#490 Scholtz, J., Human-Robot Interaction: Creating Synergistic Cyber Forces Multi-robot systems: From Swarms to Intelligent Automata, Proceedings from the 2002 NRL workshop on Multi-robot systems

#489 Scholtz, J., Evaluation Methods for Human-System Performance of Intelligent Systems , PerMIS 02, NIST, Gaithersburg, MD August 13-15, 2002.

#488 Smeaton, A., Over, P., et al, TREC-2001 Video Track Report in NIST Special Publication proceedings for TREC 10, Gaithersburg, MD .

#487 Scholtz, J., Morse, E., A New Usability Standard and What It Means to You, SIGCHI bulletin, May/June 2002

#486 Scholtz, J., Government Roles in HCI, in The Human-Computer Interaction Handbook, Julie Jacko and Andrew Sears (Eds.), Lawrence Erlbaum Associates, Published 2002

#485 Voorhees, E., Buckley, C., The Effect of Topic Set Size on Retrieval Experiment Error, Proceedings of SIGIR 2002, August 11-15, 2002, Tampere, Finland.

#484 Voorhees, E., The Evaluation of Question Answering Systems: Lessons Learned from the TREC QA Track, Proceedings of the LREC 2002 Workshop on Question Answering---Strategy and Resources, May, 2002, Las Palmas de Gran Canaria, Spain.

#483 Voorhees, E., The Philosophy of Information Retrieval Evaluation, Proceedings of the 2nd Workshop of the Cross-Language Evaluation Forum, Springer-Verlag Lecture Notes in Computer Science #2406.

#482 Stanford, V., Using Pervasive Computing to Deliver Eldercare, IEEE Pervasive Computing Mobile and Ubiquitous Systems, Volume 1, Number 1, January-March 2002

#481 Stanford, V., Pervasive Health Care Applications Face Tough Security Challenges, IEEE Pervasive Computing Mobile and Ubiquitous Systems, Volume 1, Number 2, April-June 2002

#480 Stanford, V., Pervasive Computing Goes to Work - Interfacing to the Enterprise,IEEE Pervasive Computing Mobile and Ubiquitous Systems, Volume 1, Number 3, July-August 2002

#479 Stanford, V., Wearable Computing Goes Live in Industry, IEEE Pervasive Computing Mobile and Ubiquitous Systems, Volume 1, Number 4, July-August 2002

#478 Herman, M., Stanford, V., Pervasive Computing; It's About Integration, Appliance Manufacturer Magazine, September 2001

#477 Stanford, V., Kasianowicz, J., On the Use of HMMs to Quantify Signatures from Individual DNA Molecules Driven Through a Nanometer Scale Pore, 2003 IEEE Genomic Signal Processing and Statistics Conference.

#476 Stanford, V., Physics of DNA Threading Through a Nanometer Pore and Applications to Simultaneous Multianalyte Sensing, Chapter in Structure and Dynamics of Confined Polymers, Kluwer 2002, with John Kasianowicz, et. al.

#475 Morse, E., Rapid, Remote, Automated Card Sorting using WebCAT. Proceedings of the Usability Professionals Association Annual Conference. Orlando, FL, July 2002.

#474 Laskowski, S. and Morse, E., The Common Industry Format (CIF) is Now an ANSI/INCITS Standard Proceedings of the Usability Professionals Association Annual Conference. Orlando, FL, July 2002.

#473 Scholtz, J. and Morse, E., A Standard Reporting Format for Summative Usability Evaluations. Interactions 2002.

#472 Chang, W., + other authors MPEG-7 Systems and Application, on Elsevier Science Press (to be published)

#471 Chang, W., Approach to Develop Formal Representation for MPEG-7 Profiles ISO/IEC m9269, Dec. 2002

#470 Chang, W., Comments about Definition of MPEG-7 Description Profiling, ISO/IEC m9268, Dec. 2002

#469 Chang, W., MPEG-7 Profiles and Levels Signaling, ISO/IEC m9132, Dec. 2002

#468 Chang, W., MPEG-7 Profiles & Levels Schema Verification and Test Cases , ISO/IEC m8919, Oct. 2002

#467 Chang, W., MPEG-7 Profile Schema Supporting Tools, , ISO/IEC m8918, Oct. 2002

#466 Chang, W., Proposal for MPEG-7 Profiles and Levels Definition and Rules, ISO/IEC m8917, Oct. 2002

#465 Chang, W., MPEG-7 Profile Scenario Case Study , ISO/IEC m8916, Oct. 2002

#464 Chang, W., How to Specify MPEG-7 Profile Schema from Instance Documents , ISO/IEC m8833, Oct. 2002

#463 Chang, W., The Overview Approach for Defining MPEG-7 Profiling , ISO/IEC m8813, Oct. 2002

#462 Przybocki, M., Martin, A.,NIST's Assessment of Text Independent Speaker Recognition Performance in the proceedings of the Cost 275 Workshop, The Advent of Biometrics on the Internet, pp 25-35, Rome, Italy on November 7-8, 2002.

#461 Voorhees, E., Harman, D., Overview of TREC 2001 in NIST Special Publication proceedings for TREC 10, Gaithersburg, MD . #460 Morse, E., Lewis, M., and Olsen, K.A., Testing Visual Information Retrieval Methodologies Case Study: Comparative Analysis of Textual, Icon, Graphical, and 'Spring' Displays. JASIST 53(1): 28-40, 2002.

#459 McCabe, M., Fingerprint Interoperability Standards a Book Chapter in Advances in Fingerprint Recognition, Publisher:Springer, Spring 2003

#458 Watson, C.I., Casasent, D.P., Fingerprint Matching Using Distortion Tolerant Filters Chapter in book titled Advances in Fingerprint Recognition to be published.

#457 Rukhin, A., Grother, P., Phillips, P. J., Leigh, S., Heckert, A., Newton , E., Dependence Characteristics of Face Recognition Algorithms proceedings of the 16 th International Conference on Pattern Recognition (ICPR'02) Volume 2, August 11 - 15, 2002 Quebec City, QC, Canada

#456 Leigh, S., Phillips, P.J., Grother, P., Heckert, A., Moody, M., Kniskern, K., Heath, S., Rukhin, A.L, Newton, E., Transformation, Ranking, and Clustering for Face Recognition Algorithm Comparison, in proceedings of the Third Workshop on Automatic Identification Advanced Technologies (AUTO-ID), March 14-15, 2002, Tarrytown, NY

#455 Phillips, P.J., Sarkar, S., Robledo, I., Grother, P., Bowyer, K., The Gait Identification Challenge Problem: Data Sets and Baseline Algorithm in proceedings at the 16th International Conference on Pattern Recognition (ICPR), Aug 2002.

#454 Alemayehu, N.Analysis of performance variation using query expansion. , Journal of the American Society for Information Science and Technology, Society for Information Science and Technology 54(5):379-391.

#453 Robertson, Soboroff, I ., The TREC 2001 Filtering Track Report., in NIST Special Publication proceedings for TREC 10, Gaithersburg, MD .

#452 Phillips, P.J., Sarkar, S., Robledo, I., Grother, P., Bowyer, K., Baseline Results for the Challenge Problem of Human ID Using Gait Analysis , in proceedings at the 5th International Conference on Automatic Face and Gesture Recognition (FG), May 2002.

#451 Chang. W., MPEG-7 Profile Schemas for Profiles under Consideration, ISO/IEC m9127, Dec. 2002

#450 Chang. W., AHG on MPEG-7 Interoperability and Profiling, ISO/IEC m9096, Dec. 2002

#449 Voorhees, E., Overview of the TREC 2001 Question Answering Track, in NIST Special Publication proceedings for TREC 10, Gaithersburg, MD .

#448 Hersh,W., Over, P., TREC 2001 Interactive Track Report, in NIST Special Publication proceedings for TREC 10, Gaithersburg, MD .

#447 Chang., W. AHG on MPEG-7 Interoperability and Profiling , ISO/IEC m8784, Oct. 2002

#446 Morse, E., Designing Evaluations Not Just Interfaces , DLIB Magazine, September 2002.

#445 Sanders, G. A., Le, A. N., and Garofolo, J. S. (2002).Effects of Word Error Rate in the DARPA Communicator Data During 2000 and 2001. ICSLP-2002, 7th International Conference on Spoken Language Processing (September 16-20, 2002). Denver, Colorado: International Speech Communication Association, pp. 277-280.

2001
#444 Voorhees,E., Harman D., Overview of the Ninth Text Retrieval Conference (TREC-9), TREC-9 Proceedings NIST Special Publication 500-249, Oct. 2001.

#443 Voorhees, E., Overview of the TREC-9 Question Answering Track TREC-9 Proceedings, NIST Special Publication 500-249, Oct. 2001.

#442 Voorhees, E., The TREC Question Answering Track,Journal of Natural Language Engineering, December 2001.

#441 Voorhees, E., Question Answering in TREC,in proceedings of the ACM 2001 Tenth International Conference on Information and Knowledge Management, Nov. 2001.

#440 Voorhees, E., Evaluation by Highly Relevant Documents, Proceedings of the 24 Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Sept. 2001.

#439 Garris, M. D., Watson,C.I., McCabe, R.M, Wilson, C.I., User's Guide to NIST Fingerprint Image Software (NFIS), NISTIR 6813, November 2001.

#438 Garris, M.D., Recommendation for Interstate Criminal History Transmission Specification, NISTIR 6820, November 2001

#437 Cugini J., FORTRAN Test Programs ,contribution to NBS Special Publication 958, A Century of Excellence in Measurement, Standards, and Technology (pp. 258 ff), David Lide, editor, January 2001.

#436 Cugini, J., The FLUD format: Logging Usability Data from Web-based Applications, NIST Special Publication 500-247, January 2001.

#435 Cugini, J., Design of a File Format for Logging Website Interaction, NIST Special Publication 500-248, April 2001.

#434 Fiscus, J., Doddington, G., Topic Detection and Tracking Evaluation Overview, chapter in book entitled, Topic Detection and Tracking: Event-Based Information Organization, Editors: James Allan, Jaime Carbonell, Jonathan Yamron.

#433 Ressler, S., Antonishek, B., Wang, Q., Godil, A., Integrating Active Tangible Devices with a Synthetic Environment for Collaborative Engineering, in the proceedings of Web3D 2001 Symposium, Paderborn Germany, Feb. 2001.

#432 Badre., A., Laskowski, S., The Cultural Context of Web Genres: Content vs. Style,7th Conference on Human Factors and the Web, HFWeb 2001.

#431 Hogan, M.D., Carnahan, L.J., Carpenter, R.J., Flater, D.W., Fowler, J.E., Frechette, S.P., Gray, M.M., Johnson, A., McCabe, R.M., Montgomery, D., Radack, S.M., Rosenthal, R., Shakarji, C.M.Information Technology Measurement and Testing Activities at NIST , Journal of Research of the NIST, vol. 106, no. 1, January-February 2001, pp. 341-370.

#430 Grother, P., Casasent, D. Optical Path Difference Measurement Techniques for SLMs, Optics Communications Vol. 189, pages 31-38, March 2001.

#429 Scholtz, J, Adaptation of Traditional Usability Testing Methods for Remote testing, HICSS 34, in proceedings of the Hawaii International Conference on System Science, (IEEE Conference), January 2001.

#428 Scholtz, J., Situated Computing: The Next Frontier for HCI Research, with Kevin Mills, appears in HCI in the New Millennium, Addison- Wesley, July, 2001

#427 Garris, M.D., Watson, C.I., McCabe, R.M., Wilson, C.I.User's Guide to NIST Fingerprint Image Software (NFIS), NISTIR 6813, November 2001.

#426 Watson, C.I. NIST Special Database 29 - Plain and Rolled Images from Paired Fingerprint Cards NISTIR 6801, November 2001.

#425 Watson, C.I., NIST Special Database 30 - Dual Resolution Images from Paired Fingerprint Cards, NISTIR 6800, December 2001.

#424 Grother, P., Casasent, D., Modulation transfer function measurement method for electrically addressed spatial light modulators, Applied Optics, Vol. 40 No. 29, 10 October 2001

#423 Phillips, P.J., Newton, Meta-analysis applied to face recognition, Proceedings of the Third Workshop on Empirical Evaluation Methods in Computer Vision, Kauai, Hawaii, 2001.

#422 Moon, H., Phillips, P.J.Computational and performance aspects of PCA-based face recognition algorithms (2001). Perception, 30, 301-321.

#421 Martin, A., F., Przybocki, M., A.; The NIST Speaker Recognition evaluations: 1996-2001 Proceedings of the 2001: A Speaker Odysey, A Speaker Recognition Workshop Keywords: speaker verification, performance evaluation, speaker detection, speaker recognition. .

#420 Przybocki, M., A.; Martin, A., F., Odyssey Text Independent Evaluation Data Proceedings of the 2001: A Speaker Odysey, A Speaker Recognition Workshop Keywords: evaluation corpora, performance evaluation, speaker detection, speaker recognition, text independent data..

#419 Martin, A., F.; Przybocki, M., A., Speaker Recognition in a Multi-Speaker Environment Proceedings of the 7th European Conference on Speech Communications and Technology, Eurospeech 2001, Keywords: detection cost, speaker identification, speaker segmentation, speaker tracking, performance evaluation..

#341 Scholtz, J., (2001), Evaluation Methodologies: A Framework for collaboration between HCI Research and Practice, NOT PUBLISED YET, Keywords: HCI funding, HCI practice, HCI research, information exchange.

#348 Ressler, Sandy, (2001), A Web-based 3D Glossary for Anthropometic Landmarks, will appear in the proceedings of the HCI International 2001, New Orleans, LA, August 5-10, 2001, Keywords: arm reach volume, Frankfort plane, SAE G3, viewpoints, VRML browsers, web3d.

2000
#411 Over, P., The TREC Interactive Track; An Annotated Bibliography, Information Processing and Management 37 (2001), 369-381, Keywords: Information retrieval, TREC, Interactive.

#412 Morse, E. L., Steves, M. P., A Visualization Approach to Dealing with Log Data, Published on website of the Workshop on Data Log Mining of the Computer Supported Cooperative Work Conference

#413 McCabe, R., Data Format for the Interchange of Fingerprint, Facial, and Scar mark and Tattoo Information (ANSI/NIST/ITL 1 2000), NIST Special Publication 500-245 #414 Moon, H., Phillips, J. P., Computational and Performance Aspects of PCA-Based face Recognition Algorithm, NISTIR 6486, March 8, 2000 and to be published in Perception

#415 Zhao, W., Chellappa, R., Phillips, J. P., Subspace Linear Discriminant Analysis for Face Recognition, IEEE TransImage Processing (2000)

#416 Garris, M. D., McCabe,R. M., NIST Special Databasel 27, Fingerprint Minutiae from Latent and Matching Tenprint Images, NISTIR 6534, Gaithersburg, Maryland

#417 Grother, P., Casasent, D., Optical Path Difference Measurement Techniques for SLMs, Optics Communication, August 2000

#418 Grother, P., Casasent, D., New MTE Measurement Method for Electrically-addressed SLMs, to be published in Applied Optics

#388 Scholtz, J., (2000), Adaptation of Traditional Usability Testing Methods for Remote testing, Will be in proceedings of the Hawaii International Conference on System Science, HICSS 34, Keywords: Remote evaluation, usability, web site design.

#399 Hawkings, D., Voorhees, E., Craswell, N., Bailey, P., (2000), Overview of the TREC-8 Web Track, In proceedings NIST Special Publication 500 246:The Eighth Text REtrieval Conference(TREC 8), pgs 131-150. Keywords: #400 Hersh, W., Over, P. D., (2000), TREC-8 Interactive Track Report, In proceedings NIST Special Publication 500-246: The Eighth Text REtrieval Conference(TREC 8), pg 57-64. Keywords:

#401 Voorhees, Harman, D., (2000), Overview of the Eighth Text Retrieval Conference (TREC-8), In proceedings NIST Special Publication 500-246: The Eighth Text REtrieval Conference(TREC 8), pgs 1-24. Keywords:

#277 Buckley, C. & Voorhees, E. (2000, July). Evaluating Evaluation Measure Stability. In Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Athens, Greece, pp. 33-40.

#276 Voorhees, E. & Tice, D. (2000, July). Building a Question Answering Test Collection. In Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Athens, Greece, pp. 200-207.

#292 Martin, A., Przbocki, M., Doddington, G., Reynolds, D., (2000). The NIST Speaker Recognition Evaluation - Overview, methodology, systems, results, perspectives (1998). Speech Communications 31 (2000) pages 225-254 (as submitted for publication) PDF Format

#293 Bird, S., Day, D., Garofolo, J., Henderson, J., Laprun, C., Liberman, M., (2000) ATLAS: A flexible and extensible architecture for linguistic annotation. In proceedings of the LREC Second International Conference on Language Resources and Evaluation 2000, Athens, Greece

#275 Voorhees, E. & Tice, D. (2000, May/June). The TREC-8 Question Answering Track. In proceedings of Language Resources and Evaluation Conference, Athens Greece.

#274 Voorhees, E. & Tice, D. (2000, May). Implementing a Question Answering Evaluation. In proceedings of "Using Evaluation Within HLT Programs: Results and Trends", a workshop of the Second International Conference on Language Resources and Evaluation, Athens, Greece.

#273 Kantor, P. & Voorhees, E. (2000) The TREC-5 Confusion Track: Comparing Retrieval Methods for Scanned Text. Information Retrieval, 2(2/3), 165-176.

#396 Scholtz, J., (2000), The IUSR Project: Industry Usability Report, In proceedings of the Make it Easy 2000 Conference, may 18-19, 2000 , Keywords: Procurement, software, standard report format, total-cost-of-ownership, usability.

#272 Voorhees, E. & Harman, D. (2000). Overview of the Sixth Text REtrieval Conference. Information Processing and Management, 36(1), 3-35.

#293 Martin, A., Przbocki, M., The NIST 1999 Speaker Recognition Evaluation - An Overview. Digital Signal Processing Volume #10 1-3, Jan/Apr/Jul 2000 pages 1-18 PDF Format

#348 Phillips, J. P., Martin, A., Wilson, C. L., Pryzbocki, M., (2000, February). An Introduction to Evaluating Biometric Systems, ,IEEE Computer, February 2000. (PDF format)

# 235 J. Cugini, "Presenting Search Results: Design, Visualization, and Evaluation", Proceedings of the Information Doors -- Where Information Search and Hypertext Link workshop, May 30, 2000, San Antonio, Texas (held in conjunction with the ACM Hypertext and Digital Libraries conferences).. Keywords: search engine, user interface, visualization, search results, information retrieval, usability evaluation.

#397 Scholtz, J., Mills, K. L., Workshop on Intelligent Environments, In October 2000 issue, IEEE Personal Communications Magazine, Keywords: pervasive computing, smart spaces, smart environments, ubiquitous computing.

#371 J. Cugini, (2000), "Web Usability Logging: Tools and Formats", presented to the Tools to Support Faster and Better Usability Engineering workshop, August 15, 2000, Asheville, NC (held in conjunction with the UPA 2000 conference). Keywords: usability, logfiles, logging, remote testing.

# 369 Morse, E. L., Steves, M. P., (2000, June), CollaLogger: A Tool for Visualizing Groups at Work, In proceedings of the IEEE 9th International Workshop on Enabling Technologies; Infrastructure Collaborative Enterprises, WETICE, pgs 104-109, June 14-16, 2000. Keywords: collaboration environments, exploratory sequential data analysis, software usability, visualization.

# 327 Morse, E. L., (2000), The IUSR Project and the Common Industry Reporting Format, In proceedings for the Conference on Universal Usability, November 15, 2000. Keywords: CIF, Common Industry Format, IUSR, procurement, software usability, usability testing.

# 332 J. Cugini, S. Laskowski, M. Sebrechts, (2000) Design of 3D Visualization of Search Results: Evolution and Evaluation, Proceedings of IST/SPIE's 12th Annual International Symposium: Electronic Imaging 2000: Visual Data Exploration and Analysis VII, SPIE 2000, pp. 198-210, San Jose, CA, 23-28 January 2000. Keywords: comparision of 3D and 2D, design of visualization, evaluation of visualization, information visualization, usability experiment.

#409 Watson, Grother, P.J., Casasent, D.P., Distortion-tolerant filter for elastic-distorted Fingerprint Matching, NIST Interagency Report 6489, National Institute of Standards and Technology, Gaithersburg, Maryland, 2000.

1999
#407 Garris, M.D., (1999, January). NIST Internal Report 6231 - Document Image Recognition and Retrieval: Where are We?", , and in proceedings of Document Recognition and Retrieval VI, SPIE volume 3651, p. 141 - 144, San Jose, January 1999. Keywords: document image recognition information retrieval.

#403 Voorhees, E., Harman, D.,(1999), Overview of the Seventh Text retrieval Conference, In proceedings NIST Special Publication 500-242: The Seventh Text REtrieval Conference(TREC 7), pgs 1-24. Keywords:

#419 Hawking, D., Thistlewaite, P., Harman, D.,(1999), Scaling Up the TREC Collection Information Retrieval, Vol. 1, Nos. 1/2, 1999, pp. 115-137. Keywords: test collection, very large databases, text retrieval.

#420 Banks, D., Over, P., Zhang, N-F., (1999), Blind Men and Elephants: Six approaches to TREC data Information Retrieval, Vol. 1, Nos. 1/2, 1999, pp. 7-34. Keywords: cluster analysis, multidimensional scaling, rank correlation.

#404 Over, P., (1999), TREC-7 Interactive Track Report, In proceedings NIST Special Publication 500-242: The Seventh Text REtrieval Conference(TREC 7), pgs 65-72. Keywords:

#271 Voorhees, E. (1999). Natural Language Processing and Information Retrieval. In M. T. Pazienza, (Ed.), Information Extraction: Towards Scalable, Adaptable Systems (pp.32-48). Germany: Springer. (Entry in lecture notes in artificial intelligence 1714)

#270 Schmidt, C. & Over, P. (1999, August). Digital Video Test Collection. In proceedings of the Twenty-Second Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Berkeley, California, USA.

# 345 J. Cugini and J. Scholtz, VISVIP: 3D Visualization of Paths through Web Sites, Proceedings of the International Workshop on Web-Based Information Visualization(WebVis'99), pp. 259-263, (in conjunction with DEXA'99, Tenth International Workshop on Database and Expert Systems Applications, eds A.M. Tjoa, A. Cammelli, R.R. Wagner) Florence, Italy, September 1-3, 1999, IEEE Computer Society. Keywords: 3D visualization, usability experiment, website development, website testing.

# 318 Damianos, L., Hirschman, L., Kozierok, R., Kurtz, J., Greenberg, A.., Holgado, R., Walls, K., Laskowski, S., Scholtz, J., (1999). Evaluation for Collaborative Systems, appeared in ACM Computing Surveys , vol. 31, no. 2es, June 1999. Keywords: case studies, computer supported cooperative work, evaluation, measures, metrics, scenario-based evaluation.

#346 M. Sebrechts, J. Vasilakis, M. Miller, J. Cugini, S. Laskowski, (1999). Visualization of Search Results: A Comparative Evaluation of Text, 2D, and 3D Interfaces , Proceedings of SIGIR'99, pp. 3-10, eds. M. Hearst, F. Gey, and R. Tong, 22nd International Conference on Research and Development in Information Retrieval, Berkeley, California, August 1999. Keywords: 3D user interface, evaluation, information retrieval, information visualization, search results.

#269 Schmidt, C. & Harman, D. (1999, August). Information Retrieval Library (IRLIB). In proceedings of the Twenty-Second Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Berkeley, California, USA.

#268 Tebbutt, J. (1999).User Evaluation of Automatically Generated Semantic Hypertext Links in a Heavily Used Procedural Manual. Information Processing and Management, 35(1), 1-18.

#267 Downey, L. & Tice, D. (1999). A Usability Case Study Using TREC and ZPRISE. Information Processing and Management, 35(5), 589-603.

#290 Martin, A., Przbocki, M., Doddington, G., Reynolds, D., (1999). The NIST 1998 Development Evaluation of Speaker Recognition on Multi-Speaker Telephone Channels In proceedings of The Audio-and Video-based Biometric Person Authentication Conference, Washington, DC. PDF Format

#291 Martin, A., Przbocki, M., (1999). The 1999 NIST Speaker Recognition Evaluation, Using Summed Two-Channel Telephone Data for Speaker Detection and Speaker Tracking In proceedings of EuroSpeech 1999, Volume #5, pgs 2215-2218

#384 Hsieh, M. L., Paek, E. G., Wilson, C. L., Hsu, K. Y., (1999, December). Performance Enhancement of a Joint Transform Correlator Using the Directionality of a Spatial Light Modulator. Optical Engineering , 38(12) pages 2118-2121, December 1999.

#266 Tebbutt, J. (1999). NIST Interagency Report 6321: The NIST LEIDER Prototype - Inserting Hypertext Links into the POMS Using Information Retrieval. Installation Guide, User Guide and Software Documentation. Gaithersburg, Maryland, USA: National Institute of Standards and Technology.

#347 Wilson, C. L., McCabe, R. M., (1999, May). NIST Interagency Report 6336 - Simple Test Procedure for Image-Based Biometric Verification Systems, May 1999, Gaithersburg, Maryland: National Institute of Standards and Technology.

#350 ANSI/NIST-ITL 1-1999 - PROPOSED DRAFT . American National Standard For Information Systems- Data Format for the Interchange of Fingerprint, Facial, and Scar Mark and Tattoo (SMT) Information .( This is in PDF Format). This is a Revision of ANSI/NIST-CSL 1-1993 and ANSI/NIST-ITL 1a-1997 (NIST Interagency Report 6011) ( In PFD format) or Postscript format.

#351 Phillips, J. P., (1999). Support Vector Machines Applied to Face Recognition NIST Interagency Report 6241 , November 1999 and In Advances in Neural Information Processing Systems 11, MIT Press, pp. 803-809, 1999.

#354 Rubinfeld, M., Wilson, C. L., (1999, June). NIST Interagency Report 6322 - Gray Calibration of Digital Cameras to Meet NIST Best Practice Recommendation, June 1999, Gaithersburg, Maryland: National Institute of Standards and Technology.

#355 Phillips, J. P., O'Toole, A. J., Cheng, Y., Ross, B., Wild, H. A.,(1999, June). NIST Interagency Report 6348 - Assessing Algorithms as Computational Models for Human Face Recognition, June 1999, Gaithersburg, Maryland: National Institute of Standards and Technology.

#393 Downey, L. L., Scholtz, J., , On the Fast Track: new Usability testing Methods for Web Sites, NOT PUBLISHED, Keywords: remote usability testing, usability testing, web development, web site evaluation.

#394 Scholtz, J., (1999), A Case Study: Developing a Remote, Rapid, and Automated Usability Testing Methodology for On-line Books In proceedings of the Hawaii International Conference on System Science, HICSS 32, Keywords: online books, navigation, usability testing, web-based documentation.

#395 Scholtz, J., (1999), WEB Usability, the Search for a Yardstick, In proceedings of the 3rd Conference on Human-factors and the Web, 1999, Keywords: human-computer interation, usability, web design, web evaluation.

# 326 Sheppard, C., Scholtz, J., (1999, June). The Effects of Cultural Markers on Web Site Use, In proceedings of the 5th Conference on Human Factors and the Web, Gaithersburg, Maryland, July 5, 1999. Keywords: cultural markers, usability, user performance, user preference, user satisfaction, web sites. #392 Scholtz, J. C., Graphical User Interfaces, John C. Webster (Ed.), Encyclopedia of Electrical and Electronics Engineering. Published by John Wiley. Keywords: bitmapped displays, direct manipulation, usability testing, user interface architecture, user interface toolkits, window management systems.

#408 Watson, C.I., Wilson, C.L., Paek, E.G., Grother, P.J., Composite Filter for LanderLugt Correlator, NIST Interagency Report 6291, National Institute of Standards and Technology, Gaithersburg, Maryland, 1999.

1998
#398 Scholtz, J., (1998), Kiosk-Based User Testing of Online books, In proceedings of the Sixteenth Annual International Conference on Computer Documentation, September 1998, pgs 80-86. Keywords: Usability testing, kiosk-based testing, online books, web-based documentation, navigation.

#265 Lagergren, E., & Over, P. (1998, August). Comparing Interactive Information Retrieval Systems Across Sites: the TREC-6 Interactive Track Matrix Experiment. In proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Melbourne, Australia.

#264 Voorhees, E. (1998, August). Variations in Relevance Judgements in the Measurement of Retrieval Effectiveness. In proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Melbourne, Australia.

#383 Wilson, C. L., Watson, C.I. , Paek, E. G., (1998, July). NIST Interagency Report 6184 - Effect of Resolution and Image Quality on Combined Optical and Neural Network Fingerprint Matching. Gaithersburg, Maryland: National Institute of Standards and Technology.

#294 Garris, M. D., Klein, W.W., (1998, January). NIST Interagency Report 6090 - Creating and Validating a Large Image Database for METTREC,Gaithersburg, Maryland: National Institute of Standards and Technology.

#295 Garris, M. D., Klein, W.W., Janet, S., (1998, January). NIST Interagency Report 6101 - Impact of Image Quality in Machine Print Optical Character Recognition, Gaithersburg, Maryland: National Institute of Standards and Technology.

#263 Towell, G. & Voorhees, E. (1998). Disambiguating Highly Ambiguous Text. Computational Linguistics, 24(1), 125-145.

#262 Harman, D. (1998, June). The Text REtrieval Conferences (TRECs) and the Cross-Language Track. In proceedings of the First International Conference on Language Resources and Evaluation, Granada, Spain.

#261 Tebbutt, J. (1998, June). Finding Links. In proceedings of the Ninth ACM Conference on Hypertext and Hypermedia, Pittsburgh, Pennsylvania, USA.

#260 Dimmick, D., O'Brien, G., Over, P., & Rogers, W. (1998). Guide to Z39.50/Prise 2.0: Its Installation, Use, & Modification. Gaithersburg, Maryland, USA: unpublished resource.

#259 Harman, D. (1998). The Text Retrieval Conferences. Bulletin of the American Society for Information Retrieval, vol#(iss#), pps.

#257 Voorhees, E. (1998). Using WordNet for Text Retrieval. In C. Fellbaum, (Ed.), WordNet: An Electronic Lexical Database (pp.285-303). Cambridge, Massachusetts, USA: The MIT Press.

#382 Paek, E. G., Wilson, C. L., Roberts, J. W., Watson, C.I. , (1998, January). High-speed Temporal Characterization and Visualization of Spatial Light Modulators and Flat-panel Displays. Optics Letter, Volume 23, No. 7, pages 546-548, April 1, 1998 and NIST Interagency Report 6108 January 1998, Gaithersburg, Maryland: National Institute of Standards and Technology.

Figures for paper: figure 1 figure 2 figure 3

#339 Garris, M. D., Janet, S., Klein, W.W.,(1998, December). NIST Interagency Report 6245- NIST Special Database 25 Volume 1- Federal Register Document Image Database,, December 1998.

#352 Phillips, J. P., Moon, H., Rizvi, S.A., Rauss,P. J., (1998, October). NIST Interagency Report 6264 - The FERET Evaluation Methodology for Face-Recognition Algorithms , October 1998, Gaithersburg, Maryland: National Institute of Standards and Technology.

#353 Phillips, J. P., Moon, H., and Razvi, S. A., (1998, October) NIST Interagency Report 6281 - The FERET Verification Testing Protocol for Face Recognition Algorithms, October 1998, Gaithersburg, Maryland: National Institute of Standards and Technology.

#379 Garris, M. D., Wilson, C. L., Blue, J. (1998). Neural Network-Based Systems for Handprint OCR Applications, IEEE Trans. on Image Processing, Vol. 7, pages 1097-1112, 1998.

Paper figures: 1 , 2, 3, 4, 5, 6, 7, 8 .

Paper tables: 1, 2

#389 Scholtz, J., (1998), WebMetrics: A Methodology for Producing Usable Web Sites, In proceeding for the Human Factors and Ergonomics Society Conference, 1998, Keywords: Usability testing, web design, web sites, web applications, evaluation.

#390 Steves, M. P., Scholtz, J., (1998), Modified Field Studies for CSCW Sytems, In SG Group Bulletin, Keywords: Collaboration technologies, Computer Supported Cooperative Work (CSCW), data visualizations, deployment techniques, evaluation methodologies.

#387 Scholtz, J., Laskowski, S. J., Downey, L., (1998), Developing Usability Tools and Techniques for Designing and Testing Web Sites, In proceedings for the HF & Web Conference, 1998, Keywords: remote usability testing, usabilitiy testing, web development, web site design, web site evaluation.

#406 Garris, M. D., (1998). Intelligent System for Reading Handwriting on Forms, In proceedings of the Thirty-First Annual Hawaii International Conference on System Sciences, Vol. III Emerging Techologies Track, pp. 233-242, 1998. Keywords:

1997
#256 Garris, M., Omidvar, O., Blue, J., Candela, G., Dimmick, D., Geist, J., Grother, P., Janet, S., & Wilson, C. (1997). Design of a Handprint Recognition System. Journal of Electronic Imaging, 6(2), 231-243.

#360 Wilson, C. L., A New Self-Organizing Neural Network Architecture for Parallel Multi-Map Pattern Recognition - FAUST, published in Progress in Neural Networks, Volume 5: Architecture, 1997.

# 319 Downey, L. L., Laskowski, S. J., (1997, July). NIST Special Publication 500-237 - Symposium Transcription - Usability Engineering: Industry Government Collaboration for System Effectiveness and Efficiency, Gaithersburg, Maryland, National Institute of Standards and Technology. Keywords: usability engineering.

#402 Laskowski, S. J., Grinstein, G., (1997). Benchmarking the Integration of Visualization and data Mining. In proceedings of the Knowledge Discovery in Databases Conference Workshop on Issues in the Integration of data Mining and Data Visualization, August 17, 1997. Keywords: Benchmarks, data mining, data visualization, knowledge discovery.

#391 Laskowski, S. J., Downey, L. L., (1997). Evaluation in the Trenches: Towards Rapid Evaluation, In proceedings of the CHI'97 Workshop on Usability Testing of World Wide Web Sites. Keywords: world wide web sites, evaluation, usability.

#255 B. Fordham, (1997, August). Evolving Databases: An Application to Electronic Commerce. In proceedings of the International Database Engineering and Applications Symposium 1997, Montreal, Canada.

#254 Harman, D. (1997). Information Retrieval. In Encyclopedia of Computer Science, Fourth Edition (pp. 858-863), Anthony ralston, Edwin D. reilly, David Hemmendinger, Eds.

#253 Hoffman, D., & Downey, L. (1997, June). Lessons Learned in an Informal Usability Study. In proceedings of the 20th International ACM SIGIR Conference on Research & Development in Information Retrieval, Philadelphia, Pennsylvania, USA.

#252 Voorhees, E., & Tong, R. (1997, June). Multiple Search Engines in Database Merging. In proceedings of the 2nd ACM International Conference on Digital Libraries, Philadelphia, Pennsylvania, USA.

#251 Voorhees, E., & Harman, D. (1997, November). Overview of the Sixth Text REtrieval Conference (TREC-6). In proceedings of the Sixth Text REtrieval Conference (TREC-6), Gaithersburg, Maryland, USA.

#250 Harman, D. (1997). The SMART Lab Report -- The Early Cornell Years. SIGIR Forum, 31(1), 6-12.

#249 Downey, L., Laskowski, S., Buie, E., Hefley, W. (1997). Symposium Report - Usabilty Engineering 2: Measurement and Methods. Special Interest Group on Computer & Human Interaction (SIGCHI) Bulletin,

#248 Voorhees, E., Garofolo, J., & Sparck Jones, K. (1997, February). The TREC-6 Spoken Document Retrieval Track. In proceedings of the 1997 DARPA Speech Recognition Workshop, Chantilly, Virginia, USA.

#247 Garofolo, J., Voorhees, E., Stanford, V., & Sparck Jones, K. (1997, November). TREC-6 1997 Spoken Document Retrieval Task Overview and Results. In proceedings of the Sixth Text REtrieval Conference (TREC-6), Gaithersburg, Maryland, USA.

#246 Over, P. (1997, November). TREC-6 Interactive Track Report. In proceedings of the Sixth Text REtrieval Conference (TREC-6), Gaithersburg, Maryland, USA.

# 408 Wang, Q., Ressler, S. P., (1997). Translating IGRIP Workcells into VRML2, In proceedings of Deneb Robotics 1997 International Simulation Conference and NIST Interagency Report 6076. Keywords: Deneb IGRIP/TGRIP, manufacturing simulation, translator, VRML.

#288 Martin, A., Doddington, G., Kamm, T., Ordowski, M., Przybocki, M. (1997). The DET Curve in Assessment of Detection Task Performance. In the proceedings of the EuroSpeech 1997, Volume #4, Pages 1985-1898. MS Office 97 format

#289 Fiscus, J. (1997). A Post-Processing System to Yield Reduced Word Error rates: Recognizer Output Voting Error Reduction (ROVER) IEEE Workshop on Automatic Speech Recognition and Understanding 1997. MS Office 97 Format

#245 Voorhees, E., & Harman, D. (Eds.) (1997). NIST Special Publication 500-240: The Sixth Text REtrieval Conference (TREC-6). Gaithersburg, Maryland, USA: National Institute of Standards and Technology.

#377 Wilson, C. L., Blue,J., Omidvar, O.,(1997). Neurodynamics of Learning and Network Performance,, Journal of Electronic Imaging, Vol. 6, pages 379-385, 1997.

#373 Grother, P. J., Candela, G. T., Blue, J. L., (1997). Fast Implementation of Nearest Neighbor Classifiers, in Pattern Recognition Vol. 30, No. 3, pp. 459-465, 1997.

#378 Garris, M. D., Blue, J. L., Candela, G. T., Grother, P. J., Janet, S.,Wilson, C. L., 1997, January). NIST Form-Based Handprint Recognition System (Release 2.0), NIST Interagency Report 5959, January 1997, Gaithersburg, Maryland: National Institute of Standards and Technology.

#380 Wilson, C. L., Watson, C.I. , Paek, E. G., (1997). Combined Optical and Neural Network Fingerprint Matching. In proceedings Optical Pattern Recognition VIII, volume 3073, pages 373-382, SPIE, Orlando, Florida, April 1997 and NIST Interagency Report 5955 , January 1997, Gaithersburg, Maryland: National Institute of Standards and Technology.

#381 Casasent, D., Wilson, C. L., (1997, September). Optical Metrology for Industrialization of Optical Information Processing. Optical Pattern Recognition IX, SPIE, 3386, pages 2-13, Orlando, April 1998 and NIST Interagency Report 6060 , September 1997, Gaithersburg, Maryland: National Institute of Standards and Technology.

# 409 Moline, J., (1995). NIST Interagency Report 5740 - Virtual environments for Health Care, Gaithersburg, Maryland, National Institute of Standards and Technology.

1996
#244 Garris, M., & Dimmick, D. (1996). Form Design for High Accuracy Optical Character Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 18(6), 653-656.

338 J. Cugini, C. Piatko, S. Laskowski, (1996, November). Interactive 3D Visualization for Document Retrieval, Proceedings of the Workshop on New Paradigms in Information Visualization and Manipulation, ACM Conference on Information and Knowledge Management (CIKM '96), Rockville MD, November 1996.Keywords: 3d visualization, document retrieval, information retrieval, information visualization.

#243 Voorhees, E., & Harman, D. (November, 1996). Overview of the Fifth Text REtrieval Conference (TREC-5). In proceedings of the Fifth Text REtrieval Conference (TREC-5), Gaithersburg, Maryland, USA.

#242 Harman, D. (1996, August). Panel: Building and Using Test Collections. In proceedings of the 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Zurich, Switzerland, pp 335-337.

#241 Kantor, P., & Voorhees, E. (November, 1996). Report on the TREC-5 Confusion Track. In proceedings of the Fifth Text REtrieval Conference (TREC-5), Gaithersburg, Maryland, USA.

#240 Voorhees, E. (November, 1996). The TREC-5 Database Merging Track. In proceedings of the Fifth Text REtrieval Conference (TREC-5), Gaithersburg, Maryland, USA.

#239 Over, P. (1996, November). TREC-5 Interactive Track Report. In proceedings of the Fifth Text REtrieval Conference (TREC-5), Gaithersburg, Maryland, USA.

#238 Downey, L., Laskowski, S., Buie, E., Hartson, H. (1996). Usability Engineering: Industry-Government Collaboration for System Effectiveness and Efficiency. Special Interest Group on Computer & Human Interaction (SIGCHI) Bulletin, 28(4), 66-67.

#237 Voorhees, E., & Harman, D. (Eds.) (1996). NIST Special Publication 500-238: The Fifth Text REtrieval Conference (TREC-5). Gaithersburg, Maryland, USA: National Institute of Standards and Technology.

#335 Garris, M. D., Dimmick, D. L., (1996, June). Form Design for High Accuracy Optical Character Recognition published in IEEE Transaction on Pattern Analysis and Machine Intelligence, June 1996.

#336 Garris, M. D., (1996, May). NIST Interagency Report 5843 - Component-Based Handprint Segmentation Using Adaptive Writing Style Model , May 1996, Gaithersburg, Maryland: National Institute of Standards and Technology.

#337 Wilson, C. L., Geist, J., Garris, M. D., Chellappa, R., (1996, December). NIST Interagency Report 5932 - Design, Integration, and Evaluation of Form-Based Handprint and OCR Systems, December 1996, Gaithersburg, Maryland: National Institute of Standards and Technology.

#405 Garris, M. D., (1996, September). NIST Internal Report 5894 - Teaching Computers to Read Handprinted Paragraphs, , National Institute of Standards and Technology, Gaithersburg, MD. Keywords: connected components, dictionary-based correction, handprint, optical character recognition, probabilistic neural network, unconstrained paragraph

1995
#236 Harman, D. (1995). Lab Report Special Section: Natural Language Processing and Information Retrieval Group Information Access and User Interfaces Division, National Institute of Standards and Technology. SIGIR Forum, 29(2), 6-10.

#234 Harman, D. (1995, November). Overview of the Fourth Text REtrieval Conference (TREC-4). In proceedings of the Fourth Text REtrieval Conference (TREC-4), Gaithersburg, Maryland, USA.

#233 Rogers, W., Candela, G., Harman, D. (1995, April). Space and Time Improvements for Indexing in Information Retrieval. In proceedings of the Fourth Annual Symposium on Document Analysis and Information Retrieval (SDAIR '95), Las Vegas, Nevada, USA.

#232 Garris, M., Blue, J., Candela, G., Dimmick, D., Geist, J., Grother, P., Janet, S., & Wilson, C. (1995, February). Public Domain OCR. In proceedings of SPIE's Conference on Document Recognition Technologies, San Jose, CA, USA.

#231 Harman, D. (1995). The TREC Conferences. Keynote paper presented at the Hypertext-Information Retrieval Multimedia Conference, Konstanz, Germany, pp. 9-28.

#230 Harman, D. (Ed.) (1995). NIST Special Publication 500-236: The Fourth Text REtrieval Conference (TREC-4). Gaithersburg, Maryland, USA: National Institute of Standards and Technology.

#229 Over, P., Denenberg, R., Moen, W., & Stovel, L. (Eds.) (1995). NIST Special Publication 500-229: Z39.50 Implementation Experiences. Gaithersburg, Maryland, USA: National Institute of Standards and Technology.

#228 Tebbutt, J. (1995). NIST Special Publication 500-228: Guidelines for the Evaluation of X.500 Directory Products. Gaithersburg, Maryland, USA: National Institute of Standards and Technology.

#227 Olsen, K., & Tebbutt, J. (1995). NIST Special Publication 800-11: The Impact of the FCC's Open Network Architecture on NS/NP Telecommunications Security. Gaithersburg, Maryland, USA: National Institute of Standards and Technology.

#328 Garris, M. D., Blue, J. L., Candela, G. T., Dimmick, D. L., Geist, J., Grother, P. J., Janet, S., Wilson, C. L., (1995, February). Public Domain Optical Character Recognition SPIE, Document Recognition II, pp. 2-14, San Jose, February 1995.

#329 Garris, M. D., Blue, J. L., Candela, G. T., Dimmick, D. L., Geist, J., Grother, P. J., Janet, S., Wilson, C. L.,(1995, October). Off-line Handwriting Recognition from Forms , published in IEEE International Conference on Systems, Man, and Cybernetics, pp. 2783-2788, Vancouver, Oct. 1995.

#330 Wilson, C. L., Wilkinson, R. A., Garris, M. D., (1995). Self-Organizing Neural Network Character Recognition Using Adaptive Filtering and Feature Extraction, In Progress in Neural Networks, Volume 3, pages 295-313, 1995.

#331 Garris, M. D., (1995). Evaluating Spatial Correspondence of Zones in Document Recognition Systems published in IEEE International Confernce on Image Processing, Washington DC, 1995.

#333 Garris, M. D., Grother, P. J., (1995). Generalized Form Registration Using Structure-Based Techniques, published in Proceedings of 5th Symposium on Document Analysis and Information Retrieval, pp. 321-334, April 1996 and NIST Interagency Report 5726 , Nov. 1995, Gaithersburg, Maryland: National Institute of Standards and Technology.

#334 Garris, M. D., (1995). Method and Evaluation of Character Stroke Preservation on Handprint Recognition, NIST Interagency Report 5687 , July 13 1995 and published in SPIE, Document Recognition III, pp. 321-332, San Jose, January 1996.

#374 Candela, G. T., Grother, P. J., Watson, C.I. , Wilkinson, R. A., Wilson, C. L., (1995). PCASYS - A Pattern-level Classification Automation System for Fingerprints , NIST Interagency Report 5647 April 1995, Gaithersburg, Maryland: National Institute of Standards and Technology.

#375 Wilson, C. L., Blue, J. L., Omidvar, O. M., 1995. Improving Neural Network Performance for Character and Fingerprint Classification by Altering Network Dynamics, published in World Congress on Neural Networks Proceedings, II, pgs. 151-158, July '95, Washington, DC., and NIST Interagency Report 5695, July 1995, Gaithersburg, Maryland: National Institute of Standards and Technology.

#376 Wilson, C. L., Blue, J. L., Omidvar, O. M., (1995). Training Dynamics and Neural Network Performance, published in Neural Networks Vol. 10, No. 5, pp 907-923, 1997, and NIST Interagency Report 5696 , July, 1995, Gaithersburg, Maryland: National Institute of Standards and Technology.

1994
#226 Harman, D. (1994, October). Analysis of Data from the Second Text REtrieval Conference (TREC-2). In proceedings of the Intelligent Multimedia Information Retrieval Systems and Management Conference (RIAO '94) at Rockefeller University, New York, New York, USA.

#225 Harman, D. (1993, September). Document Detection Data Preparation. In proceedings of the TIPSTER Text Program Phase I, San Mateo, California, USA.

#224 Harman, D. (1993, September). Document Detection: Summary of Results. In proceedings of the TIPSTER Text Program Phase I, San Mateo, California, USA.

#410 Harman, D. (1993, September). Document Detection: Overview. In proceedings of the TIPSTER Text Program Phase I, San Mateo, California, USA.

#385 Janet, S. A.,(1994, October) NIST Interagency Report 5506, The Maximal Accuracy Rate Algorithm for Sequence Alignment and Comparison , October 1994, Gaithersburg, Maryland: National Institute of Standards and Technology.

#223 Harman, D. (1994, November). Overview of the Third Text REtrieval Conference (TREC-3). In proceedings of the Third Text REtrieval Conference (TREC-3), Gaithersburg, Maryland, USA.

#222 Willman, N. (1994, October). A Prototype Information Retrieval System to Perform a Best-Match Search for Names. In proceedings of the Intelligent Multimedia Information Retrieval Systems and Management (RAIO '94) at Rockefeller University, New York, New York, USA.

#221 Harman, D. (1994, April). The Text REtrieval Conference (TREC). Keynote paper presented at the Third Annual Symposium on Document Analysis and Information Retrieval, Las Vegas, Nevada, USA, pp. 43-67.

#220 Harman, D. (Ed.) (1994). NIST Special Publication 500-225: Overview of the Third Text REtrieval Conference (TREC-3). Gaithersburg, Maryland, USA: National Institute of Standards and Technology.

#219 Garris, M., & Dimmick, D. (1994). NIST Interagency Report 5364: Evaluating Form Designs for Optical Character Recognition. Gaithersburg, Maryland, USA: National Institute of Standards and Technology.

#218 Garris, M., Blue, J., Candela, G., Dimmick, D., Geist, J., Grother, P., Janet, S., Wilson, C. (1994). NIST Interagency Report 5469: Form-Based Handprint Recognition System. Gaithersburg, Maryland, USA: National Institute of Standards and Technology.

#321 Garris, M. D., Design, Collection, and Analysis of Handwriting Sample Image Databases ,Encyclopedia of Computer Science and Technology, volume 31, supplement 16, Marcel Dekker, N.Y., pp. 189-213, 1994.

#322 Garris, M. D.,(1994) Correlated Run Length Algorithm (CURL) for Detecting Form Structure Within Digitized Documents , published in the Third Annual Symposium of Document Analysis and Information Retrieval (UNLV), Las Vegas, NV, pp. 413-424, April 1994.

#323 Garris, M. D., Unconstrained Handprint Recognition Using a Limited Lexicon, NIST Interagency Report 5310 ,December 1993 and published in Document Recognition IS&T/SPIE 1994 International Symposium of Electronic Imaging:Science & Technology, San Jose, CA, February 1994.

#324 Garris, M. D., Dimmick, D. L., (1994, February). NIST Interagency Report 5364 - Evaluating Form Designs for Optical Character Recognition, , February 1994, Gaithersburg, Maryland: National Institute of Standards and Technology.

#325 Geist, J., Wilkinson, R. A., Janet, S., Grother, P. J., Hammond, B., Larsen, N. W., Klear, R. M., Burges, C.J. C., Creecy, R., J., Hull, J., Vogl, T. P., Wilson, C. L., (1994, June). The Second Census Optical Character Recongition Systems Conference, NIST Interagency Report 5452 Part 1 (pgs. 1-103) , NIST Interagency Report 5452 Part 2 (pgs. 104-261)

(NOTE: Part 2 is a tar file. Many of the pages are several megabytes in size because they are composed of multiple scanned viewgraphs. So that your printer spooling queue capacity is not exceeded, it is recommended that these pages be printed one at a time in a loop that either waits for the queue to empty or sleeps for the typical printing time for a large file, a few minutes on a SparcPrinter, but dozens of minutes on older printers like a LaserWriter II.

#342 Blue, J. L., Candela, G. T., Grother, P. J., Chellappa, R., C. L. Wilson, J. D. Blue, (1994). Evaluation of Pattern Classifiers for Fingerprint and OCR Application , in Pattern Recognition, 27, pp. 485-501, 1994.

#343 Wilson, C. L., Candela, G. T., Watson, C.I. (1994) Neural Network Fingerprint Classification , in Journal for Artificial Neural Networks, 1(2), 203-228, 1994.

#344 Watson, C.I. , Candela, G., Grother, P., ( 1994, September). NIST Interagency Report 5493 - Comparison of FFT Fingerprint Filtering Methods for Neural Network Classification, , September 1994.

#348 Wilson, C. L., Barnes, C. Chellappa, R., Sirohey, (1994). , NIST Interagency Report 5465 - Face Recognition Technology for Law Enforcement Applications . July 1994 and Proceedings of the IEEE, 1994.

#370 Wilson, C. L., Omidvar, O. M., (1994). Information Content in Neural Net Optimization. In Journal of Connection Science, Vol. 6, No. 1, 1994.

#372 Wilson, C. L., Grother, P. J., Barnes, C.S., NIST Interagency Report 5542 - Binary Decision Clustering for Neural Network Based OCR, and Journal Pattern Recogniton, Vol. 29, No. 3, pp. 425-437, (1996). December 1994. Keywords: OCR, neural networks, data clustering, pattern recognition, K-L transform, dynamic systems.

#403H, Wilson, C. L., Candela, G. T., Watson, C.I., Neural-Network Fingerprint Classification, published in the Journal of Artifical Neural Networks, 1(2), pgs 203-228, (1994). Keywords: optimization, ridge-valley, K-L transform fingerprint, segmentation.

1993
#217 Harman, D. (Ed.) (1993). NIST Special Publication 500-215: The Second Text REtrieval Conference (TREC-2). Gaithersburg, Maryland, USA: National Institute of Standards and Technology.

#312 Wilson, C. L.,(1993) Evaluation of Character Recognition Systems, In Neural Networks for Signal Processing III, IEEE, New York, pp. 485-496 1993.

#313 Wilson, C. L.,(1993). Effectiveness of Feature and Classifier Algorithms in Character Recognition Systems, NIST Interagency Report 4995, December 1992 and In D. P. D'Amato, editor, Volume 1906. SPIE, San Jose, CA, 1993.

#314 Wilkinson, R. A., Garris, M. D., Geist, J. C., (1993). Machine-Assisted Human Classification of Segmented Characters for OCR Testing and Training, NIST Interagency Report 5105, December,1992 and In D. P. D'Amato, editor, volume 1906. SPIE, San Jose, CA, 1993.

#315 Garris, M. D., (1993, February). NIST Interagency Report 5129 - Methods for Evaluating the Performance of Systems Intended to Recognize Characters from Image Data Scanned from Forms, , February 1993.

#316 Garris, M. D.,(1993, April). NIST Interagency Report 5173 - NIST Scoring Package Certification Procedures in Conjunction with NIST Special Databases 2 and 6, April 1993.

#317 Wilkinson, R. A.,( 1993, April). NIST Interagency Report 5180 - Dictionary Production for Census Form Conference , April 1993.

#320 Garris, M. D., (1993, August). NIST Interagency Report 5249 - NIST Scoring Package Cross-Reference for use with NIST Internal Reports 4950 and 5129, , August 1993

#364 Wilson, C. L., (1993). Statistical Analysis of Information Content for Training Pattern Recognition Networks, NIST Interagency Report 5149 , March 1993 and In Proceedings, Applications of Artificial Neural Networks IV. SPIE, Orlando, Florida, April 1993.

#365 Candela, G. T., Chellappa, R., (1993,April). NIST Interagency Report 5163 - Comparative Performance of Classification Methods for Fingerprints, , April 1993.

#366 Blue, J. L., (1993). NIST Interagency Report 5168 - Computational Experience with Radial Basis Function Networks.

#367 Omidvar, O. M., Wilson, C. L., (1993). Optimization of ART Network with Boltzmann Machine, in Dennis W. Ruck, editor,Science of Artificial Neural Networks II, volume 1966, SPIE, Orlando, FL, 1992 and NIST Interagency Report 5176, April 1993.

#368 Grother, P. J., Candela, G. T., (1993, June). NIST Interagency Report 5209 - Comparison of Handprinted Digit Classifiers, , June 1993.

1992
#216 Harman, D. (1992). Automatic Indexing. In R. Fidel et. al. (Eds.), Challenges in Indexing Electronic Text and Images (pp. 247-264), Medford, New Jersey, USA: Learned Information Inc.

#215 Harman, D. (1992). Evaluation Issues in Information Retrieval. Information Processing and Management, 28(4), 439-440.

#214 Harman, D., Fox, E., Baeza-Yates, R., & Lee, W. (1992). Inverted Files. In W. Frakes & R. Baeza-Yates (Eds.), Information Retrieval: Data Structures and Algorithms (pp.28-43), Englewood Cliffs, New Jersey, USA: Prentice-Hall.

#213 Harman, D. (1992). Ranking Algorithms. In W. Frakes & R. Baeza-Yates (Eds.), Information Retrieval: Data Structures and Algorithms (pp.363-392), Englewood Cliffs, New Jersey, USA: Prentice-Hall.

#212 Harman, D. (1992, June). Relevance Feedback Revisited. In proceedings of the 15th International Conference on Research and Development in Information Retrieval, Copenhagen, Denmark. #301 Grother, P. J., Cross Validation Comparison of NIST OCR Databases in SPIE, D. P. D'Amato, editor, volume 1906, San Jose, 1993 and NIST Interagency Report 5123, January 1992.

#302 Garris, M. D., Wilson, C. L., Blue, J. L., Candela, G. T., P. Grother, Janet, S., Wilkinson, R. A., Massively Parallel Implementation of Character Recognition Systems. In Conference on Character Recognition and Digitizer Technologies, volume 1661, pages 269-280, SPIE, San Jose, California, February 1992., and NIST Interagency Report 4750, January 1992.

# 303 Garris, M. D., Wilson, C. L.,(1992, March) A Neural Approach to Concurrent Character Segmentation and Recognition In Southcon '92 Conference Record, pages 154-159, IEEE, Orlando, Florida, March 1992.

# 304 Garris, M. D., (1992, April). A Platform for Evolving Genetic Automata for Text Segmentation (GNATS) In Science of Artificial Neural Networks, volume 1710, pages 714-724, SPIE, Orlando, Florida, April 1992.

# 305 Garris, M. D., Wilson, C. L., Reject Mechanisms for Massively Parallel Neural Network Character Recognition Systems. In Su-Shing Chen, editor, Neural and Stochastic Methods in Image and Signal Processing, volume 1766. SPIE, San Diego, California, 1992, and NIST Interagency Report 4863, June, 1992.

#306 Wilkinson, R. A., Geist, J. Janet, S., Grother, P. J., Burges, C. J. C., Creecy,R., Hammond, B., Hull, J. J., Larsen, N. J., Vogle, T. P., Wilson, C. L., (1992, August). NIST Interagency Report 4912 - The First Optical Character Recognition Systems Conference. #307 Wilkinson, R. A., Garris, M. D., Comparison of Massively Parallel Hand-Print Segmentors. In D. P. Casasent, editor,Intelligent Robots and Computer Vision: Algorithms, Techniques, and Active Vision, volume 1825. SPIE, Boston, Massachusetts, 1992 and NIST Interagency Report 4923 , September 1992.

#308 Wilkinson, R. A., Garris, M. D., Wilson, C. L., Using Self-Organizing Recognition as a Mechanism for Rejecting Segmentation Errors. In D. P. Casasent, editor, Intelligent Robots and Computer Vision: Algorithms, Techniques, and Active Vision, volume 1825. SPIE, Boston, Massachusetts, 1992 and NIST Interagency Report 4938, October 1992.

#309 Garris, M. D., Janet, S., (1992, October). NIST Interagency Report 4950 - NIST Scoring Package User's Guide - Release 1.0, , October 1992.(NOTE: This is a tar file containing three postscript files.) #310 Garris, M. D., (1992) Design and Collection of a Handwriting Sample Image Database , Social Science Computing Journal,volume 10, pages, 196-214, 1992.

#292 McCabe, R., Wilson, C. L., Grubb, D., (1992, July) NIST Interagency Report 4892 - Research Considerations Regarding FBI-IAFIS Tasks & Requirements. #311 Geist, J., Wilkinson, R. A., (1992)OCR Error Rate Versus Rejection Rate for Isolated Handprint Characters, in D. P. D'Amato, editor, volume 1906. SPIE, San Jose, CA, 1993 and NIST Interagency Report 4990, December 1992.

#300 Wilson, C. L., Blue, J. L.,(1992). Neural Network Methods Applied to Character Recognition. In Social Science Computer Review, volume 10, pages, 173-195, 1992.

#211 Harman, D. (1992). Relevance Feedback and Other Query Modification Techniques. In W. Frakes & R. Baeza-Yates (Eds.), Information Retrieval: Data Structures and Algorithms (pp.241-263), Englewood Cliffs, New Jersey, USA: Prentice-Hall.

#210 Harman, D. (1992). User Friendly Systems Instead of User Friendly Front-Ends. Journal of the American Society for Information Science, 43(2), 164-174.

#209 Harman, D. (Ed.) (1992). NIST Special Publication 500-207: The First Text REtrieval Conference (TREC-1). Gaithersburg, Maryland, USA: National Institute of Standards and Technology.

#208 Harman, D. (1992). NIST Interagency Report 4873: Automatic Indexing. Gaithersburg, Maryland, USA: National Institute of Standards and Technology.

#340 Wilson, C. L., Candela, G. T., Grother, P. J., Watson, C. I., Wilkinson, R. A., (1992, July). NIST Interagency Report 4880 - Massively Parallel Neural Network Fingerprint Classification System. , July 1992.

#357 Wilson, C. L., Omidvar, O. M., (1992, February). NIST Interagency Report 4766 - Optimization of Neural Network Topology and Information Content Using Boltzmann Methods , Feb. 1992.

#358 Blue, J. L., Grother, P. J., (1992). Training Feed Forward Networks Using Conjugate Gradients. In Conference on Character Recognition and Digitizer Technologies, volume 1661, pages 179-190, SPIE, San Jose, California, February 1992 and NIST Interagency Report 4776 .

#358 Wilson, C. L.,(1992, March). FAUST: A Vision Based Neural Network Multi-Map Pattern Recognition Architecture. In Proceedings:Applications of Artificial Neural Networks III. SPIE, Orlando, Florida, April 1992 and NIST Interagency Report 4805 , March 1992.

#361 Grother, P. J., Karhunen Loève Feature Extraction for Neural Handwritten Character Recognition. In Proceedings: Applications of Artificial Neural Networks III. SPIE, Orlando, Florida. April 1992 and NIST Interagency Report 4824.

#362 Wilson, C. L., (1992, June). Massively Parallel Neural Network Recognition. In Proceedings of the IJCNN, Volume III, pages 227-232, June 1992. #363 Omidvar, O. M., Wilson, C. L.,(1992). Topological Separation Versus Weight Sharing in Neural Network Optimization. In Su-Shing Chen, editor, Neural and Stochastic Methods in Image and Signal Processing, volume 1766. SPIE, San Diego, California, 1992 and NIST Interagency Report 4893, July 1992.

1991
#207 Harman, D. (1991). How Effective is Suffixing? Journal of the American Society for Information Science, 42(1), 7-15.

#297 Garris, M. D., Wilkinson, R. A., Wilson, C. L., (1991, May). Analysis of a Biologically Motivated Neural Network for Character Recognition In the proceedings: Analysis of Neural Network Applications, ACM Press, George Mason University, May 1991.

#298 Wilkinson, R. A., (1991). Segmenting Text Images with Massively Parallel Machines . In D. P. Casasent, editor, Intelligent Robots and Computer Vision, volume 1607, pages 312-323. SPIE, Boston, Massachusetts, 1991.

#298 Garris, M. D., Wilkinson, R. A., Wilson, C. L., (1991, July). Methods for Enhancing Neural Network Handwritten Character Recognition. published in International Joint Conference on Neural Networks, Vol. 1, IEEE, Seattle, July 1991.

#356 Omidvar, O. M., Wilson, C. L., (1991). Massively Parallel Implementation of Neural Network Architectures, In Proceedings of the SPIE, volume 1452, pages 532-543, Feb. 25 - Mar. 1, 1991, San Jose, CA.

1990
#206 Harman, D., & Candela, G. (1990). Bringing Natural Information Language Retrieval Out of the Closet. SIGCHI Bulletin, 21(1), 42-48.

#296 Wilson, C. L., Wilkinson, R. A., Garris, M. D.,(1990). Self-Organizing Neural Network Character Recognition on a Massively Parallel Computer In the Proceedings of the IJCNN, Vol. II, San Diego, CA, June 1990.

#205 Harman, D., & Candela, G. (1990). Retrieving Records from a Gigabyte of Text on a Minicomputer Using Statistical Ranking. Journal of the American Society for Information Science, 41(8), 581-589.

1989

#204 Harman, D., & Candela, G. (1989). A Very Fast Prototype Retrieval System Using Statistical Ranking. SIGIR Forum, 23(3 and 4), 100-110.

#386 Garris, M. D., Wilson, C.L.,(1989, September) NIST Interagency Report 4177, Decoding Bar Codes from Image Data

1988
#203 Harman, D. (1988). IRX: An Information Retrieval System for Experimentation and User Applications. In proceedings of the RIAO '88 Conference on User-Oriented Content-Based Text and Image Handling Conference, Boston, Massachusetts, USA.

#202 Harman, D. (1988, June). Towards Interactive Query Expansion. In proceedings of the 11th International Conference on Research and Development in Information Retrieval, Grenoble, France, pp. 321-331.

1987
#201 Harman, D. (1987,June). A Failure Analysis of the Limitation of Suffixing in an Online Environment. In proceedings of the 10th Annual International ACM SIGIR Conference, New Orleans, Louisiana, USA, pp. 102-108.

1986
#200 Harman, D. (1986, September). An Experimental Study of Factors Important in Document Ranking. In proceedings of the ACM Conference on Research and Development, Pisa, Italy.

      
Site created on June 15, 2001

Last updated: November 9,2004

Contact web894@nist.gov with corrections.