Evaluation of Digital Library - Judy Jeng - NJCU Faculty - Judy Jeng

Abbas, J., Norris, C., & Soloway, E. (2002). Middle school children’s use of the ARTEMIS digital library. Proceedings of the 2nd ACM/IEEE-CS Joint Conference on Digital Libraries, 98-105. Retrieved December 23, 2005, from ACM Digital Library database.

Baldonado, M. Q. W. (2000). A user-centered interface for information exploration in a heterogeneous digital library. Journal of the American Society for Information Science, 51(3), 297-310.

Battleson, B., Booth, A., & Weintrop, J. (2001). Usability testing of an academic library web site: A case study. The Journal of Academic Librarianship, 27(3), 188-198.

Beagrie, N., & Greenstein, D. (1998). Managing digital collections: Arts and Humanities Data Service (AHDS) policies, standards and practices: Evaluation criteria for evaluation. Retrieved August 23, 2002, from http://ahds.ac.uk/digital

Bennett, S. (2001). The golden age of libraries. Journal of Academic Librarianship, 27(4), 256-260.

Bertot, J. C., Snead, J. T., Jaeger, P. T., & McClure, C. R. (2006). Functionality, usability, and accessibility: Iterative user-centered evaluation strategies for digital libraries. Performance Measurement and Metrics, 7(1), 17-28.

Bishop, A. P. (1998). Measuring access, use, and success in digital libraries . The Journal of Electronic Publishing, 4(2). Retrieved August 24, 2002, from http://www.press.umich.edu/jep/04-02/bishop.html

Bishop, A. P. (2005). Digital library use: Social practice in design and evaluation. Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries, 276-277. Retrieved December 23, 2005, from ACM Digital Library database.

Bishop, A. P., & Star, S. L. (1996). Social informatics for digital library use and infrastructure. In M. E. Williams (Ed.), Annual review of information science and technology, Vol. 31 (pp. 301-401). Medford, NJ: Information Today.

Bishop, A. P., Star, S. L., Neumann, L., Ignacio, E., Sandusky, R. J., & Schatz, B. Building a university digital library: The need for a user-centered approach. Retrieved August 24, 2002, from http://forseti.grainger.uiuc.edu/dlisoc/socsci_site/monterey-final.html

Blandford, A., Keith, S., Connell, I., & Edwards, H. (2004). Analytical usability evaluation for digital libraries: A case study. Proceedings of the 4th ACM/IEEE Joint Conference on Digital Libraries, 27-36. Retrieved December 23, 2005, from ACM Digital Library database.

Bollen, J., & Luce, R. (2002, June). Evaluation of digital library impact and user communities by analysis of usage patterns. D-Lib Magazine, 8(6). Retrieved August 15, 2002, from http://www.dlib.org/dlib/june02/bollen/06bollen.html

Bollen, J., Vemulapalli, S. S., Xu, W. & Luce, R. (2003, May). Usage analysis for the identification of research trends in digital libraries. D-Lib Magazine, 9(5). Retrieved May 16, 2003, from http://www.dlib.org/dlib/may03/bollen/05bollen.html

Bonn, M. S., Lougee, W. P., MacKie-Mason, J. K., & Riveros, J. F. (1999, June). A report on the PEAK experiment. D-Lib Magazine, 5(6). Retrieved May 29, 2002, from http://www.dlib.org/dlib/june99/06bonn.html

Borgman, C. L. (1999). What are digital libraries? Competing visions. Information Processing and Management, 35(3), 227-243.

Borgman, C. L. (2000). From Gutenberg to the global information infrastructure: Access to information in the networked world. Cambridge, MA: MIT Press.

Borgman, C. L., Gilliland-Swetland, A. J., Leazer, G. H., Mayer, R., Gwynn, D., Gazan, R., & Mautone, P. (2000). Evaluating digital libraries for teaching and learning in undergraduate education: A case study of the Alexandria Digital Earth ProtoType (ADEPT). Library Trends, 49(2), 228-250.

Borgman, C. L., & Larsen, R. (2003). ECDL 2003 workshop report: Digital library evaluation – metrics, testbeds, and processes. D-Lib Magazine, 9(9). Retrieved May 28, 2005, from http://www.dlib.org/dlib/september03/09inbrief.html#BORGMAN

Borgman, C. L., Leazer, G. H., Gilliland-Swetland, A. J. & Gazan, R. (2001). Iterative design and evaluation of a geographic digital library for university students: A case study of the Alexandria Digital Earth Prototype (ADEPT). In P. Constantopoulos & I. T. Solvberg (Eds.), Research and Advanced Technology for Digital Libraries: 5th European Conference (ECDL 2001). Lecture Notes in Computer Science, 2163, 390-401.

Borgman, C. L., Leazer, G. H., Gilliland-Swetland, A., Millwood, K., Champeny, L., Finley, J., & Smart, L. J. (2004). How geography professors select materials for classroom lectures: Implications for the design of digital libraries. Proceedings of the 4th ACM/IEEE-CS Joint Conference on Digital Libraries, 179-185. Retrieved December 23, 2005, from ACM Digital Library database.

Borlund, P. (2000). Experimental components for the evaluation of interactive information retrieval systems. Journal of Documentation, 56(1), 71-90.

Budhu, M. (2002, November). The design and evaluation of interactivities in a digital library. D-Lib Magazine, 8(11). Retrieved February 8, 2006, from http://www.dlib.org/dlib/november02/coleman/11coleman.html

Buhr, S., Barker, L., & Reeves, T. C. (2005). The DLESE evaluation services group: A framework for evaluation within a digital library. Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries, 370. Retrieved December 23, 2005, from ACM Digital Library database.

Byrd, S., Courson, G., Roderick, E., & Taylor, J. M. (2001). Cost/benefit analysis for digital library projects: The Virginia Historical Inventory Project (VHI). The Bottom Line: Managing Library Finances, 14(2), 65-75.

Champeny, L., Borgman, C. L., Leazer, G. H., Gilliland-Swetland, A. J., Millwood, K. A., D’Avolio, L. et al. (2004). Developing a digital learning environment: An evaluation of design and implementation processes. Proceedings of the 4th ACM/IEEE-CS Joint Conference on Digital Libraries, 37-46. Retrieved December 23, 2005, from ACM Digital Library database.

Cherry, J. M. & Duff, W. M. (2002). Studying digital library users over time: A follow-up survey of Early Canadiana Online. Information Research, 7(2). Retrieved April 5, 2006, from http://informationr.net/ir/7-2/paper123.html

Ching, H-H, S., Shih, C-L, & Chang-Chien, J. J. (2001). Economic analyses of scholarly electronic journal: Part I. Journal of Library & Information Science, 27, 37-50.

Chisman, J., Diller, K., & Walbridge, S. (1999). Usability testing: A case study. College & Research Libraries, 60(6), 552-569.

Choudhury, S., Hobbs, B., Lorie, M., & Flores, N. (2002, July/August). A framework for evaluating digital library services. D-Lib Magazine, 8(7/8). Retrieved August 13, 2002, from http://www.dlib.org/dlib/july02/choudhury/07choudhury.html

Clarke, Z. (1999). Performance indicators for the electronic library: The EQUINOX Project. Multimedia Information & Technology, 25(3), 235-237.

Coleman, A. S., Bartolo, L. M., & Jones, C. (2004). Bricoleurs: Exploring digital library evaluation as participation interactions, research, and processes. Proceedings of the 4th ACM/IEEE-CS Joint Conference on Digital Libraries, 377. Retrieved December 23, 2005, from ACM Digital Library database.

Coleman, A. S., Bartolo, L. M., & Jones, C. (2005). Impact: The last frontier in digital library evaluation. Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries, 372. Retrieved December 23, 2005, from ACM Digital Library database.

Coleman, A., & Oxnam, M. (2002). Interactional digital libraries: Introduction to a special issue on interactivity in digital libraries. Journal of Digital Information, 2(4). Retrieved September 12, 2002, from http://jodi.ecs.soton.ac.uk/Articles/v02/i04/editorial

Cook, C., Heath, F., Kyrillidou, M., Lincoln, Y., Thompson, B., & Webster, D. (2003). Developing a National Science Digital Library (NSDL) LibQUAL+TM protocol: An E-service for assessing the library of the 21st century. Retrieved January 3, 2006, from http://www.libqual.org/documents/admin/NSDL_workshop_web1.pdf

Crane, G. (1996). Building digital library: The Perseus project as a case study in the humanities. Proceedings of the First ACM International Conference on Digital Libraries, 3-19.

Crawford, G. A. (1999). Issues for the digital library. Computers in Libraries, 19(5), 62-

Cullen, R. (2003). Evaluating digital libraries in the health sector. Part 1: measuring inputs and outputs. Health Information and Libraries Journal, 20(4), 195-204.

Cullen, R. (2004). Evaluating digital libraries in the health sector. Part 2: measuring impacts and outcomes. Health Information and Libraries Journal, 21(1), 3-13.

Day, C. (1993, November). Economics of Electronic Publishing. Paper presented at AAUP/ARL Symposium on Electronic Publishing. Retrieved December 1, 2000, from http://www.press.umich.edu/jep/works/colin.econ.html

Dickstein, R., & Mills, V. (2000). Usability testing at the University of Arizona library: How to let the users in on the design. Information Technology and Libraries, 19(3), 144-151.

Dillon, A., & Song, M. (1997). An empirical comparison of the usability for novice and expert searchers of a textual and a graphic interface to an art-resource database. Journal of Digital Information, 1(1). Retrieved September 12, 2002, from http://jodi.ecs.soton.ac.uk/Articles/v01/i01/Dillon

Dorward, J., Reinke, D., & Recker, M. (2002). An evaluation model for a digital library services tool. Proceedings of the 2nd ACM/IEEE-CS Joint Conference on Digital Libraries, 322-323. Retrieved December 23, 2005, from ACM Digital Library database.

Downie, J. S. (2002). Workshop on the creation of standardized test collections, tasks and metrics for music information retrieval (MIR) and music digital library (MDL) evaluation. Proceedings of the 2nd ACM/IEEE-CS Joint Conference on Digital Libraries, 426. Retrieved December 23, 2005, from ACM Digital Library database.

Downie, J. S. (2003a). Establishing music information retrieval (MIR) and music digital library (MDL) evaluation frameworks: Preliminary foundations and infrastructures. The MIR/MDL Evaluation Project White Paper Collection, Edition 3, 3-6. Champaign, IL: Graduate School of Library and Information Science. Retrieved February 9, 2006, from http://www.music-ir.org/evaluation/wp2/wp1_downie_establishing.pdf

Downie, J. S. (2003b). Report on the panels and workshops of the music information retrieval (MIR) and Music Digital Library (MDL) evaluation framework project. ACM SIGIR Forum, 37(2), 38-44. Retrieved December 23, 2005, from ACM Digital Library database.

e Silva, L. V., Laender, A. H. F., & Gonçalves, M. A. (2005). A usability evaluation study of a digital library self-archiving service. Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries, 176-177. Retrieved December 23, 2005, from ACM Digital Library database.

Edmondson, B. (2005). NSDL 2005 Annual Report: Examining NSDL’s impact. Retrieved January 4, 2006, from http://nsdl.org/about/download/misc/NSDL_ANNUAL_REPORT_2005.pdf

Ferreira, S. M., & Pithan, D. N. (2005). Usability of digital libraries: A study based on the areas of information science and human-computer interaction. OCLC Systems & Services, 21(4), 311-323.

Fox, E. A., & Urs, S. R. (2002). Digital libraries. In Blaise Cronin (Ed.), Annual Review of Information Science and Technology: Vol. 36, (pp. 503-589). Medford, NJ: Information Today.

Frokjaer, E., Hertzum, M., & Hornbaek, K. (2000). Measuring usability: Are effectiveness, efficiency, and satisfaction really correlated? Proceedings of the CHI 2000 Conference on Human Factors in Computing Systems, 2(1), 345-352.

Fuhr, N., Hansen, P., Mabe, M., Micsik, A., & Sølvberg, I. (2001). Digital libraries: A generic classification and evaluation scheme. Lecture Notes in Computer Science. Retrieved January 13, 2006, from http://citeseer.ist.psu.edu/fuhr01digital.html

Garoufallou, E., Siatri, R., & Balatsoukas, P. (2008). Virtual maps – Virtual worlds: Testing the usability of a Greek virtual cultural map. Journal of the American Society for Information Science and Technology, 59(4), 591-601.

Gilliland-Swetland, A. J., & Leazer, G. L. (2001). Iscapes: Digital libraries environments for the promotion of scientific thinking by undergraduates in geography. Proceedings of the 1st ACM/IEEE-CS Joint Conference on Digital Libraries, 120-121. Retrieved December 23, 2005, from ACM Digital Library database.

Greenstein, D. (2000). Digital libraries and their challenges. Library Trends, 49(2), 290-303.

Harter, S. P. (1997). Scholarly communication and the digital library: Problems and issues. Journal of Digital Information, 1(1). Retrieved August 22, 2002, from http://jodi.ecs.soton.ac.uk/Articles/v01/i01/Harter

Heath, F., Kyrillidou, M., Webster, D., Choudhury, S., & Hobbs, B. (2003). Emerging tools for evaluating digital library services: Conceptual adaptations of LibQUA CAPM. Journal of Digital Information, 4(2). Retrieved July 2, 2003 from http://jodi.ecs.soton.ac.uk/Articles/v04/i02/Heath/

Hill, L. L., Carver, L., Larsgaard, M., Dolin, R., Smith, T. R., Frew, J., & Rae, M-A. (2000). Alexandria digital library: User evaluation studies and system design. Journal of the American Society for Information Science, 51(3), 246-259.

Hill, L. L., Dolin, R., Frew, J., Kemp, R. B., Larsgaard, M., Montello, D. R., Rae, M.-A., & Simpson, J. (1997). User evaluation: Summary of the methodologies and results for the Alexandria digital library, University of California at Santa Barbara. Proceedings of the 60^th annual meeting of the American Society for Information Science, (pp. 225-243). Medford, NJ: Information Today. Also available: http://www.asis.org/annual-97/alexia.htm

Hirtle, P. (2001, March). Planning enduring repositories for digital scholarly communication. D-Lib Magazine, 7(3). Retrieved August 22, 2002, from http://www.dlib.org/dlib/march01/03editorial.html

Hsieh, L. F., Chin, J. B., & Wu, M. C. (2006). Performance evaluation for university electronic libraries in Taiwan. The Electronic Library, 24(2), 212-224.

Jeng, J. (2004). Usability evaluation of academic digital libraries: From the perspectives of effectiveness, efficiency, satisfaction, and learnability. Proceedings of the 67th Annual Meeting of the American Society for Information Science and Technology, v. 41, November 13-18, 2004, Providence, RI. Available at: http://www.asis.org/Conferences/AM04/posters/180.doc

Jeng, J. (2004). Usability of digital libraries: An evaluation model. Proceedings of the Fourth ACM/IEEE Joint Conference on Digital Libraries, 407. Retrieved March 13, 2006, from ACM Digital Library database.

Jeng, J. (2005). What is usability in the context of the digital library and how can it be measured?” Information Technology and Libraries 24(2), 47-56.

Jeng, J. (2005). Usability assessment of academic digital libraries: Effectiveness, efficiency, satisfaction, and learnability” Libri: International Journal of Libraries and Information Services, 55(2/3), 96-121.

Jeng, J. (2006). Usability of the digital library: An evaluation model. Ph. D. dissertation, Rutgers University. January 2006.

Jeng, J. (2006). Usability of the digital library: An evaluation model. Summary report from the 2004 ACRL Doctoral Dissertation Fellowship Recipient. College and Research Libraries News, 67(2), 78-79.

Johnson, R. K. (2000, May). A question of access: SPARC, BioOne, and Society-Driven electronic publishing. D-Lib Magazine, 6(5). Retrieved May 8, 2002, from http://www.dlib.org/dlib/may00/johnson/05johnson.html

Jones, M. L. W., Gay, G. K., & Rieger, R. H. (1999, November). Project Soup: Comparing evaluations of digital collection efforts. D-Lib Magazine, 5(11). Retrieved August 27, 2002, from http://www.dlib.org/dlib/november99/11jones.html

Kahle, B., Prelinger, R., & Jackson, M. E. (2001, October). Public access to digital material. D-Lib Magazine, 7(10). Retrieved August 16, 2002, from http://www.dlib.org/dlib/october01/kahle/10kahle.html

Kani-Zabihi, E., Ghinea, G., & Chen, S. Y. (2006). Digital libraries: What do users want? Online Information Review, 30(4), 395-412.

Kassim, A. R. C., & Kochtanek, T. R. (2003). Designing, implementing, and evaluating an educational digital library resource. Online Information Review, 27(3), 160-168.

Kastens, K. A., & Holzman, N. (2006). The digital library for earth system education provides individualized reports for teachers on the effectiveness of educational resources in their own classrooms. D-Lib Magazine, 12(1). Retrieved January 18, 2006, from http://www.dlib.org/dlib/january06/kastens/01kastens.html

Kengeri, R., Seals, C. D., Harley, H. D., Reddy, H. P., & Fox, E. A. (1999). Usability study of digital libraries: ACM, IEEE-CS, NCSTRL, NDLTD. International Journal on Digital Libraries, 2, 157-169.

Khoo, M. (2001). Community design of DLESE’s collections review policy: A technological frames analysis. Proceedings of the 1st ACM/IEEE-CS Joint Conference on Digital Libraries, 157-164. Retrieved December 23, 2005, from ACM Digital Library database.

Kilker, J., & Gay, G. (1998). The social construction of a digital library: A case study examining implications for evaluation. Information Technology and Libraries, 60-70.

Kramer, E. F. (2005). IUPUI image collection: A usability survey. OCLC Systems & Services, 21(4), 346-359.

Krowne, A., & Halbert, M. (2005). An initial evaluation of automated organization for digital library browsing. Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries, 246-255. Retrieved December 23, 2005, from ACM Digital Library database.

Kyrillidou, M. & Giersch, S. (2005). Developing the DigiQUAL protocol for digital library evaluation. Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries, 172-173. Retrieved December 23, 2005, from ACM Digital Library database.

Lancaster, F. W. (1993). If you want to evaluate your library. 2^nd ed. Urbana-Champaign: University of Illinois, Graduate School of Library and Information Science.

Lancaster, F. W. (1995). Are evaluation criteria applied to traditional libraries equally applicable to digital libraries? In How we do user-centered design and evaluation of digital libraries: A methodological forum, 37^th Allerton Institute, October 29-31, 1995, Monticello, IL. Retrieved August 24, 2002, from http://alexia.lis.uiuc.edu/gslis/allerton/95/lancaster.html

Lancaster, F. W. (1997). Evaluation in the context of the digital library. In A. H. Helal & J. W. Weiss (Eds.), Towards a worldwide library: A ten year forecast. Essen: Universitattsbibliothek Essen.

Lawrence, S. R., Connaway, L. S., & Brigham, K. H. (2001). Life cycle costs of library collections: Creation of effective performance and cost metrics for library resources. College & Research Libraries, 62(6), 541-553.

Leazer, G. H., Gilliland-Swetland, A. J., & Borgman, C. L. (2000). Evaluating the use of a geographic digital library in undergraduate classrooms: ADEPT. Proceedings of the 5th ACM Conference on Digital Libraries, 248-249. Retrieved December 23, 2005, from ACM Digital Library database.

Lesk, M. (1997). Practical digital libraries: Books, bytes, and bucks. San Francisco, CA: Morgan Kaufmann Publishers.

Levy, D. M. (2000). Digital libraries and the problem of purpose. Bulletin of the American Society for Information Science, 26(6), 22-25.

Lewis, J. R. (2002). Psychometric evaluation of the PSSUQ using data from five years of usability studies. International Journal of Human-Computer Interaction, 14(3&4), 463-488.

Lodato, J. (2004). Creating an educational digital library: GROW a National Civil Engineering Education Resource Library. Conference on Human Factors in Computing Systems, 810-824. Retrieved December 23, 2005, from ACM Digital Library database.

Long, H. (2002). An assessment of the current state of digital library evaluation. Unpublished master’s thesis, University of North Carolina at Chapel Hill.

Long, H., Lage, K., & Cronin, C. (2005). The flight plan of a digital initiatives project, part 2: Usability testing in the context of user-centered design. OCLC Systems & Services, 21(4), 324-345.

Lyman, P. (2001). What is a digital library? The social impact of information artifacts. Digital libraries: Research and practice, 2000, Kyoto, International Conference on, 57-61.

MacKie-Mason, J. K., & Jankovich, A. L. L. (1997). PEAK: Pricing electronic access to knowledge. Retrieved December 1, 2000, from http://www-personal.umich.edu/~jmm/papers/PEAK/

MacKie-Mason, J. K., Riveros, J. F., Bonn, M. S., & Lougee, W. P. (1999, July/August). A report on the PEAK experiment: Usage and economic behavior. D-Lib Magazine, 5(7/8). Retrieved May 17, 2002, from http://www.dlib.org/dlib/july99/mackie-mason/07mackie-mason.html

Majka, D. R. (2000). The “great exchange”: The economic promise and peril of the digital library. Bottom Line: Managing Library Finances, 13(2), 68-73.

Maly, K., Zubair, M., Balusani, S., Mathur, A., & Sudeep, S. (2002). DL-COTF: An XML based digital library for U.S. Navy’s operational test and evaluation force. Proceedings of the 2002 ACM Symposium on Applied Computing, 493-497. Retrieved December 23, 2005, from ACM Digital Library database.

Marchionini, G. (2000). Evaluating digital libraries: A longitudinal and multifaceted view . Library Trends, 49(2), 304-333.

Marchionini, G., & Crane, G. (1994). Evaluating hypermedia and learning: Methods and results from the Perseus project. ACM Transactions on Information Systems, 12(1), 5-34.

Marchionini, G., Plaisant, C., & Komlodi, A. (2003). The people in digital libraries: Multifaceted approaches to assessing needs and impacts. In A. P. Bishop, N. A. VanHouse & P. Butterfield (Eds.), Digital library use: Social practice in design and evaluation (pp. 119-160). Cambridge, MA: MIT Press. Retrieved August 27, 2002, from http://ils.unc.edu/~march/revision.pdf

Mathur, M. (2005). Advent of digital libraries and measuring their performance: A review. DESIDOC Bulletin of Information Technology, 25(2), 19-25.

McCray, A. T., & Gallagher, M. E. (2001). Principles for digital library development. Communications of the ACM, 44(5), 49-54.

McClure, C. R., Snead, J., Thompson, K. M., & Bertot, J. C. (2004). Measures and statistics to assess the Florida Electronic Library (FEL). Tallahassee, FL: School of Information Studies, Florida State University.

McGillis, L., & Toms, E. G. (2001). Usability of the academic library web site: Implications for design. College & Research Libraries, 62(4), 355-367.

Matson, L. D., & Bonski, D. J. (1997). Do digital libraries need librarians? Online, 21(6), 87-92.

Mead, J. P., & Gay, G. (1995). Concept mapping: An innovative approach to digital library design and evaluation. ACM SIGOIS Bulletin, 16(2), 10-14.

Meyyappan, N., Foo, S., & Chowdhury, G. G. (2004). Design and evaluation of a task-based digital library for the academic community. Journal of Documentation, 60(4), 449-475.

Morse, E. L. (2002, September). Evaluation methodologies for information management systems. D-Lib Magazine, 8(9). Retrieved September 19, 2002, from http://www.dlib.org/dlib/september02/morse/09morse.html

Moyo, L. M. (2002). Collections on the web: Some access and navigation issues. Library Collections, Acquisitions, & Technical Services, 26, 47-59.

Muller, J. P., & Pischel, M. (1999). Doing business in the information marketplace. Proceedings of the Third Annual Conference on Autonomous Agents, 139-146.

Norberg, L. R., Vassiliadis, K., Ferguson, J., & Smith, N. (2005). Sustainable design for multiple audiences: The usability study and iterative redesign of the documenting the American South digital library. OCLC Systems & Services, 21(4), 285-299.

Pan, B., Gay, G., Saylor, J., Hembrooke, H., Henderson, D. (2004). Usability, learning, and subjective experience: User evaluation of K-MODDL in an undergraduate class. Proceedings of the 4th ACM/IEEE-CS Joint Conference on Digital Libraries, 188-189. Retrieved December 23, 2005, from ACM Digital Library database.

Park, S. (2000). Usability, user preferences, effectiveness, and user behaviors when searching individual and integrated full-text databases: Implications for digital libraries. Journal of the American Society for Information Science, 51(5), 456-468.

Payette, S. D., & Rieger, O. Y. (1997, April). The user’s perspective. D-Lib Magazine. Retrieved May 17, 2002, from http://www.dlib.org/dlib/april97/cornell/04payette.html

Peterson, Elaine. (May 2005). Evaluation of digital libraries using snowball sampling. First Monday, 10(5). Retrieved May 3, 2005, from http://firstmonday.org/issues/issue10_5/peterson/index.html

Quam, E. (2001). Informing and evaluating a metadata initiative: Usability and metadata studies in Minnesota’s Foundations Project. Government Information Quarterly, 18(3), 181-194.

Quijano-Solís, Á., & Novelo-Peña, R. (2005). Evaluating a monolingual multinational digital library by using usability: An exploratory approach from a developing country. International Information & Library Review, 37(4), 329-336.

Reeves, T., C., Buhr, S., & Barker, L. (2005). Evaluating digital libraries. Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries, 420. Retrieved December 23, 2005, from ACM Digital Library database.

Roda, C., Borel, A. M., Gentchev, E., & Thomas, J. (2005). Digital image library development in academic environment: Designing and testing usability. OCLC Systems & Services, 21(4), 264-284.

Sairamesh, J., Nikolaou, C., Ferguson, D., & Yemini, Y. (1996). Economic framework for pricing and charging in digital libraries. D-Lib Magazine, 2(2). Retrieved May 17, 2002, from http://www.dlib.org/dlib/february96/forth/02sairamesh.html.

Saracevic, T. (1995). Evaluation of evaluation in information retrieval . Proceedings of the Association for Computing Machinery Special Interest Group on Infomration Retrieval (ACM/SIGIR). (pp. 138-146). 18^th Annual International Conference on Research and Development in Information Retrieval, July 9-13, Seattle, WA. New York: ACM.

Saracevic, T. (2000). Digital library evaluation: Toward an evolution of concepts. Library Trends, 49(2), 350-369. Available at http://scils.rutgers.edu/~tefko/LibraryTrends2000.pdf

Saracevic, T. (2004). Evaluation of digital libraries: An overview. Presented at the DELOS Workshop on the Evaluation of Digital Libraries. Retrieved May 9, 2006, from http://www.scils.rutgers.edu/~tefko/DL_evaluation_Delos.pdf

Saracevic, T., & Dalbello, M. (2001). A survey of digital library education. Proceedings of the American Society for Information Science and Technology, 38, 209-223.

Schwartz, C. (2000). Digital libraries: An overview. Journal of Academic Librarianship, 26(6), 385-393.

Shiaw, H. Y., Jacob, R. J. K., & Crane, G. R. (2004). The 3D Vase Museum: A new approach to context in a digital library. Proceedings of the 4th ACM/IEEE-CS Joint Conference on Digital Libraries, 125-134. Retrieved December 23, 2005, from ACM Digital Library database.

Shim, W., & Kantor, P. B. (1998). A novel economic approach to the evaluation of academic research libraries. Retrieved September 24, 2002, from http://scils.rutgers.edu/ci/aplab/reports/dea_asis98.html

Shim, W., & Kantor, P. (1999). Evaluation of digital libraries: A DEA approach. Proceedings of the 62^nd ASIS Annual Meeting, 36, 605-615.

Sistla, A. P., Wolfson, O., Yesha, Y., & Sloan, R. H. (1999). Towards a theory of cost management for digital libraries and electronic commerce. ACM Transactions on Database Systems, 23(4), 411-452.

Snead, J. T., Bertot, J. C., Jaeger, P. T., & McClure, C. R. (2005). Developing multi-method, iterative, and user-centered evaluation strategies for digital libraries: Functionality, usability, and accessibility. Paper presented at 2005 Annual Meeting of the American Society for Information Science & Technology. Retrieved March 9, 2006, from http://www.ii.fsu.edu/presentation/digilib_asist2005.pdf

Snowhill, L. (2001, July/August). E-books and their future in academic libraries. D-Lib Magazine, 7(7/8). Retrieved August 21, 2002, from http://www.dlib.org/dlib/july01/snowhill/07snowhill.html

Suleman, H., & Fox, E. A. (2001, December). A framework for building open digital libraries. D-Lib Magazine, 7(12). Retrieved August 15, 2002, from http://www.dlib.org/dlib/december01/suleman/12suleman.html

Sumner, T., Giersch, S., & Jones, C. (2003). Steps towards establishing shared evaluation goals and procedures in the National Science Digital Library. Proceedings of the 3rd ACM/IEEE-CS Joint Conference on Digital Libraries, 407. Retrieved December 23, 2005, from ACM Digital Library database.

Sumner, T., Khoo, M., Recker, M., & Marlino, M. (2003). Understanding educator perceptions of “quality” in digital libraries. Proceedings of the 3rd ACM/IEEE-CS Joint Conference on Digital Libraries, 269-279. Retrieved December 23, 2005, from ACM Digital Library database.

Sumner, T., & Marlino, M. (2004). Digital libraries and educational practice: A case for new models. Proceedings of the 4th ACM/IEEE-CS Joint Conference on Digital Libraries, 170-178. Retrieved December 23, 2005, from ACM Digital Library database.

Talbot, D., Lowell, G. R., & Martin, K. (1998). From the user’s perspective – The UCSD libraries user survey project. Journal of Academic Librarianship, 24(5), 357-364.

Thong, J. Y. L., Hong, W., & Tam, K. Y. (2004). What leads to user acceptance of digital libraries? Communications of the ACM, 47(11), 79-83.

Unruh, K. T., Pettigrew, K. E., Durrance, J. C. (2002). Evaluation of digital community information systems. Proceedings of the 2nd ACM/IEEE-CS Joint Conference on Digital Libraries, 240-241. Retrieved December 23, 2005, from ACM Digital Library database.

Wolfram, D., & Xie, H. (2002). Traditional IR for web users: A context for general audience digital libraries. Information Processing and Management, 38, 627-648.

Xie, H. I. (2006). Evaluation of digital libraries: Criteria and problems from users' perspectives. Library & Information Science Research, 28(3), 433-452.

Yang, S. C. (2001). An interpretive and situated approach to an evaluation of Perseus digital libraries. Journal of the American Society for Information Science and Technology, 52 (14), 1210-1223.

Zahray, W. P., & Sirbu, M. (1989/90). The provision of scholarly journals by libraries via electronic technologies: An economic analysis. Information Economics and Policy, 4, 127-154.

Zhang, Y., Jeng, J., & Li, Y. (2004). IFLA FRBR as user-centered metadata evaluation framework for Moving Image Collections. Proceedings of the 67th Annual Meeting of the American Society for Information Science and Technology, v. 41, November 13-18, 2004, Providence, RI. Available at: http://www.asis.org/Conferences/AM04/posters/259.doc