Rice logo


About CODE

Members

Schedule & Agendas

Minutes & Communications


CODE Resources

Strategic Plans at Rice

Presentations

Questions & Tools

Digital Library Initiative

Possible Speakers
[CODE only]

Possible Visits
[CODE only]


General Resources

Technology Planning at Peer Institutions

Centers for Technology in Education:
brief records
longer records

IT Testbeds

Broadband Collaborative Applications

Evaluating Educational Technology

Emerging Technology

Scholarship in the Digital Era

Related Readings


Contact CODE

code_logo

Information Technology Testbeds


Evaluation of emerging educational technologies takes place in major universities, but it seems to be more isolated among computer science departments and divisions of academic computing than focused at a center or institute. Yet manufacturing, commerce, and government have developed their own institutes to study emerging technologies, and the rise of distance education has prompted efforts such as the Advanced Distributed Learning Network (ADLNet), which promotes computer-based learning by developing standards and facilitates collaborations.


Government-Sponsored Initiatives

  • The National Science Foundation has undertaken major initiatives in computer science, including:

    • usability research through the Division of Information and Intelligent Systems

    • the Innovation and Organizational Change program, which "supports research using theory combined with empirical validation to expand the concepts, models, and methodologies of change in organizations and institutions."

    • Partnerships for Innovation, which supports collaboration between academia, the private sector, and government. The program aims to "catalyze Partnerships for Innovation that will enable the transformation of knowledge created by the national research and education enterprise into innovations that create new wealth, build strong local, regional and national economies and improve the national well-being; broaden the participation of all types of academic institutions and all citizens in NSF activities to more fully meet the broad workforce needs of the national innovation enterprise; and create enabling infrastructure necessary to foster and sustain innovation in the long-term."

    • the Knowledge and Distributed Intelligence program, which "aims to achieve, across the scientific and engineering communities, the next generation of human capability to generate, model, and represent more complex and cross-disciplinary scientific data from new sources and at enormously varying scales; to transform this information into knowledge by combining and analyzing it in new ways; to deepen our understanding of learning and intelligence in natural and artificial systems; to explore the cognitive, ethical, educational, legal, and social implications of new types of learning, knowledge, and interactivity; and to collaborate in sharing knowledge and working together interactively."

    • the Science and Technology Centers Program, which supports the founding of new interdisciplinary research centers. The program aims to "fund important basic research and education activities and to encourage technology transfer and innovative approaches to interdisciplinary activities. The STCs explore new areas and build bridges among disciplines, institutions, and other sectors. They offer the research community an effective mechanism to: embark upon long-term scientific and technological research activities; explore better and more effective ways to educate students; and develop mechanisms to ensure the timely transition of research and education advances made into service in society."

    • Information Technology Research, "a proposed $366 million FY 2000 multiagency Federal information technology (IT) research and development." It supports long-term research into software, human-computer interaction, the information infrastructure, and high-end computing, as well as advanced computing and the impacts of the Information Revolution.

    • the Next Generation Software initiative, which "will support research for methods and tools leading to the development of performance frameworks for modeling, measurement, analysis, evaluation and prediction of performance of complex computing and communications systems, and of the applications executing on such systems."

    Note: Some of these grant programs have expired.

  • National Partnership for Advanced Computation Infrastructure

    Over 50 universities are involved in PACI, which is constructing the country's next-generation information and computational infrastructure, the PACI Grid. "The Grid is creating a powerful, seamless, integrated computational problem-solving environment for collaborative, multidisciplinary work on a national scale." PACI's projects include bioinformatics, scalable visualization, telescience, interaction environments, and education (see EOT-PACI on the education page). Among PACI's institutional partners are UCSD, Caltech, Texas, Virginia, Michigan, Stanford, and many others.

  • Advanced Distributed Learning Network (ADLNet)

    The ADL was launched in 1997 by the Department of Defense (DoD) and the White House Office of Science and Technology Policy (OSTP). The ADL initiative aims "to accelerate large-scale development of dynamic and cost-effective learning software and to stimulate an efficient market for these products in order to meet the education and training needs of the military and the nation's workforce in the 21st century. It will do this through the development of a common technical framework for computer and net-based learning that will foster the creation of reusable learning content as 'instructional objects.'" One of the ADL's first projects was the Instructional Management System project (see below). The ADL's strategy is to:

    • "Pursue emerging network-based technologies
    • Facilitate development of common standards
    • Lower development costs
    • Promote widespread collaboration that satisfies common needs
    • Enhance performance with next-generation learning technologies
    • Work with industry to influence commercial off-the-shelf (COTS) product development"

    ADL's current projects include: Sharable Courseware Object Reference Model (SCORM), "a reference model that defines a Web-based learning 'content model"; Total Force Advanced Distributed Learning Action Team, which focuses on delivering high-quality learning to Defnese Department employees; and the Co-Laboratories, which will "provide an open, collegiate environment for (1) testing, evaluating, and demonstrating technical and functional capabilities of ADL tools and prototypes and (2) sharing data, information, and lessons learned with DoD components, government agencies, and the private sector."

    Currently the ADL is involved with 3 co-labs--government-based labs in in Alexandria, Virginia and in Orlando, Florida, and a lab co-sponsored with the University of Wisconsin (see below). Five other universities are participating in the partnership: Pennsylvania State University, the Rochester Institute of Technology, the University of California-Berkeley, the University of Nebraska, and the University of Washington.

  • National Center for Supercomputing Applications (NCSA), Performance Analysis Group

    NCSA, one of the five original centers funded by the NSF's Supercomputer Centers program, has established itself as a leader in implementing "experimental supercomputing and high-performance computing systems and networks and for developing innovative applications in high-performance computing, visualization, and desktop software." The Performance Analysis Group conducts performance experiments and disseminates benchmarking results.


Government-Sponsored Organizations

  • National Institute of Standards and Technology, Information Technology Laboratory (ITL)

    "The Information Technology Laboratory (ITL) responds to industry and user needs for objective, neutral tests for information technology. These are the enabling tools that help companies produce the next generation of products and services, and that help industries and individuals use these complex products and services. ITL works with industry, research and government organizations to develop and demonstrate tests, test methods, reference data, proof of concept implementations and other infrastructural technologies.... ITL's activities support the development and use of information technology systems that are usable, scalable, interoperable and secure. Program activities include: high performance computing and communications systems; emerging network technologies; access to, exchange, and retrieval of complex information; computational and statistical methods; information security; and testing tools and methods to improve the quality of software."

  • National Advanced Manufacturing Testbed

    "The NAMT vision focuses on creating a distributed facility that can be shared with industry, academia, and other government agencies and within NIST. The NAMT testbed is meant to be an information based collaboratory that facilitates joint research, training, and demonstrations among NIST and its partners and customers. The testbed computing and communications infrastructure is central to these goals of externalizing and leveraging the unique resources and capabilities of the NAMT.... the NAMT should evolve towards new communications technologies and computing environments that are emerging out of the Internet networking and collaboration research communities." As the name implies, the center is focused upon the needs of the manufacturing community rather than the educational; projects include the virtual cybernetic building testbed, tele-calibration of gas-flow meters, Verification of Information Technology (IT) Solutions for Small and Medium Size Manufacturing Enterprises (SMEs), and Use of Next Generation Internet (NGI) and Intelligent Collaboration and Visualization (ICV) Technologies to Build NAMT Collaboratories.

  • Pennsylvania Education Network Link to Learn: Technology Assessment and Documentation Group

    The Technology Assessment and Documentation group has conducted a major study of technology needs and resources in Pennsylvania. The study aimed

    • "To assess the current technological infrastructure and related resources of the Commonwealth of Pennsylvania in terms of what is available in the education, business and governmental sectors. This includes quantitative as well as qualitative character istics of these resources.
    • To build an architectural model of what is required to meet the shared vision of what capabilities and capacities will be needed for the 21st century for Pennsylvania.
    • To determine how current technological and related resources can be integrated and utilized to meet the requirements of the architectural model.
    • To provide a readily accessible and current database of technological and related resources in the Commonwealth for analysis, modeling and reporting purposes. "

  • The Texas State Technology Assessment Center evaluates new and competing technologies for state governmental agencies. It promotes open standards, examines emerging technologies, analyzes how to integrate emerging technologies with existing systems, and promotes technologies that facilitate communication between citizens and government. The focus of the center seems to be providing research for state agencies.


Incubators

  • University of California Digital Media Innovation Program (DiMI)

    This is a description of a new conference series sponsored by the University of California System and corporate underwriters, bringing together research faculty, business entrepreneurs, industry, venture capitalists, technology leaders, and visionaries. I don't know of another undertaking that has this scope and educational backing; the goal is to foster creative collaboration to strengthen the digital economy of California. The model might be one to emulate in Houston. (ch)


Technology Testbeds at Universities

  • University of Michigan, Center for Information Technology Integration

    This applied research and development center focuses on integrating new technologies into the university environment. Projects include: smart cards, linux scalability, security, and authenticated quality of service.

  • Drexel University, vCATI: Virtual Center for Applied Technology Integration

    Part of the Office of Information Resources and Technology, vCATI promotes an academic integrated technological architecture through its research and development activities. "vCATI is a virtual organization without walls, it has no full-time assigned employees, but instead depends on collaboration for the initiation, development, and implementation of next generation integrative technology and associated educational applications. Current participants include Drexel's Engineering Core Curriculum Multimedia Laboratory (John Morris), DUTV (George McCollough), Campus Computing Infrastructure (Ken Blackney), Instructional Technology Support (Jan Biros) and New Technologies and Innovation (Ken Blackney). External participants to date include visiting experts (Jean-Francois Desnos, Joseph Fourier University, Grenoble), WHYY, and the Sarnoff Corporation" (http://www.drexel.edu/irt/irtorg/vcati/vcati.html). Initiatives include: Academic Architecture Initiative, WEB/Television Integration Initiative, EUNIS (European University Information Systems Organization), and Center for Educational Research and Development in Biomedical Engineering. The Center seems to focus on Drexel's specific needs and programs, such as wireless technologies and the Drexel information infrastructure.

    The Drexel IT division also has an Assistant for New Technology and Innovation who is responsible for researching "technologies applicable to Drexel and lead[ing] initiatives to integrate appropriate technologies into the existing computing and curricular framework at Drexel."

  • Drexel University's The Knowledge Management Collaboratory "is envisioned to be a national center focused on the information dynamics of business. It will leverage the considerable IT capabilities within the College of Information Science and Technology with key industrial and academic partners. The KMC will: Develop and deliver cutting-edge education for students and faculty and training for industry; Conduct applied research; Host demonstration projects; Provide discovery usability testing facilities." This is new center, so it doesn't seem to have delivered many results yet; seems to be focused more on business than education.

  • University of Wisconsin, Advanced Distributed Learning Co-Laboratory

    Founded by the University of Wisconsin and the Department of Defense in 2000, the ADL Co-Laboratory will research, develop, and evaluate web-based learning technologies. See the announcement of the Co-Laboratory's founding in the UW's Newsletter from February of 2000 and the ADL Co-Lab working paper. Proposed projects include: Compliance testing/evaluation of tools by technical staff and faculty; Demonstration/showcase/seminars on learning technologies products, software and services; Interoperable Learning Management System(s); Wireless; Federal Learning Technology Resource Center; and so forth.

  • Internet2 Technology Evaluation Center (ITEC) aims "to act as an evaluation center for technologies, components and services being considered for Internet 2," and to "promote the continued development of high-performance communications infrastructure in Ohio and the rest of the country." This partnership, founded in 1999 by the OARNet, involves Ohio universities such as Ohio State and Case Western and corporations such as Qwest and Pacific Northwest National Laboratory. Through its research into high-performance networks, ITEC hopes to facilitate "distance learning, tele-medicine, massive digital libraries, distributed computing, virtual laboratories, and much more." It will also establish the "Abilene Interoperability Lab to measure and facilitate interoperability between different hardware and software systems and vendors. This national evaluation and emerging technology facility will provide the Abilene project with a sound test bed for emerging technology in a non-production environment."

  • University at Albany/State University of New York, Center for Technology in Government

    The Center for Technology in Government serves as a testbed for technologies relevant to government. The Center's mission is "to reduce the costs and improve the quality of government services, reduce the risks of innovation, and share our project results throughout the public sector." Not only does the Center evaluate emerging technologies, but it builds prototype systems and disseminates its research. The Center has established partnerships with 50 high-tech companies, over a hundred state and local governmental agenices, and over a dozen academics. The Center aims to help managers make intelligent decisions about IT; towards this end, it makes available Making Smart IT Choices, which explains the Center's approach to evaluating IT.

  • NetLib, a partnership between AT&T Bell Laboratories, the University of Tennessee, and Oak Ridge National Laboratory, is a repository for computer science and mathematical articles and software. It features the Performance Database Server, which offers "an on-line catalog of public-domain computer benchmarks." NetLib also hosts the Linpack Benchmark -- Java Version, "a numerically intensive test that has been used for years to measure the floating point performance of computer," and it provides access to BenchWeb, "a starting point for finding information about computer system performance benchmarks, benchmark results, and benchmark code." See the article about Netlib in Dlib, September 1995.

  • University of Southern California, Center for Advanced Research in Technology for Education (CARTE)

    CARTE, part of USC's Information Sciences Institute, focuses on creating, evaluating, and deploying new technologies for education, particularly pedagogical agents and intelligent assistants.

  • Georgia Tech, Test & Evaluation Research and Education Center (TEREC)

    This Center, which is mainly focused on Defense Department projects, provides methodologies for measuring the operational impact of systems, developing and testing new telecommunications products, integrating modeling and testing, and so forth.

  • University of Virginia, Center for Information Modeling and Evaluation (Scroll down to the bottom of the page to find information about the Center.)

    Funded through grants by industry and government, the Center locates technologies appropriate for the needs and aims of their clients. The Center offers:

    • "Evaluation of competing software solutions.
    • Prototyping and testing of new approaches in areas such as information fusion, data mining, data warehousing, neural nets, and expert systems.
    • Rapid simulation of high-investment software system alternatives.
    • Technology transfer of the latest university research.
    • Training and education in advanced approaches to integration and performance evaluation of complex information technologies."


Related Resources

  • The IEEE Learning Technology Standards Committee

    The Learning Technology Standards group aims to "develop technical Standards, recommended practices, and guides for software components, tools, technologies and design methods that facilitate the development, deployment, maintenance and interoperation of computer implementations of education and training components and systems." Projects include emerging standards for student identifiers, learning objects metadata, and computer managed instruction. Its efforts are related to those of the ISO group on Learning Technology.

  • IMS Global Learning Consortium

    Launched by EDUCAUSE in 1997, IMS is developing "the next-generation open architecture for online learning." IMS facilitates online learning by defining the technical standards that will make educational technologies interoperable. A consortium of government organizations, over 1,600 colleges and universities, and 150 corporations, IMS has released or is developing standards relevant to administrative applications, metadata for learning resources, content and packaging specifications, and learner profiles.


Home URL: < http://www.rice.edu/projects/code >
Copyright © 2000 by CODE.
Last updated September 26, 2000 by Lisa Spiro for CODE (Committee on the Digital Environment at Rice University).