%0 Conference Paper
%B Proceedings IV2023 - 27th International Conference on Information Visualisation
%D 2023
%T Interactive Network Visualization of Educational Standards, Learning Resources and Learning Progressions
%A Reitsma,Reindert
%A Hoglund,Brian
%A Achatz,Nikolas
%A Marks,Andrea
%K BIS
%K Design Program
%X We present a novel, network- and browser-based visualization of the Next Generation Science Standards (NGSS). The NGSS are meant to guide (USA) K-12 science and engineering learning and are almost always presented using text and tables. Their connectivity, however, lends them well for network modeling and interactive network visualization.<br><br>
%B Proceedings IV2023 - 27th International Conference on Information Visualisation
%8 2023
%G eng
%2 b
%4 256122902528
%$ 256122902528

%0 Audiovisual Material
%D 2022
%T NGSS Explorer (Curriculum Network Visualization)
%A Reitsma,Reindert
%A Hoglund,Brian
%A Achatz,Nikolas
%K BIS
%8 2022
%G eng
%U https://www.teachengineering.org/ngss_explorer
%2 d
%4 253092712448
%$ 253092712448

%0 Book
%D 2022
%T A Tale of Two Systems. A Review of the architecting and re-architecting of a long-lived website; (2nd edition)
%A Reitsma,Reindert
%A Krueger,Kevin
%K BIS
%8 2022
%G eng
%U https://open.oregonstate.education/taleoftwosystems/
%2 d
%4 158829608960
%$ 158829608960

%0 Book Section
%D 2021
%T Breadcrumbs
%A Reitsma,Reindert
%K BIS
%X Reflections on the work and contributions of Dr. Paul Hendriks, Professor of Knowledge Management at Radboud University, Nijmegen, The Netherlands.
%C Nijmegen
%8 2021
%G eng
%2 d
%4 233150005248
%$ 233150005248

%0 Conference Paper
%B American Society for Engineering Education (ASEE)
%D 2020
%T K-12 Engineering and the Next Generation Science Standards (NGSS): A Network Visualization and Analysis
%A Reitsma,Reindert
%A Hoglund,Brian
%A Marks,Andrea
%A Chaker,Dua
%A Marks,Andrea
%K BIS
%K Design Program
%X We present an interactive network visualization of the Next Generation Science Standards (NGSS) and its coverage by collections of aligned curriculum. The visualization presents an alternative to the usual presentation of the NGSS as a set of linked tables. Users can view entire grade bands, search for or drill down to the level of individual NGSS standards or curricular items, or display groups of standards across grade bands. NGSS-aligned curriculum collections can be switched on and off to visually explore their NGSS coverage. Viewing the NGSS and associated curriculum this way facilitates navigating the NGSS and can help with assessment of alignments as lacking or anomalous. Modeling the NGSS as a network also allows for the computation of network metrics to provide insight into core characteristics of the network. It also provides for detecting anomalies and unexpected patterns.
%B American Society for Engineering Education (ASEE)
%8 2020
%G eng
%U https://strategy.asee.org/k-12-engineering-and-the-next-generation-science-standards-a-network-visualization-and-analysis-resource-exchange
%2 b
%4 202185967616
%$ 202185967616

%0 Journal Article
%J Dialectic
%D 2019
%T The Future of Data: Too Much Visualization — Too Little Understanding?
%A Reitsma,Reindert
%A Marks,Andrea
%K BIS
%K Design Program
%X Data is part of our lives. Information visualizations help us make sense of this data and possibly help us make changes because of it. In this paper, however, we estimate some of the consequences of what seems an ominous trend, namely the needless complication and beautification of such visualizations. We argue that with increased availability of data and ever more powerful and easy to use visualization software, it becomes easy to succumb to the temptation to impress rather than to communicate. And so we wonder: is a future filled with visualizations that are visually complex and stunning, yet fail to properly communicate the data emerging? To assess some of the consequences of this practice we selected five examples from published sources, developed far simpler (and less attractive) versions from the identical data, randomly exposed these visualizations to subjects and asked simple questions about the displayed data. We find that, on average, it takes subjects longer to comprehend the complex versions, that it takes subjects longer to extract information from these versions and that they make more and larger errors doing so. The experiment shows that subjects eventually do learn how to navigate the complex versions, but by then they have spent significantly more time and made serious interpretative errors.
%B Dialectic
%V 2
%8 2019
%G eng
%U https://quod.lib.umich.edu/d/dialectic/14932326.0002.207?view=text;rgn=main
%N 2
%2 a
%4 161824772096
%$ 161824772096

%0 Case
%D 2016
%T BA302: Microsoft Dynamics NAV ERP Exercise/Walkthrough
%A Curry,Michael
%A Marshall,Byron
%A Raja,V.T.
%A Reitsma,Reindert
%A Wydner,Kirk
%K Accounting
%K BIS
%X Whether you enter the workforce as a sales manager, financial accountant or office admin, chances are that you will be working with some type of Enterprise Resource Planning (ERP) system. The purpose of this exercise/walkthrough is to familiarize you with a typical business process as it is commonly executed with the help of one of the leading ERP systems in the market today – Microsoft Dynamics NAV. This exercise will walk you through the six steps of a typical sales process: 1) Creating a customer order; 2) Backordering an out-of-stock item; 3) Receiving the backordered item; 4) Shipping the customer the ordered items and invoicing the customer; 5) Receiving payment from the customer; 6) Making a payment to the vendor from whom we backordered. As you make your way through this exercise, you should realize that in a real company this process would be executed by different people working in different departments. They all will interact with the ERP; i.e., they all retrieve information from the ERP and store new information in it, as the sales process progresses. In this exercise you take on the role of each of these people, giving you a sense of how the sales order is processed both by the company and by the ERP.
%P 25
%8 2016
%G eng
%U http://hdl.handle.net/1957/59858
%2 d
%4 134050416640
%$ 134050416640

%0 Journal Article
%J Information Visualization
%D 2016
%T Map? or List?based Recommender Agents? Does the Map Metaphor Fulfill its Promise?
%A Reitsma,Reindert
%A Hsieh,Ping-Hung
%A Diekema,Anne
%A Robson,Robby
%A Zarsky,Malinda
%K BIS
%K Supply Chain
%X We present a spatialization of digital library content based on item similarity and an experiment which compares the performance of this spatialization relative to a simple list-based display. Items in the library are K-12 science and engineering learning resources. Spatialization and visualization are accomplished through 2D interactive Sammon mapping of pairwise item similarity scores based on the joint occurrence of word bigrams. The 65 science teachers participating in the experiment were asked to search the library for curricular items they would consider using in conducting one or more teaching assignments. Results indicate that whereas the spatializations adequately capture the salient features of the library’s content and teachers actively use them, item retrieval rates, task-completion time and perceived utility do not significantly differ from the semantically poorer but easier to comprehend and navigate list-based representations. These results put into question the usefulness of the rapidly increasing supply of information spatializations.
%B Information Visualization
%V 16
%P 291-308
%8 2016
%G eng
%U http://journals.sagepub.com/doi/abs/10.1177/1473871616669193
%2 a
%4 127142455296
%$ 127142455296

%0 Conference Paper
%B Joint Conference on Digital Libraries
%D 2016
%T Unraveling K-12 Standard Alignment; Report on a New Attempt
%A Marshall,Byron
%A Reitsma,Reindert
%A Samson,Carleigh
%K Accounting
%K BIS
%X We present the results of an experiment which indicates that automated alignment of electronic learning objects to educational standards may be more feasible than previously implied. We highlight some important deficiencies in existing alignment systems and formulate suggestions for improved future ones. We consider how the changing substance of newer educational standards, a multi-faceted view of standard alignment, and a more nuanced view of the ‘alignment’ concept may bring the long-sought goal of automated standard alignment closer. We explore how lexical similarity of documents, a World+Method representation of semantics, and network-based analysis can yield promising results. We furthermore investigate the nature of false positives to better understand how validity of match is evaluated so as to better focus future alignment system development.
%B Joint Conference on Digital Libraries
%8 2016
%G eng
%2 b
%4 127038310400
%$ 127038310400

%0 Conference Paper
%B Intern. Conf. on Inf. Systems (ICIS) 2015
%D 2015
%T Estimation and Visualization of Digital Library Content Similarities
%A Reitsma,Reindert
%A Hsieh,Ping-Hung
%A Robson,Robby
%K BIS
%K Supply Chain
%X We report on a process for similarity estimation and two-dimensional mapping of lesson materials stored in a Web-based K12 Science, Technology, Engineering and Mathematics (STEM) digital library. The process starts with automated removal of all information which should not be included in the similarity estimations followed by automated indexing. Similarity estimation itself is conducted through a natural language processing algorithm which heavily relies on bigrams. The resulting similarities are then used to compute a Sammon-map; i.e., a projection in n dimensions, the item-to-item distances of which best reflect the input similarities. In this paper we concentrate on specification and validation of this process. The similarity results show almost 100% precision-by-rank in the top three to five ranks. Sammon mapping in two dimensions corresponds well with the digital library‘s table of content.
%B Intern. Conf. on Inf. Systems (ICIS) 2015
%8 2015
%G eng
%2 b
%4 105616928768
%$ 105616928768

%0 Conference Paper
%B ASEE 2015 Annual Conference
%D 2015
%T The Relevance of K-12 Engineering Curricula to NGSS: an Analysis of TeachEngineering-NGSS Alignments
%A Reitsma,Reindert
%A Samson,Carleigh
%A Soltys,Mike
%A Sullivan,Jacquelyn
%K BIS
%X The 2013 publication of the Next Generation Science Standards (NGSS) provided the first widely adopted set of science standards to include engineering design throughout all K-12 grades. In doing so, NGSS raised the relevance of the K-12 engineering education sector on a national scale. The TeachEngineering digital library, representative of the K-12 engineering education sector through its collaboration of 36, mostly NSF-funded, K-12 engineering education programs across the US, recently aligned its 1,300+ K-12 engineering lessons and hands-on activities to the NGSS. This paper provides analysis of both the alignment process and its results. As such, we offer insight into the correspondence between the NGSS and a broad, collection of K-12 engineering learning objects and hence, into the mutual relevance of K-12 engineering curriculum and the NGSS. We also provide some recommendations for future K-12 engineering curriculum development.
%B ASEE 2015 Annual Conference
%8 2015
%G eng
%2 b
%4 105617211392
%$ 105617211392

%0 Generic
%D 2015
%T Workshop: TeachEngineering Digital Library: Hundreds of Free, Searchable, NGSS-aligned Hands-on Engineering Lessons for K-12
%A Reitsma,Reindert
%A Zarske,Malinda
%A Yowell,Janet
%A Samson,Carleigh
%K BIS
%B ASEE Annual Conference 2015
%C Seattle, WA
%8 2015
%G eng
%2 c
%4 102487447552
%$ 102487447552

%0 Generic
%D 2012
%T Business Process Management
%A Reitsma,Reindert
%A Van Patten,Mark
%A Baker,Mark
%A Coogan,Chris
%K BIS
%B 2012 Portland CIO Forum
%C Portland, OR
%8 2012
%G eng
%2 c
%4 63034542081
%$ 63034542081

%0 Journal Article
%J Journal of the Association for Information Science and Technology
%D 2012
%T Can Intermediary-based Science Standards Crosswalking Work? Some Evidence from Mining the Standard Alignment Tool (SAT)
%A Reitsma,Reindert
%A Marshall,Byron
%A Chart,Trevor
%K Accounting
%K BIS
%X We explore the feasibility of intermediary-based crosswalking and alignment of K-12 science education standards. With increasing availability of K-12 science, technology, engineering and mathematics (STEM) digital library content, alignment of that content with educational standards is a significant and continuous challenge. Whereas direct, one-to-one alignment of standards is preferable but currently unsustainable in its resource demands, less resource-intensive intermediary-based alignment offers an interesting alternative. But will it work? We present the results from an experiment in which the machine-based Standard Alignment Tool (SAT) —incorporated in the National Science Digital Library (NSDL)— was used to collect over half a million direct alignments between standards from different standard-authoring bodies. These were then used to compute intermediary-based alignments derived from the well-known AAAS Project 2061 Benchmarks and NSES standards. Results show strong variation among authoring bodies in their success to crosswalk with best results for those who modeled their standards on the intermediaries. Results furthermore show a strong inverse relationship between recall and precision when both intermediates where involved in the crosswalking.
%B Journal of the Association for Information Science and Technology
%V 63
%P 1843-1858
%8 2012
%G eng
%U http://people.oregonstate.edu/~marshaby/Papers/ReitsmaMarshallChart_StandardsCrosswalking_JASIST2012.pdf
%2 a
%4 43025678337
%$ 43025678337

%0 Conference Paper
%B Proceedings 2nd P-12 Engineering and Design Education Research Summit
%D 2012
%T The TeachEngineering Digital Library:  Improving Access to the P-12 Engineering Conversation
%A Reitsma,Reindert
%A Zarske,M.
%A Sullivan,J.
%A Klenk,P.
%A Forbes,M.
%A Carlson,D.
%K BIS
%X The TeachEngineering digital library is a collection of searchable, standards-based, classroom-tested P-12 engineering curricula for use in science and math classrooms (Sullivan et al., 2005). Its inquiry-based lessons and hands-on activities use real-life engineering as a vehicle for the integration of science and math in P-12 classrooms. Mapped to educational content standards, the activities are age-appropriate, inexpensive to conduct, and relevant to students’ daily lives, helping science and math come alive. The collection is a powerful resource for those in P-12 or higher education, industry and professional communities wanting to improve STEM literacy, to engage young students in the joys and creativity of engineering and the design process, and to increase the number of students pursuing STEM careers.<br>This paper investigates TeachEngineering usage trends and curricular submission statistics. Specifically, we analyze the submission process for curriculum contributed from external authors, suggest practices for submitting new curriculum, and discuss possible support avenues for future submissions.
%B Proceedings 2nd P-12 Engineering and Design Education Research Summit
%8 2012
%G eng
%2 b
%4 50961645568
%$ 50961645568

%0 Journal Article
%J International Journal on Digital Libraries
%D 2011
%T Comparison of Human and Machine-based Educational Standard Assignment Networks
%A Reitsma,Reindert
%A Diekema,Anne R
%K BIS
%X Increasing availability of digital libraries of K-12 curriculum resources, coupled with an increased emphasis on standard-based teaching necessitates assignment of the standards to the available curriculum. Since such assignment is a laborious and ongoing task, machine-based standard assignment tools have been under development for some time. Unfortunately, data on the performance of these machine-based classifiers are mostly lacking. In this paper we explore network modeling and layout to gain insight into the differences between human assignments and those by one of the better known machine-based classifiers. To build the standard assignment networks we define standards to be linked if they are jointly assigned to the same curricular item. Comparative analysis of the mapped networks shows that that unlike the machine-based assignment maps, the human-based maps elegantly reflect the rationales and principles of the assignment; i.e., clusters of standards separate along lines of lesson content and pedagogical principles. In addition, comparison of the maps clearly indicates that the machine classifier has trouble assigning so-called 'method' standards.
%B International Journal on Digital Libraries
%V 11
%P 209-223
%8 2011
%G eng
%2 a
%4 26462951425
%$ 26462951425

%0 Journal Article
%J Communications of the IIMA
%D 2011
%T Organizational Information Technology Norms and IT Quality
%A Marshall,Byron
%A Curry,Michael
%A Reitsma,Reindert
%K Accounting
%K BIS
%X The effectiveness of IT governance initiatives in improving IT’s contribution to organizational success has been demonstrated but the mechanisms by which improved outcomes are realized have largely remained unexplored. Although IT governance tools such as COBIT and ITIL specify procedures and policies for the management of IT resources, the experts who developed those tools also embedded a set of core principles or ‘norms’ in the underlying frameworks. This article explores these norms and their role in the realization of organizational IT quality. Through analysis of normative messages implicitly expressed in the documentation elements provided by COBIT, we extract two norms (commitment to improvement and a risk/control perspective) thought to indicate that an organization has adopted the spirit of IT governance. Next, we model the relationship between adoption of these norms and IT quality and evaluate the model with data from a survey of 86 individuals who use, manage, and/or deliver organizational IT services. Principal component analysis is used to validate the survey items. Results show statistically significant relationships between norm adoption, participation in norm-driven activities, and organizational IT quality.
%B Communications of the IIMA
%V 11
%8 2011
%G eng
%U http://www.iima.org/index.php?option=com_phocadownload&view=category&id=60:2011-volume-11-issue-4&Itemid=68
%N 4
%2 a
%4 40795119617
%$ 40795119617

%0 Conference Paper
%B Proceedings of the Joint Conference on Digital Libraries (JCDL'11),Ottawa, Canada.
%D 2011
%T World vs. Method: Educational Standard Formulation Impacts Document Retrieval
%A Marshall,Byron
%A Reitsma,Reindert
%K Accounting
%K BIS
%X Although initiatives are underway in the educational community to consolidate disparate collections of educational standards, little has been done to explore the impact of educational standard formulation on information retrieval. Recent research contrasts two categories of educational standards: ‘World’ (topical domain-related concepts) and ‘Method’ (investigative and epistemological principles). This paper explores the information retrieval implications of the World vs. Method distinction. We find that experts are more likely to agree about which educational resources align with a Method standard but that a typical automatic standard assignment tool is more likely to assign a World standard to an educational resource. Further, a text-based information retrieval system is more likely to be accurate in retrieving documents relevant to a World standard as compared to a Method standard. These findings have implications both for educational standard formulation (combining World and Method components in a standard may improve retrieval) and for digital library builders who want to help teachers identify useful, standards-aligned learning objects.
%B Proceedings of the Joint Conference on Digital Libraries (JCDL'11),Ottawa, Canada.
%8 2011
%G eng
%2 b
%4 33636190209
%$ 33636190209

%0 Conference Paper
%B Am. Soc. of Engr. Education (ASEE) Annual Conf. 2010
%D 2010
%T Are French Fries and Grades Bad for You?  Conflicting Evidence on how K-12 Teachers Search in a K-12 Engineering Digital Library
%A Reitsma,Reindert
%A Klenk,P.
%A Zarske,M.
%A Sullivan,J.
%K BIS
%X The TeachEngineering digital library provides teacher-tested, standards-based engineering content for K-12 teachers to use in science and math classrooms. Since its release in 2005, it has demonstrated significant growth in users and in contributors; data on this growth is presented. The TeachEngineering team continues to research its search functions and user interface in order to ensure that it is meeting the needs of its intended users, K-12 teachers. Empirical evidence of an experimental study on the dimensions of alignment between digital K-12 lesson materials and education standards, however, contradicts that of the observed search behavior of patrons of TeachEngineering. Whereas the experiment convincingly shows that grade band information does not add to the teaching materials’ relevance for an educational standard, observed patrons’ searching patterns show ample evidence of grade band-based searches. In this paper we offer that although grade band-based searches should perhaps be avoided because they improperly bias search results, they are such a prominent feature in the actual use of the digital library that as designers we must support them while mitigating the risk of unfortunate search bias. As a possible solution we suggest supporting grade-based searches yet offering query expansion by widening the grade band. These results also imply that curriculum developers pay close attention to the assignment of grade bands to their lessons and activities.
%B Am. Soc. of Engr. Education (ASEE) Annual Conf. 2010
%C Louisville, KY
%8 2010
%G eng
%2 b
%4 21031903233
%$ 21031903233

%0 Journal Article
%J Information Processing & Management
%D 2010
%T Aspects of 'Relevance' in the Alignment of Curriculum with Educational Standards
%A Reitsma,Reindert
%A Marshall,Byron
%A Zarske,Malinda
%K Accounting
%K BIS
%X Retrieval of useful digitized learning objects is a key objective for educational digital libraries, but imprecise definitions of alignment hinder the development of effective retrieval mechanisms. With over 63,000 U.S. K-12 science and mathematics education standards and a rapid proliferation of Web-enabled curriculum, retrieving curriculum that aligns with the standards to which teachers must teach is increasingly important. Previous studies of such alignment use single-dimensional and binary measures of relevance. Perhaps as a consequence they suffer from low inter-rater reliability (IRR), with experts agreeing about alignments only some 20-40% of the time. We present the results of an experiment in which the dependent variable ‘alignment’ is operationalized using the Saracevic model of relevance in which; i.e., alignment is defined and measured through ‘clues’ from the everyday practice of K-12 teaching. Results show higher inter-rater reliability on all clues with significantly higher IRR on several specific alignment dimensions. In addition, a (linear) model of ‘overall alignment’ is derived and estimated. Both the structure and explanatory power of the model differ significantly between searching vs. assessment. These results illustrate the usefulness of clue-based relevance measures for information retrieval and have important consequences for both the formulation of automated retrieval mechanisms and the construction of a gold standard set of standard-curriculum alignments.
%B Information Processing & Management
%V 46
%P 362-376
%8 2010
%G eng
%U http://www.sciencedirect.com/science/article/B6VC8-4XF7Y02-1/2/3fd5e4257f3d904d5929eeff2185c678
%N 3
%2 a
%4 12651030529
%$ 12651030529

%0 Conference Paper
%B AAA Annual Meeting, IS Section
%D 2010
%T Does Using CobiT Improve IT Solution Proposals?
%A Marshall,Byron
%A Curry,Michael
%A Reitsma,Reindert
%K Accounting
%K BIS
%X The CobiT (Control Objectives for Information and related Technology) framework is designed to help organizations implement IT governance practices by systematically shaping identifiable IT processes to better leverage IT expenditures. The control structure advocated in CobiT embodies governance notions including business alignment, a risk/control perspective, systematic measurement, accountability, and continuous improvement. Despite the rise of internal control regulation, not all organizations have implemented systematic IT controls and many, notably small, organizations may never do so. This study explores whether exposing decision makers to CobiT positively affects the IT solutions they generate. We present a framework (drawn primarily from the structure of CobiT) for identifying normatively better IT plans as measured by application of governance principles. We report on 115 IT solution proposals created by business students. The proposals developed using CobiT more frequently took a risk/control approach, addressed the need for continuous improvement, referred to general IT processes, identified the people who should implement a solution, and proposed more measures of success. Thus, exposing decision makers to a systematic IT governance framework promises to help them generate more comprehensive solutions to IT challenges.
%B AAA Annual Meeting, IS Section
%8 2010
%G eng
%2 b
%4 16758226945
%$ 16758226945

%0 Conference Paper
%B National Science Digital Library (NSDL) 2010 Annual Meeting
%D 2010
%T Educational Standard Assignment; Some recent findings working with NSDL tools CAT & SAT
%A Reitsma,Reindert
%A Diekema,A.
%K BIS
%X The NSDL suite of tools offers the Content Assignment and Standard Alignment Tools (CAT & SAT). We present two evaluations of these tools; one is a comparative analysis of human vs. CAT standard assignment. Another is the use of a 24M-row database of SAT-based standard alignments. The latter explores the feasibility of standard cross walking
%B National Science Digital Library (NSDL) 2010 Annual Meeting
%8 2010
%G eng
%2 b
%4 33900787713
%$ 33900787713

%0 Generic
%D 2010
%T IT curriculum and critical skills set for effective IT professionals: is there a gap?
%A Reitsma,Reindert
%A Eom,Mike
%A Hootman,J
%K BIS
%B 2010 Portland CIO Forum
%C Portland, OR
%8 2010
%G eng
%2 c
%4 27415453697
%$ 27415453697

%0 Conference Paper
%B 2nd annual Pre‐ICIS Workshop on Accounting Information Systems
%D 2010
%T IT Governance Norms and IT Success
%A Marshall,Byron
%A Curry,Michael
%A Reitsma,Reindert
%K Accounting
%K BIS
%X The checklists included in well-known IT governance frameworks may be a good fit for<br>large organizations that face regulatory pressure and a need for large-scale coordination<br>but may be less appropriate for smaller organizations. Core IT governance principles<br>embedded in the structure of CobiT, ITIL, and ISO2000 can be expressed as a set of IT<br>governance norms including business alignment, a risk/control perspective, systematic<br>measurement, accountability, and continuous improvement. In this study, we model IT<br>effectiveness and willingness to comply with best practices as effects of adopting these<br>norms. We propose a set of survey items tailored to help assess the constructs in this<br>model then partially validate them using principal components analysis. Survey<br>responses (n=86) reveal a significant connection between evidence of norm adoption in<br>organizations and IT success. This norms-based paradigm may be useful in bringing<br>some of the benefits of IT governance to the smaller organizations that are thought to<br>drive economic growth and employment.
%B 2nd annual Pre‐ICIS Workshop on Accounting Information Systems
%C December 2010, Saint Louis, MO, U.S.A.
%8 2010
%G eng
%2 b
%4 31898748929
%$ 31898748929

%0 Conference Paper
%B Information Visualization 2010 (IV-10)
%D 2010
%T Network Visualization of Human and Machine-based Educational Standard Assignment
%A Reitsma,Reindert
%A Diekema,A.
%K BIS
%X Rapid growth in the availability of digital libraries of K-12 curriculum, coupled with an increased emphasis on standard-based teaching has led to the development of automated standard assignment tools. To assess the performance of one of those tools and to gain insight into the differences between how human catalogers and automated tools conduct these standard assignments, we explore the use of network modeling and visualization techniques for comparing and contrasting the two. The results show significant differences between the human-based and machine-based network maps. Unlike the machine-based maps, the human-based assignment maps elegantly reflect the rationales and principles of the assignments; i.e., clusters of standards separate along lines of content and pedagogical principles. In addition, humans seem significantly more apt at assigning so-called ‘methodological’ standards.
%B Information Visualization 2010 (IV-10)
%C London
%8 2010
%G eng
%2 b
%4 21412300801
%$ 21412300801

%0 Book Section
%D 2010
%T Web Services
%A Reitsma,Reindert
%K BIS
%X Overview of Web services technology and its use.
%C Hoboken, NJ
%V 3
%P 578-592
%8 2010
%G eng
%2 d
%4 7908530177
%$ 7908530177

%0 Conference Paper
%B Proceedings of the Joint Conference on Digital Libraries (JCDL'09), Austin, TX
%D 2009
%T Dimensional Standard Alignment in K-12 Digital Libraries: Assessment of Self-found vs. Recommended Curriculum
%A Marshall,Byron
%A Reitsma,Reindert
%A Zarske,Malinda
%K Accounting
%K BIS
%B Proceedings of the Joint Conference on Digital Libraries (JCDL'09), Austin, TX
%8 2009
%G eng
%U http://doi.acm.org/10.1145/1555400.1555403
%2 b
%4 12651069441
%$ 12651069441

%0 Generic
%D 2009
%T Navigating the TeachEngineering Resource
%A Reitsma,Reindert
%K BIS
%B NSF TeachEngineering/GK-12 Workshop
%C Boulder, CO
%8 2009
%G eng
%2 c
%4 14032785409
%$ 14032785409

%0 Generic
%D 2009
%T Regionalization of Information Space  with  Capacity-constrained Voronoi Diagrams
%A Reitsma,Reindert
%K BIS
%B Colloquium Geographic Information Science (GIS)
%C Zurich, CH
%8 2009
%G eng
%2 c
%4 14032777217
%$ 14032777217

%0 Generic
%D 2009
%T TeachEngineering: K-12 Teacher Use Study
%A Reitsma,Reindert
%A Marshall,Byron
%K Accounting
%K BIS
%B Special Workshop on TeachEngineering/GK-12 Integration
%C Boulder, CO.
%8 2009
%G eng
%2 c
%4 12650889217
%$ 12650889217

%0 Journal Article
%J Information Visualization
%D 2007
%T Information Space Partitioning Using Adaptive Voronoi Diagrams
%A Reitsma,Reindert
%A Trubin,Stanislav
%K BIS
%X In this paper we present and evaluate a Voronoi method for partitioning continuous information spaces. We define the formal characteristics of the problem and discuss several well-known partitioning methods and approaches. We submit that although they all partially solve the problem, they all have shortcomings. As an alternative, we offer an approach based on an adaptive version of the multiplicatively weighted Voronoi diagram. The diagram is ‘adaptive’ because it is computed backwards; i.e., the generators' weights are treated as dependent rather than independent variables. We successfully test this adaptive solution using both ideal-typical (artificial) and empirical data. Since the resultant visualizations are meant to be used by human subjects, we then discuss the results of a usability experiment, positioning the adaptive solution against a commonly used rectangular solution and the classic nonweighted Voronoi solution. The results indicate that in terms of usability, both the rectangular and the adaptive Voronoi solution outperform the standard Voronoi solution. In addition, although subjects are better able to gage rectangular area relationships, only the adaptive Voronoi solution satisfies all geometric constraints of weight-proportional partitioning.
%B Information Visualization
%V 6
%P 123-138
%8 2007
%G eng
%2 a
%4 649322496
%$ 649322496

%0 Generic
%D 2007
%T Poster Session. Aligning Curriculum with Standards: TeachEngineering, SAT & CAT
%A Reitsma,Reindert
%A Cyr,Martha N.
%A Diekema,Anne
%K BIS
%B National Science Digital Library Annual Meeting
%C Washington, DC
%8 2007
%G eng
%2 c
%4 8579811329
%$ 8579811329

%0 Conference Paper
%B Proceedings of the 7th ACM/IEEE Joint Conference on Digital Libraries, 181-182
%D 2007
%T Semantics or Standards for Curriculum Search?
%A Marshall,Byron
%A Reitsma,Reindert
%A Cyr,Martha N
%K Accounting
%K BIS
%X Aligning digital library resources with national and state educational standards to help K-12 teachers search for relevant curriculum is an important issue in the digital library community. Aligning standards from different states promises to help teachers in one state find appropriate materials created and cataloged elsewhere. Although such alignments provide a powerful means for crosswalking standards and curriculum across states, alignment matrices are intrinsically sparse. Hence, we hypothesize that such sparseness may cause significant numbers of false negatives when used for searching curriculum. Our preliminary results confirm the false negative hypothesis, demonstrate the usefulness of term-based techniques in addressing the false negative problem, and explore ways to combine term occurrence data with standards correlations.
%B Proceedings of the 7th ACM/IEEE Joint Conference on Digital Libraries, 181-182
%C New York, NY
%8 2007
%G eng
%2 b
%4 2606370817
%$ 2606370817

%0 Generic
%D 2007
%T TeachEngineering Poster Session
%A Reitsma,Reindert
%A Vanlue,William
%A Lewis,Paul
%K BIS
%B OSU 2007 National Science Board Site Visit
%8 2007
%G eng
%2 c
%4 2606598145
%$ 2606598145

%0 Journal Article
%J Geoinformatica
%D 2007
%T Weight-proportional Space Partitioning Using Adaptive Voronoi Diagrams
%A Reitsma,Reindert
%A Trubin,S,
%A Mortensen,E.
%K BIS
%X Traditional application of Voronoi diagrams for space partitioning results in Voronoi regions, each with a specific area determined by the generators’ relative locations and weights. Particularly in the area of information space (re)construction, however, there is a need for inverse solutions; i.e., finding weights that result in regions with predefined area ratios. In this paper, we formulate an adaptive Voronoi solution and propose a raster-based optimization method for finding the associated weight set. The solution consists of a combination of simple, fixed-point iteration with an optional spatial resolution refinement along the regions’ boundaries using quadtree decomposition. We present the corresponding algorithm and its complexity analysis. The method is successfully tested on a series of ideal”typical cases and the interactions between the adaptive technique and boundary resolution refinement are explored and assessed.
%B Geoinformatica
%V 11
%P 383-405
%8 2007
%G eng
%N 3
%2 a
%4 649330688
%$ 649330688

%0 Generic
%D 2006
%T TeachEngineering Poster Session
%A Reitsma,Reindert
%A Sullivan,J
%A Cyr,M N
%K BIS
%B National Science Digital Library Annual Meeting
%C Washington, DC
%8 2006
%G eng
%2 c
%4 2606585857
%$ 2606585857

%0 Generic
%D 2005
%T Poster Session. Just a cute kid with a great imagination?
%A Reitsma,Reindert
%A Sullivan,J
%A Cyr,M N
%K BIS
%B National Science Digital Library Annual Meeting
%C Denver, CO
%8 2005
%G eng
%2 c
%4 2606573569
%$ 2606573569

%0 Journal Article
%J Journal of the Association for Information Science and Technology
%D 2004
%T Spatialization of Web Sites Using a Weighted Frequency Model of Navigation Data
%A Reitsma,Reindert
%A Thabane,L.
%A MacLeod,J.
%K BIS
%X Reitsma, Thabane, and MacLeod are interested in the display of document sets as visualized geometric spaces. Such spaces can use metrics and dimensions determined arbitrarily prior to analysis of data, or they may use secondary data (logged website transaction counts, perhaps) with techniques like factor analysis or MDS to find a structure. Using high transaction volume between an origin and a destination as an indicator of a small distance and a low volume as an indicator of a large distance, a transaction log can provide input to MDS. One problem is the possible origination of multiple sessions from the same address where one can not determine if consecutive requests are part of the same transaction and thus frequencies may be invalid.  They suggest the use of the probability that a count is a transaction as a weight rather the count alone, with this probability depending upon the time separation between an origin and a destination with less time indicating a higher probability. A transaction log for a website for undergraduate engineering learning was analyzed in this manner and weighted transaction counts were compared to the use of  straight count inputs to MDS using the Euclidean metric and four dimensions. Weighted results were not significantly different.
%B Journal of the Association for Information Science and Technology
%V 55
%P 13-22
%8 2004
%G eng
%N 1
%2 a
%4 649314304
%$ 649314304

%0 Generic
%D 2004
%T Teachengineering Resources for K-12
%A Reitsma,Reindert
%A Cyr,M.
%A Mooney,M.
%A Sullivan,J.
%A Ybarra,G.
%K BIS
%B 4th Annual NSF-NSDL meeting
%8 2004
%G eng
%2 c
%4 649347072
%$ 649347072

%0 Journal Article
%J International Journal of Engineering Education
%D 2003
%T Exploiting Engineering as a Unique Distance Learning Tool  19, 379-388
%A Carlson,L.
%A Reitsma,Reindert
%A Brandemuehl,M.
%A Hertzberg,J.
%A Sullivan,J.
%A Gabbard,S.
%K BIS
%B International Journal of Engineering Education
%V 19
%P 379-388
%8 2003
%G eng
%2 a
%4 649318400
%$ 649318400

%0 Journal Article
%J International Journal of Human-Computer Studies
%D 2002
%T Loglinear and Multidimensional Scaling Models of Digital Library Navigation
%A Buttenfield,B.
%A Reitsma,Reindert
%K BIS
%B International Journal of Human-Computer Studies
%V 57
%P 101-119
%8 2002
%G eng
%2 a
%4 51551979520
%$ 51551979520

%0 Journal Article
%J Proceedings of the IEEE
%D 2000
%T A Living Laboratory
%A Lightner,M.
%A Carlson,D.
%A Sullivan,J.
%A Brandemuehl,M.
%A Reitsma,Reindert
%K BIS
%B Proceedings of the IEEE
%V 88
%P 31-40
%8 2000
%G eng
%2 a
%4 51551956992
%$ 51551956992

%0 Journal Article
%J Group Decision and Negotiation
%D 1999
%T Accessibility of Computer-based Simulation Models in Inherently Conflict-Laden Negotiations
%A Zigurs,I.
%A Reitsma,Reindert
%A Lewis,C.
%A Hubscher,R.
%A Hayes,C.
%K BIS
%B Group Decision and Negotiation
%V 8
%P 511-533
%8 1999
%G eng
%2 a
%4 51551926272
%$ 51551926272

%0 Journal Article
%D 1997
%T Object-oriented Simulation and Evaluation of River Basin Operations. Journal of Geographic Information and Decision Analysis. 1, 1, pp. 10-24
%A Reitsma,Reindert
%A Carron,John C.
%K BIS
%V 1
%P 1--24
%8 1997
%G eng
%N 1
%2 a
%4 240165423104
%$ 240165423104

%0 Journal Article
%J Journal of Geographic Information and Decision Analysis
%D 1997
%T Object-oriented Simulation and Evaluation of River Basin Operations
%A Reitsma,Reindert
%A Carron,J.
%K BIS
%B Journal of Geographic Information and Decision Analysis
%V 1
%P 9-24
%8 1997
%G eng
%2 a
%4 51551909888
%$ 51551909888

%0 Journal Article
%J Journal of Hydrology
%D 1996
%T Structure and Support of Water Resources Management and Decision Making
%A Reitsma,Reindert
%K BIS
%B Journal of Hydrology
%V 177
%P 253-268
%8 1996
%G eng
%2 a
%4 51551893504
%$ 51551893504

%0 Journal Article
%J Journal of Computing in Civil Engineering
%D 1994
%T Construction Kit for Visual Programming of River-Basin Models
%A Reitsma,Reindert
%A Sautins,A.
%A Wehrend,S.
%K BIS
%B Journal of Computing in Civil Engineering
%V 8
%P 378-384
%8 1994
%G eng
%2 a
%4 51551885312
%$ 51551885312

%0 Journal Article
%J SWIM
%D 1990
%T WODAN: een Venster op Beleidsinformatie (WODAN: a Window on Decision-making Information)
%A Reitsma,Reindert
%A Hendriks,P.
%K BIS
%B SWIM
%V 5
%P 15-24
%8 1990
%G eng
%2 a
%4 51551875072
%$ 51551875072

%0 Journal Article
%J Regional Studies
%D 1988
%T A Causal Typology of Migration: The Role of Commuting. Regional Studies
%A Reitsma,Reindert
%A Vergoossen,A.
%K BIS
%B Regional Studies
%V 22
%P 331-340
%8 1988
%G eng
%2 a
%4 51551858688
%$ 51551858688

%0 Journal Article
%J SWIM
%D 1986
%T Artificiele Intelligentie in Geografisch Onderzoek: Cognitie, `Engineering' en Geografische Modellen (Artificial Intelligence in Geographical Research: Cognition, `Engineering' and Geographical Models)
%A Reitsma,Reindert
%K BIS
%B SWIM
%V 1
%P 4-7
%8 1986
%G eng
%2 a
%4 51551834112
%$ 51551834112