Some of the material in is restricted to members of the community. By logging in, you may be able to gain additional access to certain collections or items. If you have questions about access or logging in, please use the form on the Contact Page.
Some of the material in is restricted to members of the community. By logging in, you may be able to gain additional access to certain collections or items. If you have questions about access or logging in, please use the form on the Contact Page.
Value-Added Models (VAMs) require consistent longitudinal data that includes student test scores coming from sequential years. However, longitudinal data is usually incomplete for several reasons, including year-to-year changes in...
Multivariate meta-analysis methods typically assume the dependence of effect sizes. One type of experimental-design study that generates dependent effect sizes is the multiple-endpoint study. While the generalized least squares (GLS)...
Estimating a treatment effect is problematic when selection bias exists. This dissertation sought to elucidate the problem of estimating the treatment effect size of the Response-to-Intervention (RTI) policy when selection bias exists....
With the latest developments in computer based testing, implementing equating techniques that incorporate automated essay scoring systems such as e-rater are encouraging potential new directions for equating mixed-format tests of writing...
The Department of Mathematics of the Florida State University gives a mathematics placement test to each entering freshman. This study examines relationships between the scores attained on the mathematics placement test, other tests...
Testlets bring several perks in the development and administration of tests, such as 1) the construction of meaningful test items, 2) the avoidance of non-relevant context exposure, 3) the improvement of testing efficiency, and 4) the...
Test makers and test users are giving increasing attention to the critical analysis and evaluation of standardized tests, scales, and inventories. Such analyses are too many times so brief and general as to be of little value to those...
Mixture IRT modeling allows the detection of latent classes and different item parameter profile patterns across latent classes. In Rasch mixture model estimation, latent classes are assumed to follow a normal distribution with means...
The improvement of critical thinking ability among university students is widely accepted as a goal of higher learning. However, as an objective it frequently remains loosely defined in curriculum, and there is little agreement regarding...
Study of children in the third grade classroom of the Demonstration School at Florida State University during the 1950-1952 school terms--P. 2. From the study of the tentative edition of the Elementary Evaluative Criteria came increasing...
The Comparison of Standard Error Methods in the Marginal Maximum Likelihood Estimation of the Two-Parameter Logistic Item Response Model When the Distribution of the Latent Trait Is Nonnormal
A Monte Carlo simulation study was conducted to investigate the accuracy of several item parameter standard error (SE) estimation methods in item response theory (IRT) when the marginal maximum likelihood (MML) estimation method was used...
In education and psychology, exploratory factor analysis (EFA) is mainly used in scale development or refinement. To select a final EFA model, researchers take into account not only the number of factors, but also parameter estimates...
When developing a test, it is essential to ensure that the test is free of items with differential item functioning (DIF). DIF occurs when examinees of equal ability, but from different examinee subgroups, have different chances of...
In research synthesis, researchers may aim at summarizing peoples' attitudes and perceptions of phenomena that have been assessed using different measures. Self-report rating scales are among the most commonly used measurement tools to...
"The purpose of this paper is to examine research and professional literature to learn what some of the findings in regard to promotion and failure are, to relate these findings to data obtained from a study of failures in an individual...
In the current study, I intended to simulate single case research design (SCRD) data to investigate the impact of the presence of autocorrelation on analysis of SCRD for Bayesian method under a variety of simulation conditions. The...
The Impact of Unbalanced Designs on the Performance of Parametric and Nonparametric DIF Procedures: A Comparison of Mantel Haenszel, Logistic Regression, SIBTEST, and IRTLR Procedures
The current study examined the impact of unbalanced sample sizes between focal and reference groups on the Type I error rates and DIF detection rates (power) of five DIF procedures (MH, LR, general IRTLR, IRTLR-b, and SIBTEST). Five...
This study introduces a longitudinal diagnostic classification model, called the LTA+HDCM, which is a fusion of latent transition analysis (LTA; Collins & Flaherty, 2002; Collins & Wugalter, 1992) and the hierarchical diagnostic...
The study explored the development of a valid assessment tool for job negotiation competencies using the Evidence Centered Design framework. It involved the creation of a competency model, evidence models, and task models that guided the...
"It is the purpose of this study to evaluate the results of the special battery of tests administered to freshmen and transfer students entering the Florida State University School of Music over a two year period, 1953 and 1954, together...
This paper addresses the role of tuition on retention rates for full-time students across in 2 and 4-year public institutions in the United States. Multiple regression on tuition variables was performed by using institutional data on...
The dissertation explored the efficacy of using a POMDP to select and apply appropriate instruction. POMDPs are a tool for planning: selecting a sequence of actions that will lead to an optimal outcome. RTI is an approach to instruction, ...
There is in effect at the present time a Florida State-Wide Ninth-Grade Testing Program. This program consists of two tests; one is the School Ability Test (SAT) and the other consists of five parts of the Iowa Tests of Educational...
The 21st century technology has advanced to become an accessible beacon of education. The physical boundaries of the chemistry laboratory have expanded with the use of innovative virtual lab simulations despite disparate results from...
Educators use various statistical techniques to explain relationships between latent and observable variables. One way to model these relationships is to use Bayesian networks as a scoring model. However, adjusting the conditional...
Reading comprehension emerges as an important skill set in the early elementary grades. It is supported by component skills including decoding, linguistic knowledge including vocabulary and syntactic knowledge, as well as more complex, ...
The nonequivalent-groups anchor-test (NEAT) data-collection design is commonly used in large-scale assessments. Under this design, different test groups take different test forms. Each test form has its own unique items and all test...
The Impact of Rater Variability on Relationships among Different Effect-Size Indices for Inter-Rater Agreement between Human and Automated Essay Scoring
Since researchers investigated automatic scoring systems in writing assessments, they have dealt with relationships between human and machine scoring, and then have suggested evaluation criteria for inter-rater agreement. The main...
"The writer has heard a great deal concerning intelligence and the use of intelligence tests. However, not all of the opinions expressed have been in agreement, and there seems to be a large area of uncertainty for the classroom teacher...
The problem of finding a suitable instrument for projecting, or influencing the projection of an organized guidance program for the Florida State University Demonstration School is an outgrowth of at least three areas of personal...
The purpose of the current study was to test the theory of action hypothesized for the Mathematics Formative Assessment System (MFAS) based on results from a large-scale randomized field trial. Using a multilevel structural equation...
In this study, I investigated the effectiveness of a creativity-support system that I developed in the level editor of a learning game called Physics Playground on improving college students’ creativity. Moreover, I investigated the...
Lately, there has been an increased focus on the role that certification plays in the long-term performance of classroom teachers. In short, does certification matter? Many studies have analyzed the specific components and requirements...
"This problem was chosen because there seems to be a need for an understanding by primary teachers about what learnings should be tested and how to test those learnings. For too long we, as teachers of the first, second, and third grades...
My dissertation explores publication-bias detection methods for meta-analyses of survival analysis studies. I simulated individual-level survival data and created pseudo studies that were combined in meta-analyses. I analyzed the pseudo...
In factor analysis, determining the number of factors underlying measurement indicators is important. An incorrect decision on the number of factors may mislead practitioners in terms of estimating parameters in factor analysis, ...
Checking that models adequately present data is an essential component of applied statistical inference. Psychometricans increasingly use complex models to analyze test takers responses. The appeal of using complex cognitive diagnostic...
The purpose of the current study is to provide evidence of the possible repercussions of different teacher certification pathways on student achievement that can inform policy in order to improve the instruction students receive. In the...
This study evaluates a CART-based value-added model and compares it with commonly used multiple regression, hierarchical linear model, and student growth percentiles models. The comparisons are done in terms of prediction accuracy, ...
Currently, more sophisticated techniques such as factor analyses are frequently applied in primary research thus may need to be meta-analyzed. This topic has been given little attention in the past due to its complexity. Because factor...
The purpose of the current study is to provide evidence of the possible repercussions of different teacher certification pathways on student achievement that can inform policy in order to improve the instruction students receive. In the...
The main objective of this study was to investigate the improvement of the accuracy of small sample equating, which typically occurs in teacher certification/licensure examinations due to a low volume of test takers per test...
Measurement invariance analysis is important when test scores are used to make a group-wise comparison. Multiple-group IRT modeling is one of the commonly used methods for measurement invariance examination. One essential step in the...
Many popular global model-data fit indices (GFIs), such as Comparative Fit Index (CFI), Tucker-Lewis Index (TLI), Root Mean Square Error of Approximation (RMSEA), and Standardized Root Mean Square Residuals (SRMSR) are proposed and...
Research has shown that cross-sectional mediation analysis cannot accurately reflect a true longitudinal mediated effect. To investigate longitudinal mediated effects, different longitudinal mediation models have been proposed and these...
Some of the material in is restricted to members of the community. By logging in, you may be able to gain additional access to certain collections or items. If you have questions about access or logging in, please use the form on the Contact Page.
