Public School Reform


 

Statewide Evaluation of the California Mathematics and Science Partnership (CaMSP) Program.  Public Works conducted a statewide evaluation for the California Department of Education (CDE) to study the implementation of the CaMSP program organized through local partnerships.  The CaMSP program was intended to increase the academic achievement of students in mathematics and science by enhancing the content knowledge and teaching skills of classroom teachers through professional learning activities. The study focused on how partnerships ensured all students have access to, are prepared for, and are encouraged to participate and succeed in challenging and advanced mathematics and science courses; how partnerships enhanced the quality of the mathematics and science teacher workforce; and the evidence-based outcomes that contributed to understanding how students effectively learn mathematics and science. Evaluation activities included site visits to each partnership, observations of professional development activities, telephone interviews, statewide surveys of participating teachers and partners, development of a statewide database for teacher demographic and participation data, analyses of teacher demographic participation data, and a matched control/comparison group study of teacher and student outcomes. These activities resulted in annual reports that summarized key qualitative and quantitative data about the impact of the CaMSP program.

Local Evaluator, Downey Opportunities in Mathematics (DO Math) Downey Unified School District. Public Works served as the local evaluator for DO Math, the Downey Opportunities in Mathematics, a program funded through the California Math and Science Partnerships (CaMSP). Public Works evaluated the effectiveness of the federally funded professional development program that targeted 45 mathematics teachers in grades 3-Algebra I, with the goal of directly impacting 3,500 students. Evaluation activities included: collection and analysis of data related to teacher participation in professional development, gains in teacher knowledge linked to UCLA MCPT training and professional development, conducting analysis of surveys and assessments, student achievement through district-wide STAR data, observations of professional development and classroom instruction, conducting focus groups of participating coaches, teachers, and students. Public Works provided reports to meet state and federal requirements, periodic quarterly reports for the leadership team and a summative evaluation report.

Local Evaluator, North East Bay Mathematics Consortium, John Swett Unified School District. Public Works served as the local evaluator for this California Mathematics and Science Partnership (CaMSP) Cohort 6 project. Evaluation activities included analysis of data related to participation in professional development activities, a pre-post-assessment of teacher content knowledge, coaching observations, and analysis of student outcomes using STAR and local assessment data. Public Works provided spring and final reports each year to meet state and federal requirements.

Local Evaluator, San Benito County Mathematics Initiative, Hollister School District. Public Works served as the local evaluator for this California Mathematics and Science Partnership (CaMSP) Cohort 7 project. Evaluation activities included analysis of data related to participation in professional development activities, a pre-post-assessment of teacher content knowledge, coaching observations, and analysis of student outcomes using STAR and local assessment data. Public Works provided spring and final reports each year to meet state and federal requirements.

Evaluation, CalTech/Pasadena Schools High School Biology Inquiry Science Project, CalTech Precollege Science Initiative (CAPSI). PW served as the evaluator of this inquiry-based learning model in the Pasadena Unified School District (PUSD) to better serve students and to document how the project can provide information about reform in other multiethnic urban school districts. The outcomes of the project are: a) better science content knowledge, b) ability to do independent investigations, c) learning to use evidence-based reasoning, d) increased interest in and preparation for science careers and e) improved written and oral communication skills. PW evaluated the professional development activities; evaluated the extent of implementation of inquiry-based instruction, collected baseline student outcome information from PUSD in order to assess student science and literacy skills (2012 Biology CST and Advanced Placement data from PUSD).

Evaluation, Sonoma County of Education Common Core Math Professional Development. PW served as the evaluator for this project that focused on a developing network of classroom professional development providers to demonstrate an effective model for providing regional professional development opportunities that allow participants to implement and support colleagues in applying the Mathematics Practice Standards and the California Common Core State Content Standards in Mathematics. PW collected the following data: surveys (to assess familiarity with the Common Core Standards, determine needs and readiness to disseminate and train colleagues in sue of the content modules and Mathematics Practice Standards); professional development activity feedback from participants to help shape subsequent professional development. Other data evaluated includes the Learning for Mathematics Teaching assessment to measure content knowledge and portfolios from participating counties.

Evaluation, Sonoma State University, English Learners Pre-service Program. PW served as the evaluator collecting and analyzing formative data related to the implementation of the professional development program and supported year-end and summative reporting to the US Department of Education. PW collected the following data: pre-post teacher attitudinal survey for in-service teachers, pre-post teaching preparation and attitudinal survey; and a professional development activity feedback form. Other data collected included a random sample of ten participating pre-service teachers such as lesson plans, completed rubrics, feedback, and revisions. PW also collects EL student achievement and engagement in academic coursework.

Local Evaluator, Alameda County Office of Education and California State University East Bay. Public Works served as the local evaluator for five partnerships funded through the California Mathematics and Science Partnership (CaMSP) project. Public Works evaluated the effectiveness of the federally funded professional development projects in the Cohort 3, 4, 6, 7 and Research targeting over 350 teachers in 13 districts coordinated by Alameda County Office of Education in partnership with California State University East Bay. Evaluation activities included analysis of data related to participation in professional development activities, a pre-post-assessment of teacher content knowledge, coaching observations, and analysis of student outcomes using STAR and local assessment data. Public Works provided spring and final reports each year to meet state and federal requirements.

FRAME UCLA Center X Mathematics Professional Development Program Evaluation at Fremont High School, Los Angeles Unified School District. This evaluation study encompasses five research questions in an evaluation that includes the study of treatment teachers at Fremont High School and teachers from a comparison high school in LAUSD. The research questions include: 1) To what extent do Professional Learning Partners (PLPs) effectively deliver and support quality PD linked to Fremont Math program goals?  2) To what extent do Fremont Math PD efforts have an effect on the delivery of Mathematics instruction at Fremont High School?  3) How do Fremont Math PD efforts impact the school-site Mathematics culture (collaboration, collegiality, vision, efficacy, leadership, etc.) at Fremont High School?  4) To what extent do Fremont Math PD efforts have an effect on teacher content knowledge in the teaching of Mathematics; and 5) To what extent do Fremont Math PD efforts have an impact on student Mathematics achievement (CST and CAHSEE)? Methods in this study include a quasi-experimental student outcome study, measurement of teacher mathematical knowledge for teaching (MKT), classroom observations, and a teacher survey.

Technical Assistance for the Downey Unified School District Professional Learning Communities. Public Works was contracted by Downey USD to provide technical assistance, professional development, and coaching to Professional Learning Communities (PLC) in district high schools. PW met regularly with groups organized by department to establish pacing guides aligned to key standards and develop benchmark assessments aligned to teaching and learning. The PLCs also analyzed data such as CSTs, CAHSEE, API, and AYP to identify areas of PLC focus.

Evaluation, California State University, Dominguez Hills Gear-Up, Bethune Middle School. Los Angeles Unified School District (LAUSD). PW served as the evaluator for a project to support the 2011-12 7th grade students at Bethune Middle School as they transition into Fremont High School and post-secondary over the next seven-years. PW collected both quantitative and qualitative data designed to evaluate two objectives: 1) student success in rigorous curricula and coursework that prepares them for college; 2) high school graduation and preparation for and post-secondary enrollment. PW collected the following data: administer and analyze surveys of current 7th grade students, parents of 7th grade students, and 7th grade teachers; conducted site visits; collected and analyzed student and staff participation data; collected and analyzed middle school achievement data (CST in English/Language Arts and Mathematics, courses grades in English and mathematics, and pupil attendance); and collected and analyzed high school student achievement data longitudinally for this cohort.

Evaluation Support for the California Environmental Protection Agency, Office of Education and the Environment. Public Works was contracted to provide evaluation support by conducting a survey of teachers related to the Cal/EPA Education and the Environment (EEI) curriculum. The survey results support the agency’s efforts to 1) increase the number of school district using the EEI curriculum and 2) provide information from teachers that will inform prospective funders about teacher usage and satisfaction with the EEI curriculum.

Evaluation of the Pasadena Unified School District Positive Futures Grant. Grant Education Consultants contracted with Public Works to support the evaluation of this project. The evaluation focused on qualitative data that provided information and results necessary to determine if efforts were working to decrease the dropout rate and increase the graduation rate in the district. The evaluation included site visits to all PUSD middle and high schools; interview and focus groups for middle and high schools; ninth grade student survey to measure climate and culture of each school, and baseline data collection to meet federal requirements. The evaluation also included collection of quantitative student outcome data.

Evaluation of the Catholic Schools Consortium, Specialty Family Foundation (SFF). SFF formed the Catholic Schools Consortium (CSC) to serve some of the region’s most economically disadvantaged students and families enrolled in Catholic schools. With a goal to increase enrollment and annual fundraising capacity in nine school sites, Public Works conducted a formative and summative third party evaluation for the CSC. The evaluation included site visits to nine schools; interviews with stakeholders and focus groups with parents/ guardians and advisory board members; a case study about each school visited; and a cross case analysis to identify trends and findings; and teacher and parent surveys.

Data Reporting for the Los Angeles Educational Partnership (LAEP). Public Works was contracted to provide data on schools and small learning communities that are working with  to meet their reporting requirements for three foundations/ initiatives: Stuart, Ahmanson, and Know How to Go to College. The data analysis focused on California Standards Tests, high school exit exam results, eligibility for postsecondary education and attendance. PW also developed profiles for 30 schools that compare individual schools to LAEP and LAUSD averages and provided staff with professional development to understand and use data.

Evaluation of US Department of Education Smaller Learning Communities Supplemental Grant (Cohorts VI and VIII) to the Los Angeles Unified School District (LAUSD). Public Works served as the third party evaluator for seven Cohort VI high schools and three Cohort VIII high schools. The supplemental grant was awarded to enhance the timely collection and reporting of data on enrollment in postsecondary education, advanced training, or registered apprenticeship program by graduates of schools included in the approved application. Data collected and analyzed for this project was incorporated in the findings in the USDE ALC Annual Performance Report.

Evaluation of US Department of Education Smaller Learning Communities Supplemental Grant (Cohort VI) to the San Bernardino County Superintendent of Schools, Center for the Advancement of Smaller Learning Environments. Public Works was the third party evaluator for the Cohort VI high schools. The supplemental grant was awarded to enhance the timely collection and reporting of data on enrollment in postsecondary education, advanced training, or registered apprenticeship program by graduates of schools included in the approved application. Data collected and analyzed for this project was incorporated in the findings in the USDE ALC Annual Performance Report.

Evaluation of US Department of Education Smaller Learning Communities Grant (Cohort VIII) to the Los Angeles Unified School District (LAUSD). Public Works evaluated a five-year grant to implement Smaller Learning Communities in nine large comprehensive high schools. Research questions focused on the modification of the delivery of curriculum and instruction, the benefits to students resulting from personalization of instruction, improvements in school safety, community engagement and improved student achievement including increased student eligibility and preparation for postsecondary education and careers. Evaluation activities included site visits to each school, surveys of school staff, current students, and graduates, analysis of student outcome data, and support in the use of data at school sites for continuous program improvement. Deliverables included qualitative and quantitative reports summarizing the status of grant implementation across the nine high schools and submission of the Federal Annual Performance Report each calendar year.

Evaluation of US Department of Education Smaller Learning Communities Grant (Cohort VI) to the San Bernardino County Superintendent of Schools (SBCSS).  Public Works evaluated a five-year grant to implement Smaller Learning Communities in ten comprehensive high schools. Research questions focused on the modification of the delivery of curriculum and instruction, the benefits to students resulting from personalization of instruction, improvements in school safety, community engagement and improved student achievement including increased student eligibility and preparation for postsecondary education and careers. Evaluation activities included site visits to each school, surveys of school staff, current students, and graduates, analysis of student outcome data, and support in the use of data at school sites for continuous program improvement. Deliverables included qualitative and quantitative reports summarizing the status of grant implementation across the ten high schools and submission of the Federal Annual Performance Report each calendar year.

Evaluation of US Department of Education Smaller Learning Communities Grant (Cohort VI) to Bassett Unified School District (BUSD).  Public Works evaluated a five-year grant to implement Smaller Learning Communities in one comprehensive high school. Research questions focus on the modification of the delivery of curriculum and instruction, the benefits to students resulting from personalization of instruction, improvements in school safety, community engagement and improved student achievement including increased student eligibility and preparation for postsecondary education and careers. Evaluation activities include site visits to the school, surveys of school staff, current students, and graduates, analysis of student outcome data, and support in the use of data at the school site for continuous program improvement. Deliverables include qualitative and quantitative reports summarizing the status of grant implementation and submission of the Federal Annual Performance Report each calendar year.

Evaluator of the Carol M. White Physical Education Program (PEP) for Whittier City School District. Whittier City School District was granted the federal Carol M. White Physical Education Program (PEP) grant to increase physical education activity in 11 elementary schools. Public Works assisted the district in meeting federal reporting requirements including pedometer logs, pre-and post-BMI scores and a student survey to measure consumption of fruits and vegetables.

Public Schools Choice Technical Assistance.   Assisted three LAUSD secondary schools (one high school, one middle, and one grade 6-12 school) in developing portions of school improvement plans linked to LAUSD’s Public Schools Choice (PSC) initiative.  PSC requires all new schools opening in the district as well as chronically underperforming schools to prepare a detailed plan for ensuring improved student achievement in competition with non-profits, institutions of higher education, charter schools, and charter school networks.   Public Works conducted needs assessments of the school and facilitated Design Teams comprised of local district representatives, school administrators, teachers, and community/parent representatives working to formulate and respond to a rubric detailing elements of a comprehensive school improvement plan.   PW presented research-based approaches to schooling in selected key areas and drafted key portions of the PSC plans for these schools including: 1) Curriculum and Instruction; 2) Assessment and Data; 3) Performance Management; 4) Professional Development; 5) Leadership; and 6) Governance and Oversight.

 

 

© 2014. Public Works Group. All Rights Reserved.