1. Program Evaluation
OIR works with clients to develop program evaluations for new and ongoing project. Our evaluation plans are tailored to fit the needs of the client and range from online satisfaction surveys to expansive quasi-experimental studies. We employ a variety of evaluation methods, some including online, mail, and phone surveys, focus groups, and interviews. At OIR, we work collaboratively with our clients to ensure that each evaluation plan is meaningful, practical, and produces effective results that lead to change.Example:
OIR has evaluated three Safe Schools/Healthy Students (SS/HS) grants in Sanford and Lewiston, ME and Pittsfield, MA. SS/HS is a federal initiative that provides technical assistance to strengthen the community infrastructure to increase access to mental health services and reduce substance use and abuse and violence among children from preschool through 12th grade. The Sanford, ME team has drawn on our data and support to help them win four additional federal grants for community improvement.2. Program Research
OIR uses research-based techniques in working with clients on program improvement. After clearly summarizing existing research findings, we target research activities to collect data that can be directly used to improve program function and sustainability. OIR specializes in making research information palatable to the non-researcher through the use of visuals and real-life examples.
Example
Our recent work with the Massachusetts Department of Early Education and Care on the Institutes of Higher Education Mapping Projects (Phases I and II), evaluated aspects of public and private higher education programs in the Commonwealth to aid the early education and out-of-school time workforce in the successful completion of higher education programs. To make results applicable to a wide audience, we presented our findings in a variety of formats including a written report with graphic representations, searchable Excel databases, and fact sheets, all which are posted on the EEC website.Sample Document:
Document Two. IHE Factsheet
3. Grant Development and Writing Assistance
OIR teams with clients to develop proposal responses to local, state, and national RFPs. Developing logic models that map out goals and objectives and highlighting outcomes that lay the foundation for grant development, OIR has helped clients win grants from the Department of Education, Substance Abuse and Mental Health Services Administration, and Department of Health and Human Services. In additional to teaming with clients to write full grants, OIR writes competitive, comprehensive evaluation plans for any type of proposals.Example:
OIR assisted the Sanford School Department to secure funding for the Safe Schools/Healthy Students grant, a federal Department of Education three million dollar multi-year project. OIR’s comprehensive logic model was a unique aspect of the grant and the blueprint for the project. This particular logic model was produced collaboratively with the members of the Sanford Safe Schools/Healthy Students collaborative.
Sample Document:
Sanford Safe Schools Logic Model
4. Technical Assistance and Training
OIR consistently helps clients interpret data and achieve intended project outcomes. Recently, we have provided technical assistance and training on logic models, the use of data to inform classroom instruction, and the use of child assessment tools. OIR staff are certified trainers on the Early Language and Literacy Classroom Observation (ELLCO) and the Classroom Assessment Scoring System (CLASS).Example:
The Massachusetts Department of Early Education and Care contracted OIR to provide technical assistance to Massachusetts programs receiving Universal Pre-Kindergarten funding. Using skills and experience from child assessment projects with the United Way of Massachusetts Bay and Merrimack Valley, OIR implemented a child assessment system for these programs. . OIR helped the programs find appropriate training, interviewed clients to find their ideas for optimal project success, and tracked the programs’ successes and challenges to inform future potential grantees.Sample Document:
Document Four. Recommendations for Implementing a Child Assessment System in Massachusetts
5. Data Collection and Analysis
OIR has a staff of trained data collectors in multiple states for use in project evaluation and technical assistance. Among other data collection skills, staff are trained to assess classroom environments, administer individual child assessments, conduct phone and in-person interviews, and facilitate focus groups. Data collectors have experience with the Environmental Rating Scales, including the Early Childhood Environment Rating Scale™, the Early Language and Literacy Classrooms Observation (ELLCO), and the Classroom Assessment Scoring System (CLASS). Staff are trained to administer individual child assessments in a respectful and conscientious manner that recognizes children’s interests and developmental stages. OIR analyzes data in ways that best suit the client. We structure out analysis strategies and presentation of results according to our clients needs. Data summaries can be used by clients for program improvement, strategic planning, and grant development.The depth and breadth of skills that our core staff and data collectors possess allow OIR to complete a variety of projects requiring a multitude of evaluation techniques. Because of our multifaceted, efficient, and effective approaches, OIR can complete projects on tight timelines.
Example:
The Massachusetts Department of Public Health hired OIR to develop a database of child care health consultants in Massachusetts. Previously, the department had no way of knowing the names and affiliations of child care health consultants around the state. In two months, OIR data collectors called thousands of child care programs and developed a comprehensive and useful database.
Sample Document:
Document Five. Mental Health Services in Early Childhood Factsheet
