Massachusetts Veterans Jobs

MassHire JobQuest Logo

Job Information

Pine Street Inn Evaluation Associate in Boston, Massachusetts

Evaluation Associate

Department: Strategic Initiatives/Program Evaluation

Office: 444 Harrison Avenue

Location: Boston, MA

Position Type: Administrative

Hours/Shift: Morning - First Shift

Employee Type:: Regular Full-time


SCHEDULE: 40 hours, Monday-Friday, 8:30am-5:00pm occasional flexibility as necessary.

Pays $65-70K Annually DOE

LOCATION: 444 Harrison Ave, Boston, MA



The Evaluation Associate is responsible for analyzing program data to assess the outcomes of Pine Street Inn programs and projects on behalf of the populations PSI serves. In collaboration with the Director of Program Evaluation and the Data Analyst, the incumbent is responsible for planning and conducting collection and analysis of various data sources to provide insight on program performance and areas for improvement, towards an end of shaping best practice program models and policies. The overall goal of the Program Evaluation department is to work with program staff at all levels to improve the quality of services to the populations we serve, and to identify opportunities to expand services or fill gaps in programming in support of Pine Street Inn-s strategic plan.

The Evaluation Associate-s work is driven by the data collected by PSI-s programs, and the Evaluation Associate will be a creative and analytical thinker able to suggest changes to current data collection and reporting practices to ensure that PSI-s work is driven by the most scientifically accurate and rigorous analyses. In doing their work, the Evaluation Associate will be able to communicate with staff and leaders regardless of their technical or data proficiency in order to ask the questions and propose the changes and improvements needed to maximize each program-s effectiveness. The Evaluation Associate will also disseminate findings to and promote learning with various program partners.




  • Bachelor-s Degree with two to five (2 - 5) years of database applications and administrative experience, preferably in human services.

  • Proficiency in office software and equipment including Microsoft Office Products (Word, Excel, and Outlook), internet use, telephone systems, and copy/scanner machines.

  • Training in basic evaluation concepts, such as logic models and theories of change.


  • Master-s Degree with database applications and administrative experience, preferably in human services, and graduate training in program evaluation, research methods, or program management, or equivalent professional experience.

  • Training experience



  • Proven experience in matrix-managing projects that involve numerous stakeholders

  • Significant applied knowledge of spreadsheet applications, MS Excel and otherwise

  • Project management experience.

  • Minimum of 3 years- experience in data management

  • Profound Knowledge and understanding of relational databases

  • Experience in program evaluation and/or research design, data collection, and writing

  • Proven ability to communicate findings to a variety of audiences, from leadership to front-line staff

  • Strong organization and verbal and written communication skills


  • Experience in HMIS applications (e.g. Clarity Human Services by BitFocus, ETO by Social Solutions, or CaseWorthy)

  • Experience and/or training in qualitative data collection and analysis

  • Quality improvement training or experience

  • Experience with interventions towards ending homelessness.

  • 3-5 years- experience in supervising

    • Management experience.



  • Ability to access different Pine Street Inn building locations and attend local meetings.

  • Ability to use a workstation for long periods of time.

  • Ability to use a PC, phone, copier, and fax machine frequently.



  • Ability to accomplish tasks in a timely manner.

  • Ability to juggle and follow through with multiple projects simultaneously.

  • Ability to interact positively with co-workers and work as a team.

  • Ability to be flexible when new priorities are presented.

  • Ability to work closely with the supervisors and program partners.

  • Ability to develop and execute action plans to resolve problematic situations.

  • Ability to convey database language to staff in a manner that all will comprehend.

  • Interest, or experience with, social justice as well as homeless and housing advocacy.

  • High degree of cultural sensitivity and ability to work effectively with diverse people and situations.

  • Excellent customer service skills; highly developed and effective interpersonal skills.

  • Ability to understand and work on behalf of people with untreated mental health issues, addiction disorders, and poor hygiene.

  • Must have highly developed professional ethics to maintain appropriate boundaries with program participants, staff, landlords, management agent staff, etc. and to support the work of a team.

  • Demonstrated experience as a self-starter; ability to work independently with limited supervision and as a member of an interagency/interdisciplinary team.


    Analysis and Evaluation

  • Evaluates the effectiveness of Pine Street Inn programs, through quantitative and qualitative methods, and proposes changes to program design, data collection, and measurement to advance program goals and PSI-s mission, vision, and values, and develops plans to implement such changes.

  • Assists in conducting evaluations in collaboration with Director of Program Evaluation, Senior Director of Strategic Initiatives and relevant program leaders to foster buy-in and joint learning on program performance and goals.

  • In collaboration with the Director of Program Evaluation, the Data Analyst, and the Sr. Director of Strategic Initiatives, manages the collection of and reporting on PSI-s program outputs and outcomes framework, including quarterly and fiscal year goals. Identifies areas of strengths and challenges for programs.

  • Supports the Data Analyst and Director of Evaluation in probing PSI program participant data for in-depth analysis and evaluation.

  • Produces data reports to: assist in meetings on reporting requirements, benchmark achievable program outcomes, and inform program directors of data points in a timely manner to effect programmatic course correction.

  • In collaboration with the Data Analyst and the Director of Program Evaluation, designs dashboards for program managers to monitor program performance, data quality, and outcomes. Supports program managers in using such dashboards, and identifies and proposes solutions to address potential additional needs.

  • Optimizes the HMIS system to produce data for outcomes and program quality improvement, in collaboration with the Director of Program Evaluation and the Associate Director of HMIS.

  • Supports program managers with creating processes and procedures to ensure accurate and timely data entry, including the design of visual and textual support material. Together with the Associate Director of HMIS and the Director of Program Evaluation, designs and implements changes to support these processes and procedures.

  • Tests results from various analytical methods if they reflect the -real-world-.

  • Plans and conducts quality improvement efforts, such as Plan-Do-Study-Act (PDSA) cycles, to test, reflect on, and scale successful program changes.

  • Facilitates reflective practice with program partners.

  • In collaboration with the Director of Evaluation, plans and conducts and/or oversees qualitative data collection efforts as needed to answer questions of interest. Conducts qualitative analysis, such as thematic analysis, and disseminates findings.

  • In collaboration with the Director of Evaluation, conducts process and/or implementation evaluation efforts to assist programs in reflecting on successes and challenges, as well as identifying barriers to implementation.

  • Disseminates findings from quantitative and qualitative analyses to various audiences, such as program and agency leadership and front-line staff. Employs different modalities as necessary for different audiences. Accepts and responds to suggestions, questions, and feedback from PSI staff at all levels as to these findings.

  • Based on findings of data analysis and in collaboration with Director and Sr. Director, recommends more effective and efficient program policies and procedures.

  • Participates in the efforts to produce research on Pine Street Inn initiatives, particularly with newer interventions, which may be published and utilized in local and national arenas to increase the viability of homeless service programs.

  • Actively participates in the planning and implementation of data-based solutions to fulfill Pine Street Inn-s mission to end homelessness.

  • Proposes changes to current reporting and data collection fields, templates, and practices in support of PSI-s strategic plan.

  • Inputs data into the Pine Street Inn-s HMIS system if needed.

  • Performs any other tasks deemed necessary for maintaining the quality of the HMIS system.

  • Submits reports and responds to special information requests promptly and as needed, and in collaboration or consultation with other affected departments, such as Communications or Development


  • Consistently seeks to perform at the highest level and is responsible for completing work in a way that upholds core values of PSI.

  • Meet PSI Attendance Policy. Fosters teamwork. Gives credit and acknowledges contributions and efforts of other staff and team members.

  • Identifies unsafe or potentially unsafe situations and takes appropriate action to maintain a safe and secure environment for self and others. Consistently follows PSI and program safety policies and procedures.

  • Promotes a professional, welcoming, trauma-informed office environment.

  • Protects confidential information and adheres to Pine Street Inn-s policies and procedures, including occupational health and illness prevention policies and procedures.

  • Participates in team meetings and other meetings as assigned and records minutes as appropriate.

  • Accepts supervision and guidance and actively participates in efforts to improve quality of performance.

  • Upholds the rights of all persons served. Is continually aware of these rights and act in accordance with these rights.

  • Interacts with guests, clients, and tenants in ways which establish a climate of respect for human dignity.

  • Works cooperatively with representatives of all PSI departments, including but not limited to Development and External Affairs, Finance, ITS, and Human Resources.

  • Creates an environment of customer service and accessibility where staff are encouraged to ask questions, receive guidance, or address issues with data.

  • Participates in meetings with external stakeholders and represents the Evaluation Department and the whole agency in a professional manner in all contacts with representatives of other agencies.

  • Provides work coverage in case of absences of team members.

  • Performs other additional assignments or projects as requested/directed by supervisor.

  • Comply with and model compliance with all PSI policies, including illness prevention and occupational health policies.

  • Accept other duties or work locations as assigned in order to meet the needs of the organization during weather other emergencies .


  • Working with the Director of Program Evaluation, the Senior Director of Strategic Initiatives, the Associate Director of HMIS, and partner agencies, ensures that staff are properly trained and implements HMIS data collection procedures. Ensures accuracy and completeness of the data collected and entered and the production of high quality and timely reporting. Reports the status of these efforts to the Director of Program Evaluation frequently.


Planning & Organizing: Develops, implements, evaluates and adjusts plans to reach goals, while ensuring the optimal use of resources. Identifies varied resources needed (e.g., different types of expenditures, different skill mixes). Produces realistic and achievable work plans. Develops back-up plans to handle potential obstacles. Evaluates the extent to which goals and objectives have been achieved.


Pine Street Inn is an Equal Opportunity/Affirmative Action Employer