English Language Assessment Specialist

Overview

Amazon is looking for an outstanding English Language Assessment Specialist to be part of our Global Assessment & Technology Optimization team. As a member of the team, you will get the opportunity to create and evaluate innovative assessments to employ thousands of Amazonians globally.

You will be responsible for developing, maintaining and managing auto-scored English language proficiency assessments to ensure our job applicants can properly communicate with customers in various countries.

Successful candidates will have experience in technology organizations, feel passionate about serving their clients, and have excellent problem solving abilities.

What you’ll do:

· Language construct design and validation: Evaluating various work roles to design an English language testing strategy to reliably measure the target level of language fluency.
· Item Development: Writing, reviewing, piloting, evaluating, revising items and item characteristics (e.g., difficulty level for each population of interest), rating scales (rubrics) following the test design framework and test specifications.
· Content Evaluation: Applying item and test statistics to evaluate item and test form performance during development, piloting and post implementation phases.
· Item library and test construction: Assembling test forms according to strategy and statistical specifications for each target audience. Assisting in designing and implementing the content, format and interface for the computerized delivery of the testing programs.
· Research and Evaluation: Conducting quantitative and qualitative research on score reliability and validity utilizing a variety of methods and data; summarizing, explaining, reporting and publishing findings to stakeholders.
· Content maintenance: Designing item rotation, retirement and new item creation to manage test content exposure and maximize test security.
· Internal consultation: Primary resource to answer questions, propose solutions and iterations of existing programs to apply to new roles and geographies.

BASIC QUALIFICATIONS

· Graduate degree (Masters or PhD) in Applied Linguistics, Educational Linguistics, Psychology, TESOL, TEFL, or TESL with a focus on second language acquisition or language proficiency assessment/testing and research.
· Solid understanding of test development principles, psychometrics, validity and reliability, and fairness of tests; in-depth knowledge of second language acquisition.
· One to three years of experience large-scale standardized English language test development and research or developing language assessment instruments as part of a language teaching program.
· Ability to apply statistical techniques to design and evaluate test content (e.g., content validity, item reliability, appropriate item difficulty design for parallel test forms, etc.)
· Excellent skills in writing technical test manuals and research reports.

PREFERRED QUALIFICATIONS

· Experience developing test content for entry level roles
· Experience developing English tests for use in India, South Africa and/or Costa Rica
· Experience designing solutions for automated analysis of open-ended written and/or verbal responses
· Experience in the above but for other language test development (French, German, Italian or Spanish testing).