Summary
Software Engineering Evaluator / Code Quality SpecialistWe are seeking a detail-oriented Software Engineering Evaluator to assess and improve the quality of AI-generated software development work. In this role, you will apply your engineering expertise to design realistic coding scenarios, evaluate AI-generated solutions, and provide structured feedback on code quality, correctness, and technical execution.This opportunity is ideal for software engineers who enjoy reviewing code, solving technical problems, and applying strong engineering judgment to ensure high-quality, production-ready outcomes.Key ResponsibilitiesCreate realistic software engineering tasks based on real-world development workflows, including technical requirements, supporting documentation, test cases, and code repositories.Evaluate AI-generated code solutions against professional engineering standards for correctness, maintainability, performance, and reliability.Compare outputs from different AI systems using identical requirements and environments, documenting relative strengths and areas for improvement.Develop test plans, evaluation rubrics, and success criteria that clearly define expected functionality, coding standards, and edge-case handling.Review code changes, implementation decisions, automated tests, and design approaches to verify technical quality and adherence to requirements.Identify and document issues such as:Missed edge casesIncorrect or incomplete implementationsFragile code changesIneffective testing strategiesRequirements misinterpretationUnsupported assumptions or fabricated outputsCollaborate with engineers and reviewers to refine evaluation tasks, improve assessment methodologies, and maintain quality standards across projects.Contribute technical expertise across a variety of technologies, platforms, and software development environments.QualificationsRequiredExperience developing, testing, and maintaining software applications or systems.Proficiency in at least one modern programming language such as:PythonJavaScript / TypeScriptJavaGoC++C#RubyPHPSwiftKotlinRustStrong understanding of software engineering principles, debugging techniques, testing methodologies, and version control systems.Ability to quickly understand unfamiliar codebases and evaluate implementation quality.Experience using tools such as Git, testing frameworks, command-line interfaces, and debugging tools.Excellent written communication skills with the ability to explain technical findings clearly and objectively.Professional-level English proficiency.PreferredTwo or more years of software development experience in a professional, academic, freelance, or open-source setting.Familiarity with containerization, CI/CD pipelines, and modern development workflows.Experience using AI-powered coding assistants or large language model (LLM) tools such as ChatGPT, Claude, GitHub Copilot, or similar technologies.Bachelor's degree (completed or in progress) in Computer Science, Software Engineering, Information Systems, or a related discipline, or equivalent practical experience.What Success Looks LikeConsistently identifies technical issues, risks, and implementation gaps with supporting evidence.Demonstrates sound engineering judgment when evaluating code quality and software behavior.Produces clear, actionable feedback that improves the quality of AI-generated software outputs.Applies best practices in testing, maintainability, performance, and software design.Delivers objective and well-documented evaluations across multiple technologies and domains.SkillsSoftware DevelopmentCode ReviewQuality AssuranceTest Design & ValidationDebugging & TroubleshootingGit & Version ControlSoftware ArchitectureTechnical DocumentationAnalytical ThinkingAI-Assisted DevelopmentBackend, Frontend, and Full-Stack DevelopmentProblem SolvingThis is a Permanent position based out of Charlotte, NC.The pay range for this position is $45000.00 - $60000.00/yr.Individual compensation offered for this position within this range will depend on many factors, including qualifications, skills, relevant experience, job knowledge, geographic location, internal equity, and other pertinent job-related factors.Independent contractor paid through paypal. No benefits offeredThis is a fully remote position.
Job Description
Software Engineering Evaluator / Code Quality SpecialistWe are seeking a detail-oriented Software Engineering Evaluator to assess and improve the quality of AI-generated software development work. In this role, you will apply your engineering expertise to design realistic coding scenarios, evaluate AI-generated solutions, and provide structured feedback on code quality, correctness, and technical execution.This opportunity is ideal for software engineers who enjoy reviewing code, solving technical problems, and applying strong engineering judgment to ensure high-quality, production-ready outcomes.Key ResponsibilitiesCreate realistic software engineering tasks based on real-world development workflows, including technical requirements, supporting documentation, test cases, and code repositories.Evaluate AI-generated code solutions against professional engineering standards for correctness, maintainability, performance, and reliability.Compare outputs from different AI systems using identical requirements and environments, documenting relative strengths and areas for improvement.Develop test plans, evaluation rubrics, and success criteria that clearly define expected functionality, coding standards, and edge-case handling.Review code changes, implementation decisions, automated tests, and design approaches to verify technical quality and adherence to requirements.Identify and document issues such as:Missed edge casesIncorrect or incomplete implementationsFragile code changesIneffective testing strategiesRequirements misinterpretationUnsupported assumptions or fabricated outputsCollaborate with engineers and reviewers to refine evaluation tasks, improve assessment methodologies, and maintain quality standards across projects.Contribute technical expertise across a variety of technologies, platforms, and software development environments.QualificationsRequiredExperience developing, testing, and maintaining software applications or systems.Proficiency in at least one modern programming language such as:PythonJavaScript / TypeScriptJavaGoC++C#RubyPHPSwiftKotlinRustStrong understanding of software engineering principles, debugging techniques, testing methodologies, and version control systems.Ability to quickly understand unfamiliar codebases and evaluate implementation quality.Experience using tools such as Git, testing frameworks, command-line interfaces, and debugging tools.Excellent written communication skills with the ability to explain technical findings clearly and objectively.Professional-level English proficiency.PreferredTwo or more years of software development experience in a professional, academic, freelance, or open-source setting.Familiarity with containerization, CI/CD pipelines, and modern development workflows.Experience using AI-powered coding assistants or large language model (LLM) tools such as ChatGPT, Claude, GitHub Copilot, or similar technologies.Bachelor's degree (completed or in progress) in Computer Science, Software Engineering, Information Systems, or a related discipline, or equivalent practical experience.What Success Looks LikeConsistently identifies technical issues, risks, and implementation gaps with supporting evidence.Demonstrates sound engineering judgment when evaluating code quality and software behavior.Produces clear, actionable feedback that improves the quality of AI-generated software outputs.Applies best practices in testing, maintainability, performance, and software design.Delivers objective and well-documented evaluations across multiple technologies and domains.SkillsSoftware DevelopmentCode ReviewQuality AssuranceTest Design & ValidationDebugging & TroubleshootingGit & Version ControlSoftware ArchitectureTechnical DocumentationAnalytical ThinkingAI-Assisted DevelopmentBackend, Frontend, and Full-Stack DevelopmentProblem SolvingThis is a Permanent position based out of Charlotte, NC.The pay range for this position is $45000.00 - $60000.00/yr.Individual compensation offered for this position within this range will depend on many factors, including qualifications, skills, relevant experience, job knowledge, geographic location, internal equity, and other pertinent job-related factors.Independent contractor paid through paypal. No benefits offeredThis is a fully remote position.
Government Careers
Government jobs offer stability, competitive benefits, and the chance to make a meaningful impact on your community and country.
Whether you’re starting your career or seeking new opportunities, these roles provide pathways for growth, security, and service.
Explore positions across a wide range of fields and take the first step toward a rewarding future in public service.
MORE JOBS
-
See Position Description
Government Liaison/Special Advice Counsel/Staff Attorney
- York, South Carolina
- YORK COUNTY, SC
- Sep 30, 2026
-
See Position Description
County Attorney
- York, South Carolina
- YORK COUNTY, SC
- Sep 30, 2026
-
See Position Description
Assistant County Attorney
- York, South Carolina
- YORK COUNTY, SC
- Sep 30, 2026
-
See Position Description
Road Technician I
- York, South Carolina
- YORK COUNTY, SC
- Nov 11, 2026
-
See Position Description
Parks Maintenance Technician - Seasonal Catawba Bend
- Rock Hill, South Carolina
- YORK COUNTY, SC
- Nov 11, 2026
-
See Position Description
Nurse Practitioner
- York, South Carolina
- YORK COUNTY, SC
- Nov 11, 2026