Senior Engineer, Competitive Benchmarking & Performance

Career Tools

About This Role

Elastic, known as the Search AI Company, provides a complete Search AI Platform used by over half of the Fortune 500 to deliver cloud-based solutions spanning search, security, and observability. The organization is currently hiring a Senior Engineer for Competitive Benchmarking & Performance to join the Elasticsearch Performance team. This position centers on directing competitive benchmarking operations, building reproducible test environments, and analyzing how Elasticsearch performs against alternative systems. This…

Job Description

Responsibilities

• Manage prioritized competitive benchmarking efforts across analytical, observability, search, vector, and hybrid retrieval workloads
• Construct and upkeep automated testing harnesses, datasets, query sets, and load profiles that mirror real-world application usage
• Design equitable comparisons detailing chosen system versions, configuration settings, hardware budgets, tuning choices, and functional variations
• Assess latency metrics, throughput capacities, resource usage, and financial efficiency across evaluated systems
• Measure retrieval performance under equivalent recall or relevance benchmarks for information retrieval tasks
• Utilize and adapt tools including Elasticsearch Rally, ClickBench, and vector search evaluation frameworks
• Examine performance disparities via system metrics, controlled experiments, and profiling, collaborating with engineering groups to validate upgrades
• Assess self-managed and managed cloud environments, including serverless options, while reviewing scalability and service limitations
• Collaborate with engineering and technical publishing partners to release reproducible benchmark assets and detailed reports
• Work alongside product management and engineering to prioritize benchmark coverage and convert findings into product enhancements

Requirements

• Proficiency in software development with the ability to construct maintainable automation and analysis tools using Python or another relevant language
• Practical background in assessing and troubleshooting performance within distributed architectures, databases, or search engines
• Specialized knowledge in at least one domain such as search, vector retrieval, analytical databases, or observability platforms
• Experience formulating representative datasets and workload behaviors, including query patterns, concurrency, and ingestion
• Strong experimental methodology, accounting for repeated measurements, variability, cache effects, and noise separation
• Background in setting up reproducible test environments with documented configurations and procedures
• Effective technical communication skills to articulate complex findings and limitations
• Collaboration skills necessary to translate performance metrics into actionable engineering advice

Qualifications

• Background working with Elasticsearch, Lucene, Rally, ClickBench, or vector search benchmarking frameworks
• Experience evaluating retrieval relevance alongside throughput, resource utilization, and latency
• Familiarity with cloud cost analysis, autoscaling, and serverless architectures
• History of public technical writing, open-source software contributions, or published performance benchmarks

Core Skills

Benefits

• Base salary compensation ranging from 307 800 zł to 486 900 zł PLN
• Health insurance coverage for employees and their families in many regions
• Flexible schedules and calendar arrangements for eligible positions
• Generous yearly vacation days
• Financial donation matching up to $2000 or regional currency equivalent
• Up to 40 hours annually for volunteer projects
• At least 16 weeks of parental leave

Frequently Asked Questions

Answers are based only on the employer’s listing; where it doesn’t say, neither do we.

Sample Interview Questions

AI-generated questions tailored to this specific role — a preview of the full practice set.